Afaik, gpu cores a very stripped down cpu cores that do basic math, but what sort of math can cpus do that gpus can’t

I’m talking, cpu core vs Tensor/Cuda cores.

  • capn_hector@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    to echo others, it’s not what, but how.

    cpus do execution reordering and speculation to run one thread really fast. gpus have mostly avoided that and execute threads in large groups called “warps” (analogous to lanes of a SIMD unit).