Ditching CUDA for AMD ROCm for more accessible LLM inference. Ryzen APUs Edition.
medium.com
We test the limits of ROCm compatibility (CUDA’s alternative) using Ryzen APUs, for GPU accelerated at-home LLM training.
  • TeutonJon78@alien.topBEnglish
    1·
    1 year ago

    Maybe when AMD supports ROCm for more than like 3 consumer cards at at time.

    CUDA supports cards going back many generations. AMD keeps cutting off cards that already had existing support – Polaris has been cut for awhile, Vega/VII either just got cut or in is in the next release.