Ditching CUDA for AMD ROCm for more accessible LLM inference. Ryzen APUs Edition.
medium.com
We test the limits of ROCm compatibility (CUDA’s alternative) using Ryzen APUs, for GPU accelerated at-home LLM training.
  • LoafyLemon@alien.topBEnglish
    1·
    11 months ago

    Yep. I just did that the other day to run Stable Diffusion as I could not get it to install required drivers any other way.