Reddit user chain-77 discovered that a $95 Ryzen 5 4600G APU can do respectable AI work by telling Linux to see it as a 16GB GPU. Although the processor doesn’t compare to dedicated cards in traditional graphics rendering, AI relies heavily on memory, where an APU’s ability to allocate shared memory freely becomes an advantage.
You must log in or register to comment.
Interesting. If LLama performance and the GPU allocation improves, it could make a lot of sense to build something like that with the last generation of DDR4 APUs because that memory is cheap.
