Today my PC finally ate it. No POST, no disk activity, so I’m pretty sure the mobo has failed. I built this PC 8 or 10 years ago, and I’m honestly too old and out of touch to know where to start on a rebuild lol.
I’m an arch Linux user, my job is in machine learning, and I’m looking at a soup to nuts style rebuild but I don’t know where to start. I want as much future proofing as I can get and I’m happy with a budget anywhere from $2k to $8k. I don’t game now, but I might want to in the future.
So it seems like to leverage good ML tools I’m locked to cuda, so probably Nvidia GPU. Does that mean 4070 Ti is the knee in the curve? CPU I came from AMD but I have no idea. RAM speed is something I have never ever considered. And mobo wise, I have a couple of M.2 drives now, but I’m not sure what else should drive decisions? 1 monitor currently that I intend to replace, so I’m not sure why I would need multiple GPUs or something that necessitates a lot of PCIe connections.
I want a plain old closed black case, no color changing gamer shit, and about as much computing power as I can get. Pcpartpicker came up a little short, how do I start?
I’ve got maybe a week of lead time, then I would like to pull the trigger. This whole build process was a lot easier circa 2003!
This is all great info and the new power supply and ram kit stuff is blowing my mind. Fortunately, my worn is not LLM related but just simple neural networks, but I don’t know how that might affect best practices for hardware.
Okay. If this is something you already do on existing machines, you’ll be in good position to know how much memory you actually need, and then maybe give yourself a little room to grow. My guess would be that you’re not working on massive models so you’ll probably be fine with a mid-range card.
At the same time, a lot of AI/ML stuff is becoming mainstream and requires a ton of VRAM to get good performance. If you do any work with graphics, audio, or video, you might find yourself running large models without really thinking about it. There are lots of use cases for speech recognition models, for example, which are quite large. Photoshop already has some medium-sized models for some tasks. Noise reduction for audio can also be quite demanding (if you want to do a really good job).
As for system RAM…the world of DDR5 is indeed complicated. I don’t think there’s a huge need to go over 6000MHz RAM, and faster RAM brings some compatibility issues with some mobos/CPUs. It’s also usually faster to use two sticks than four. So 2x32GB would be better than 4x16 in general.
For GPUs in particular, new gens with more VRAM are on the way, so buying the high-end now might leave you with something that feels obsolete by the time you grow into it. If you spend $750 now and $750 again in 2-3 years, you might end up better off than if you spent $1500 today and waited twice as long to upgrade. Particularly if you are able/willing to sell your old equipment to offset upgrade costs.
Solid advice. Saving this comment. Yeah I have 32G ram now and was thinking 64, so 2 sticks. I also think I’m going to roll Nvidia in the 4000 series as high as I can get without going over about 2k.
Still gotta resolve processor… I’m thinking AMD Ryzen but not sure how to pick which one. After that it’s just mobo and making sure I’ve got enough name/m.2 slots I guess?
Yeah. If you want to be on the cutting edge of storage, look for a mobo that has PCIe gen5 m.2 slots. But really, PCIe gen4 m.2 drives are still pretty darned fast. You can get some with >7GB/sec transfer rates. Do you need >12GB/sec transfer from disk? Probably not. Is it cooooool? Sure. :)
This is a popular SSD these days, very good for the price: https://us-store.msi.com/PC-Components/Storage-Devices/Solid-State-Drive/M482-NVMe-M2-2TB-Bulk . If you want something high-end, look for an SSD with DRAM cache. Useful if you’re writing massive amounts of data regularly, like video mastering or something like that, generally overkill otherwise.
I’ve been on the Ryzen x700 line for a long time now, first the 1700 and now on the 7700. No complaints, they rock. So I’d start by looking at the 9700. 9900 has more cores (and uses significantly more power), 9600 has fewer cores. Single-core performance is basically the same across the board, so it just depends on whether your workload can use a lot of cores or not. The “X3D” chips have additional CPU cache that supposedly improves performance in some workloads (notably in gaming). So if that’s important to you, the 9800X3D is the natural choice.
When training you’ll want way more VRAM than you need to run inference - get a 90 series GPU for the memory.