Hello, I want to standardize my home servers and reduce them to 3 Proxmox computers. 2x a Tiny server and a slightly more powerful one for AI (ollama/open webui and deepseek-r1-70b, CPU based only, no GPU).
For the more powerful server, I am wavering between 2 processors: i9-10940X vs. i9-14900KS.
i9-10940X
- 14 Cores (3,30-4,8 GHz == 67,2 GHz)
- 28 Threads
- Quadro-Channel DDR4-2933 (PC4-23466, 93.9GB/s)
i9-14900KS
- 24 Cores (8Power+16Economy - 2,40-6,2 GHz == 117,6GHz)
- 32 Threads
- Dual-Channel DDR5-5600 (PC5-44800, 89.6GB/s)
I don’t like the Idea of the Power/Economy-Cores… And the newer i9 has only dual-channel for RAM instead of quad. But it has double of GHz.
Which is better for my solution? I also want a relative low idle power consumption.
thank you all!
You’re not going to run deepseek r1 without GPUs (plural).
you can, but it’ll be the distilled versions that are significantly less impressive.
https://apxml.com/posts/gpu-requirements-deepseek-r1
Newer versions also introduce memory mapping so they’re technically only bound by your storage capacity (but they’re way slower in practice).