Looking at the others in the ultra-SFFPC market segment they’re targeting (e.g. Mac Mini, Intel NUC, Nvidia DIGITS) this is a solid first outing.
It’s a standard ITX mainboard that happens to have soldered ram. It will fit in any ITX-compatible case and even has dedicated PCI-e slot in case you do use a case with space for a PCI-e device like an SFP+ card.
On the upside, the unified ram means the GPU can use it, and so you could run 70b-size models on it.
Looking at the others in the ultra-SFFPC market segment they’re targeting (e.g. Mac Mini, Intel NUC, Nvidia DIGITS) this is a solid first outing.
It’s a standard ITX mainboard that happens to have soldered ram. It will fit in any ITX-compatible case and even has dedicated PCI-e slot in case you do use a case with space for a PCI-e device like an SFP+ card.
On the upside, the unified ram means the GPU can use it, and so you could run 70b-size models on it.
The version with 128GB ram is $1999.
Nvidia’s equivalent (DIGITS) is $2,999.
How do you know that it is equivalent? Or what the price is?
Equivalent as in 128gb of unified RAM targeting casual ML workloads. The price should be on any news article about it.