Assuming the training software could be run on the hardware and that we could distribute the load as if it was 2023, would it be possible to train a modern LLM on hardware from 1985?
Assuming the training software could be run on the hardware and that we could distribute the load as if it was 2023, would it be possible to train a modern LLM on hardware from 1985?
I think you’d need roughly a billion of them. Minus the 20 you have, of course.
Estimate of up to 30 million C64 were produced so I guess not enough if I managed to get every single one in the world