- cross-posted to:
- [email protected]
- games
- [email protected]
- [email protected]
- cross-posted to:
- [email protected]
- games
- [email protected]
- [email protected]
As it fucking should be, this is like the third time they have tried to redesign the chip to get around export restrictions
And yet all of the good, open source LLM work is coming out of China. But hey, maybe this will spur some ROCm development so AMD cards don’t suck so fucking hard in that space.
AMD is also subject to export restrictions.
I liked your original comment before the edit, it’s true. AMD only has consumer grade hardware, which is the main reason the majority of the AI projects don’t support it. Code written for CUDA can work on a A100 just as well as a 3090, there’s no money in developing software to run on someone’s 4 year old gaming PC.
AMD makes a few Mi999 cards that support pytorch with ROCM and are subject to the export ban.
Not sure how I missed the MI250 series, but thanks.
Right? It’s really unfortunate that so many of the Chinese people that make awesome stuff get limited because CCP has garnered so much distrust that they won’t use AI to advance their surveillance and authoritarian control systems both domestically and abroad.
I mean it was also a shame how much the actions of the NSA weakend trust in West as well.
I’m deeply skeptical that export controls are going to work with China if the item in question is a consumer GPU unless you’re going to radically redesign the things to do something extremely obnoxious like require cryptographically-secure online activation every boot. There are just too many individuals and small businesses in random other countries who are going to be able to buy them and resell them. The chain over which a GPU travels is too far disconnected from entities that we can directly affect.
Maybe they can induce a very limited delay, or increase costs to a limited degree, but I assume that that’s not what the goal is.
You can only effectively export-control something if, all along the chain from the manufacturer to the end user, you can clearly distinguish between a legit and non-legit user. There’s no way that some random electronics store in Kazakhstan is going to know whether the person buying a 4090 with cash is going to sell it in China or use it themselves.
It’s also kind of ridiculous to think that anyone using a consumer grade GPU is a threat. No one doing work with AI is using a 4090, they’re using enterprise grade cards with 80GB of vram (H100/A100, even P40’s in a pinch). The 4090 is a nice toy for running Stable Diffusion and low grade
ERPLLM models and that’s about it.Bad logic. If there’s risk involved and they can’t get the. Legitimately, it’s going to add a significant overhead.
So nice of the US to encourage the growth of our trade partner’s domestic chip manufacturing