vegeta@lemmy.world to Technology@lemmy.worldEnglish · 14 days agoDeepSeek's AI breakthrough bypasses industry-standard CUDA, uses assembly-like PTX programming insteadwww.tomshardware.comexternal-linkmessage-square31fedilinkarrow-up1337arrow-down113cross-posted to: [email protected][email protected]
arrow-up1324arrow-down1external-linkDeepSeek's AI breakthrough bypasses industry-standard CUDA, uses assembly-like PTX programming insteadwww.tomshardware.comvegeta@lemmy.world to Technology@lemmy.worldEnglish · 14 days agomessage-square31fedilinkcross-posted to: [email protected][email protected]
minus-squarefilister@lemmy.worldlinkfedilinkEnglisharrow-up60arrow-down3·14 days agoWhat is amazing in this case is that they achieved spending a fraction of the inference cost that OpenAI is paying. Plus they are a lot cheaper too. But I am pretty sure that the American government will ban them in no time, citing national security concerns, etc. Nevertheless, I think we need more open source models. Not to mention that NVIDIA also needs to be brought to earth.
What is amazing in this case is that they achieved spending a fraction of the inference cost that OpenAI is paying.
Plus they are a lot cheaper too. But I am pretty sure that the American government will ban them in no time, citing national security concerns, etc.
Nevertheless, I think we need more open source models.
Not to mention that NVIDIA also needs to be brought to earth.