minus-squarecandre23@alien.topBtoData Hoarder@selfhosted.forum•It is time keep hoarding AI models as Chinese censorship hits NYC based Huggingface the biggest AI librarylinkfedilinkEnglisharrow-up1·1 year agoAnywhere from 1 to several hundred GB. Quantized (compressed), the most popular models are 8-40gb each. LORAs are a lot smaller, but full models take up a lot of space. linkfedilink
candre23@alien.topB to Data Hoarder@selfhosted.forumEnglish · 1 year agoSSD shopping - how to find drives with DRAM cache?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareSSD shopping - how to find drives with DRAM cache?plus-squarecandre23@alien.topB to Data Hoarder@selfhosted.forumEnglish · 1 year agomessage-square0fedilink
Anywhere from 1 to several hundred GB. Quantized (compressed), the most popular models are 8-40gb each. LORAs are a lot smaller, but full models take up a lot of space.