Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square121fedilinkarrow-up1563arrow-down16cross-posted to: [email protected]
arrow-up1557arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square121fedilinkcross-posted to: [email protected]
minus-squareJackbyDev@programming.devlinkfedilinkEnglisharrow-up1·8 hours agohttps://www.reddit.com/robots.txt
https://www.reddit.com/robots.txt