Indeed, and vastly underpowered for that amount of content.
I’m curious how many more subreddits I can scrape from without sweating though. 130 hasn’t even move the needle.
The issue isn’t the content itself. it’s the number of users/federation activity the server has to churn through for folks not local to the instance or pulling in stuff remotely.
Looking at my own server’s performance as i’ve been fucking around w/different things, the bottleneck is all the federation that server is trying to go through without enough resources to support it. Wish there was a way to spread that out more other then people having to move. I’ve got a ton of CPU/Memory/Disk in these Dell R720xds and R730xds that are happy to chip in beyond scraping the subreddits I used to follow.
Ya, i’ve not really dug into it too deep but it seems like it’s just spewing plain text json across the web from the bits of logs I’ve had to mess with lmao.
Indeed, and vastly underpowered for that amount of content.
I’m curious how many more subreddits I can scrape from without sweating though. 130 hasn’t even move the needle.
The issue isn’t the content itself. it’s the number of users/federation activity the server has to churn through for folks not local to the instance or pulling in stuff remotely.
Looking at my own server’s performance as i’ve been fucking around w/different things, the bottleneck is all the federation that server is trying to go through without enough resources to support it. Wish there was a way to spread that out more other then people having to move. I’ve got a ton of CPU/Memory/Disk in these Dell R720xds and R730xds that are happy to chip in beyond scraping the subreddits I used to follow.
I wonder if there are better protocols for this thing than ActivityPub.
That’s a great question. There probably are, but they’re hidden/less adopted or difficult to deploy or whatever :(
Would be awesome it included some encryption too
It seems really weird each identity doesn’t have a public/private key, but whatever.
Ya, i’ve not really dug into it too deep but it seems like it’s just spewing plain text json across the web from the bits of logs I’ve had to mess with lmao.
“eh, good nuff” - Dessalines (probably)