But any 50 watt chip will get absolutely destroyed by a 500 watt gpu

If you are memory-bound (and since OP’s talking about 192GB, it’s pretty safe to assume they are), then it’s hard to make a direct comparison here.

You’d need 8 high-end consumer GPUs to get 192GB. Not only is that insanely expensive to buy and run, but you won’t even be able to support it on a standard residential electrical circuit, or any consumer-level motherboard. Even 4 GPUs (which would be great for 70B models) would cost more than a Mac.

The speed advantage you get from discrete GPUs rapidly disappears as your memory requirements exceed VRAM capacity. Partial offloading to GPU is better than nothing, but if we’re talking about standard PC hardware, it’s not going to be as fast as Apple Silicon for anything that requires a lot of memory.

This might change in the near future as AMD and Intel catch up to Apple Silicon in terms of memory bandwidth and integrated NPU performance. Then you can sidestep the Apple tax, and perhaps you will be able to pair a discrete GPU and get a meaningful performance boost even with larger models.

It’s not really a matter of poor taste, just unrealistic time management. There are way too many good games out there for me to ever actually play them all. I only played like half a dozen games last year. I bought…more than that.

I have a fairly large Steam catalog, most of which I have never played. However, I’m pretty sure they are almost all good games and I will definitely get around to some of them.

My bookshelf is similar. I’ve only read roughly half the books I have staring me in the face every day.

But on the plus side, anytime I’m bored, I have a wealth of options!

If you’re running a consumer level GPU, you’ll be operating with 24GB of VRAM max (RTX 4090, RTX 3090, or Radeon 7900XTX).

90b model = 90GB at 8-bit quantization (plus some extra based on your context size and general overhead, but as a ballpark estimate, just going by the model size is good enough). You would need to drop down to 2-bit quantization to have any hope to fit it in a single consumer GPU. At that point you’d probably be better off using a smaller model will less aggressive quantization, like a 32b model at 4-bit quantization.

So forget about consumer GPUs for that size of model. Instead, you can look at systems with integrated memory, like a Mac with 96-128GB of memory, or something similar. HP has announced a mini PC that might be good, and Nvidia has announced a dedicated AI box as well. Neither of those are available for purchase yet, though.

You could also consider using multiple consumer GPUs. You might be able to get multiple RTX 3090s for cheaper than a Mac with the same amount of memory. But then you’ll be using several times more power to run it, so keep that in mind.

We need a lock before the lock screen to deal with all the functionality you can now access without unlocking it.

Sometimes I accidentally turn on the flashlight when the phone is in my pocket. I call it asslighting.

According to BabyCenter.com user data, it’s the 13,388th most popular boy’s name. https://www.babycenter.com/baby-names/details/root-1704004

Are we so desperate that we want what is basically malware ported to Linux? Ew. I didn’t tolerate that shit when I was running Windows, and I’m sure not going to start now.

I’ll just keep on voting with my wallet, and not pay money for such user-hostile products.

Cool, thanks for sharing!

I see you prompt it to “Make sure to only use knowledge found in the following audio transcription”. Have you found that sufficient to eliminate hallucination and going off track?

True. I guess they will require you to enter your own OpenAI/Anthropic/whatever API token, because there’s no way they can afford to do that centrally. Hopefully you can point it to whatever server you like (such as a selfhosted ollama or similar).

In my experiments, local Whisper models I can run locally are comparable to YouTube’s — which is to say, not production-quality but certainly better then nothing.

I’ve also had some success cleaning up the output with a modest LLM. I suspect the VLC folks could do a good job with this, though I’m put off by the mention of cloud services. Depends on how they implement it.

Excuse my ignorance of microblog mechanics, but can you elaborate on this? Would Bluesky show me this shit just because my connections follow them, or something like that? Is there something I should know if I want to avoid this stuff, besides “don’t follow bullshit accounts” and “block people who post/repost bullshit”?

I’m on Bluesky, but I don’t use it much. I poke my head in now and then, mostly out of academic interest. I am interested to learn from your experience.

10 years ago, all I wanted was a brick-sized phone with a battery that won’t quit. Now that we have cheap and reliable portable power banks, it’s dropped down on my priorities list.

I guess a 22Ah battery would have a longer effective lifespan, too. I mean, if it drops to 50% capacity after a few years, that’s still more that double most phones. So that would potentially solve my longevity issue.

This link is more Lemmy-friendly: [email protected] (note that you might need to refresh the page after loading it, if this is the first time someone is loading it on your Lemmy instance).

Typically, I use a slow-charger overnight (a plain ol’ USB type-A charger, which I think means 5W max), then top-up as needed during the day with USB-PD fast chargers. I generally do not top up to 100% during the day. I have adaptive charging enabled in settings.

That said, I’m a heavy phone user, and I’ve never had a phone that reliably lasts me a full day. According to aBattery, my current phone is at 750 charge cycles, which is just about 1 per day since I bought it. I’m not up to date on all the latest developments in battery tech, but I think it’s normal for a battery to drop to 80% of its original max charge after 500 cycles. I don’t think I have a dud on my hands, just an ordinary battery that is aging as expected. Like I said, it’s still “fine”. It hasn’t started unexpectedly shutting off or anything like that.

I still have my old Pixel 2 (now 7 years old) that I occasionally use as a wi-fi device. I used that phone heavily for 2 years and very lightly for the remaining 5. I’m lucky if the battery lasts half an hour at this point; it’s basically a desktop device now.

Also works on Twitch with the added benefit of NOT playing ads (you still get breaks, just with a placeholder screen instead of the commercial).

mpv has yt-dlp support built in, so it can just play the streams directly.

vd (VisiData) is a wonderful TUI spreadsheet program. It can read lots of formats, like csv, sqlite, and even nested formats like json. It supports Python expressions and replayable commands.

I find it most useful for large CSV files from various sources. Logs and reports from a lot of the tools I use can easily be tens of thousands of rows, and it can take many minutes just to open them in GUI apps like Excel or LibreOffice.

I frequently need to re-export fresh data, so I find myself needing to re-process and re-arrange it every time, which visidata makes easy (well, easier) with its replayable command files. So e.g. I can write a script to open a raw csv, add a formula column, resize all columns to fit their content, set the column types as appropriate, and sort it the way I need it. So I can do direct from exporting the data to reading it with no preprocessing in between.

Yeah, I’ve replaced phones in the past that were perfectly fine except the battery was terribly degraded. With an iFixIt repairability rating of 2 stars and a new battery costing more than the phone was worth, it just didn’t make sense to fix it.

My current phone is only two years old and while it’s still “fine”, the battery life is noticeably lower than it used to be. I doubt it’ll remain useful for another two years.

Many brands now provide software support for longer than the hardware will remain useful (thanks to non-removable batteries). Strange times!

Consumers partly killed replaceable batteries by demanding things they couldn’t deliver. Waterproofing

Ehhhh…no, not buying it. We had water-resistant phones before the switch to non-removable batteries. For example, the Galaxy S5 (the last Samsung flagship with a removable battery) had an IP67 rating. The current Galaxy S24 has an IP68 rating. Go ahead, ask your average consumer what the difference is between IP67 and IP68, and how much they care.

Oh yeah, and the S5 also had a headphone jack and SD slot. You can do all these things and still have water resistance, so let’s all please stop perpetuating these myths. If you’re not on Apple’s or Samsung’s payroll, you do not need to lie for them.

Mathematicians: “First time?”

My experience might be a bit outdated, but I remember finding the default Mac OS X Terminal extremely slow. A few years back I ran an output-heavy command, and the speed difference between displaying the output in terminal vs outputting it to a file was orders of magnitude. The same thing on my Linux system was much, much faster. I’m not sure how much of that was due specifically to rendering, vs memory management or something else, though.

I might see if I can still reproduce this in Sequoia and if Ghostty is faster on Mac.

According to Rtings, the Samsung has a notably worse viewing angle than your other two. Take a look at the graphs:

Samsung: https://www.rtings.com/monitor/reviews/samsung/odyssey-g5-g50d-s27dg50#test_1417

Asus: https://www.rtings.com/monitor/reviews/asus/tuf-gaming-vg27aql1a#test_1417

Acer: https://www.rtings.com/monitor/reviews/acer/nitro-vg271up-pbmiipx#test_1417

Not sure if that explains your experience or if there’s something more to it.