The quantized model you can run locally works decently and they can’t read any of it, which is nice.
I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf
If you’re looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
If you’re ready to tinker a bit i can recommend Ollama for the backend and Open web UI for the frontend. They can also both run on the same machine.
The advantage is that you can use your GPU to compute, which is a lot faster.
Pretty sure LM studio is not open source
You’re right, I thought they were but I checked their GitHub and LM Studio itself isn’t.
It won’t fuck off even if you ask it how to disable it gives you bullshit answers. Some “AI”.
Yeah first thing I did was ask it how I could dissable it.
At least the new windows copilot told me how to disable it.
It finds it way to you in many forms, even if you disable it in one place.
Taskbar, Startmenu, Edge browser, the new Office to name a few.
They will push it wether you like it or not
I just blocked its user account
Don’t see any option to block it on messenger yet
What happens if you ask it to create Prof Farnsworth saying “Fuck Off”?
Could you then use the AI generated Farnsworth to instruct the AI to Fuck Off?
Where are you guys running into this? I thought for the most part tech people dropped anything associated with meta
Some people are ‘forced’ to use WhatsApp due to it being the messaging platform of choice for a lot of people.
Oh gotcha, I kinda forgot that was under the meta umbrella
You’re not forced to see anything.
I put it in quote marks. Obviously I’m not actually forced to use it, but my entire family uses it and it’s the dominant messaging platform in Indonesia - to the point where people get annoyed with you if you send regular SMS or just end up replying to you on WhatsApp. A lot of businesses large and small also exclusively use it, so you’re causing yourself a lot of annoyance if you actively avoid WhatsApp. It’s a crap situation, but it’s reality in some countries.
For me it’s WhatsApp because it’s the defacto group messaging choice
your defacto group messaging choice
Don’t throw all of us under that bus, please and thanks
Since it’s what everyone else uses, it’s what I need to use. Good luck getting everyone to switch to another app
Well, see? That’s what I was on about. It may be what everyone you know uses, but it’s not what everyone I know uses.
But for sure - getting people to switch messengers seems like forcing them to take on a new religion. Not something I’d ever want to force on anyone
“Who are those horrible orange creatures over there?”
“Why, those are the Grunka Lunkas. They work here in the Slurm factory.”
“Tell them to fuck off!”
At least meta AI actually releases most of their models, and publishes research papers about the ones they don’t.
There are couple of things you have to do different if you’re the underdog, don’t make it a good guy Meta argument.
The models are marketing, and we can be fine with it.
