Home | Notifications | New Note | Local | Federated | Search | Logout

Note Detail

Reply to @wouter@pleroma.debian.social
Wouter Verhelst@wouter@pleroma.debian.social (2026-09-29 10:24:29)
@lettosprey
> The "run at home" LLM's are not exactly much to get excited about.

Certainly true several months ago, and probably true today (more so from an ideological than a technical pov).

I feel the way out of this mess though is through this. If we "run at home" LLMs are competitive with hosted ones, then when the bubble bursts and big tech must hike their prices, not even the people most convinced will want to use them anymore.
@xgranade
---Reply---
lain@lain@fediffusion.art (2026-09-30 21:50:14)
@wouter @lettosprey @xgranade you can run qwen 3.8 flash next at home with a strix halo or a big mac, as long as you have ~128gb ram. that's at around opus 4.6/4.8 level, so very usable. I had it write me a fediverse server and a gameboy emulator without guidance.

---Replies---

Lett Osprey :v_pan: :v_enby: 🍉 :therian:@lettosprey@tech.lgbt (2026-09-30 22:17:39)
@lain You mean you have an LLM that managed to create software that already exist as open source?

Impressive!

Having open source projects that do what you wanted is definitely not guidance!!!

@wouter @xgranade