Home | Notifications | New Note | Local | Federated | Search | Logout

Note Detail

Reply to @wouter@pleroma.debian.social
Wouter Verhelst@wouter@pleroma.debian.social (2026-09-29 10:24:29)
@lettosprey
> It doesn't matter that "big tech are not the only ones that can...", when projects use their LLM's (...)

Absolutely. I am 100% with you that free software should not be beholden to big tech. Unfortunately "open source" was always a ploy to get big tech to embrace free software, and so depending on why you are here, you might not care as much. ("You" as in the hypothetical open source developer, not you personally)
@xgranade
---Reply---
Wouter Verhelst@wouter@pleroma.debian.social (2026-09-29 10:24:29)
@lettosprey
> The "run at home" LLM's are not exactly much to get excited about.

Certainly true several months ago, and probably true today (more so from an ideological than a technical pov).

I feel the way out of this mess though is through this. If we "run at home" LLMs are competitive with hosted ones, then when the bubble bursts and big tech must hike their prices, not even the people most convinced will want to use them anymore.
@xgranade

---Replies---

lain@lain@fediffusion.art (2026-09-30 21:50:14)
@wouter @lettosprey @xgranade you can run qwen 3.8 flash next at home with a strix halo or a big mac, as long as you have ~128gb ram. that's at around opus 4.6/4.8 level, so very usable. I had it write me a fediverse server and a gameboy emulator without guidance.