Home | Notifications | New Note | Local | Federated | Search | Logout

Note Detail

alle_yoj813@theorytoe@ak.kyaruc.moe (2026-07-22 16:18:10)
so for the ai-adjacent folk here are you paying for subscriptions? running models locally? or running models on a remote node?
---Reply---
:VD15_0::VD15_1::VD15_2::VD15_3::VD15_4::VD15_5::VD15_6::VD15_7:@VD15@pl.valkyrie.world (2026-07-22 16:25:07)
@theorytoe I used to run locally until torch dropped support for the cards I was using and I couldn't be fucked having a jet engine under my desk anymore. I'm on a pay-as-you-go plan for API access now but I still only use open weight models

---Replies---

alle_yoj813@theorytoe@ak.kyaruc.moe (2026-07-22 16:29:38)
@VD15 ok

I was looking into some of the stats required to run these models (mainly glm) and holy shit its a lot