Home | Notifications | New Note | Local | Federated | Search | Logout

Note Detail

Reply to @trogdor@rayci.st
lain@lain@fediffusion.art (2026-09-10 15:34:25)
@trogdor @anemone what kind of performance do you get with that?

---Reply---
Trogdor the Burninator :trogdor:@trogdor@rayci.st (2026-09-10 15:36:58)
@lain @anemone I get about 200 tok/s prefill and 17 tok/s decode
Reply 
---Replies---
lain@lain@fediffusion.art (2026-09-10 15:38:21)
@trogdor @anemone that's pretty good!