Home | Notifications | New Note | Local | Federated | Search | Logout

Note Detail

Reply to @lain@lain.com
Wanderer atop the sea of clouds or whatever@WandererUber@poa.st (2026-07-29 22:51:48)
@lain It's actually an interesting video. I wonder how tough it would be to abuse structured output or constrained grammars to this end, i.e. raising the logits of the period continuously. Probably pretty hard though because the way the APIs are going they are hiding all the inner workings, plus that doesn't really propagate back into the NN to tell it to "wrap it up"
---Reply---
Blurry Moon@sun@shitposter.world (2026-07-29 22:57:13)
@WandererUber @lain llama.cpp lets you enforce a regular grammar on output and I think also now you can do it sort of with some others using json-schema, is that the same thing?

---Replies---

Wanderer atop the sea of clouds or whatever@WandererUber@poa.st (2026-07-29 23:01:59)
@sun @lain former is grammar, latter is structured output
it is the mechanism that I meant, yes. Problem with grammar is that it is dog slow when doing stuff like that, apparently. Plus token!=word so tough to implement. 
Also, like I said, model does not "see" that you're doing this, internally.