Home | Notifications | New Note | Local | Federated | Search | Logout
Note Detail
Reply to @demha@comp.lain.la
Blurry Moon@sun@shitposter.world (2026-10-08 10:03:26)
@demha @lain @mischievoustomato as a matter of fact, something I am doing RIGHT NOW is: constraining the LLM in a custom web pixel art program, to make its tools, controls and panels etc according to YAML contracts that specify what the component is actually doing, parameters its passing, etc. Also, the editor has an edit and a readonly mode. I have put every panel and component into custom w3c web components; then, every component has a type annotation that indicates its behavior in either mode.
what this accomplishes is: there are npm tasks that check for missing or incorrect annotations, and builds fail if the checks fail. The LLM either builds it fucking right, or it fails. if it hallucinates anything, it fails.
you can do what you said.
---Reply---
Blurry Moon@sun@shitposter.world (2026-10-08 13:18:58)
@demha @lain @mischievoustomato to add a little more clarity here, there are certain things that can be mechanically tested and proved, like using strict typescript typing, and build-time checks that certain types have certain annotations. so, that at least proves intent. then, there are things you can't easily prove mechanically. So, I instructed the LLM: never change a function against it contract; never change the contract to make a function do something I asked. only permit an explicit request to change the contract first, then a second request to implement the change. and, the annotations are the source of truth for correctness audits.
it's not foolproof. but it helps, a lot.
Reply
---Replies---
Tshering dempa@demha@comp.lain.la (2026-10-08 15:55:22)
@sun @lain @mischievoustomato anywherei cab read about this or is this secret suce youve been cooki g while wroking with these
Tshering dempa@demha@comp.lain.la (2026-10-08 19:35:11)
@sun @lain @mischievoustomato i heard something about the bend language doing something like that with its LAWS.bend feature