jevland

replica source-backed

system-one: batched single-token choice inference

Constrains token selection to choice indices so any open LLM answers many questions in one pass; includes Doom and Wikipedia-racing demos on Qwen models.

172 ms versus 600 ms median action latency compared with tool calling on Qwen3-8B.

source-backed — Public repository, docs or live artifact. About this label

← Back to the directory