TypeLLM 发布开源工作流模型，可将整个工作流作为一次 API 调用执行，把 JSON Schema 转成依赖图并在单一共享上下文上运行。它基于 SGLang 做约束解码，enum/boolean 只给一个打分 token、数字限定位数、依赖图复用缓存前缀，因此无需改动权重即可从原生 Qwen checkpoint 获得 schema 保证的输出。
Open source meets type-safe AI, with TypeLLM.
Chat models give you a reply and decision models give you a choice, but TypeLLM is built to run your whole workflow in one API call.
Most production pipelines need something in between: several typed answers, some depending on others, a few that should exist only under certain conditions.
TypeLLM takes that whole shape as one JSON Schema and executes it as a dependency graph over a single shared context.
Typed LLM outputs, built in the open.
You can get schema-guaranteed outputs from a stock Qwen checkpoint without touching its weights.
The guarantee comes from how the requests are built and decoded.
TypeLLM sits on SGLang and turns a JSON Schema into constrained decoding: one scored token for an enum or boolean, bounded digits for numbers, and a dependency graph that reuses cached prefixes.
So a field can’t return a value outside its enum, because the decoder only considers the allowed candidates.
Chat models return messages. Decision models return decisions. Workflow models execute workflows. TypeLLM introduces the first workflow model. Run an entire workflow in a single API call. Simpler, faster, cheaper. Try it now: https://typellm.ai/examples/ticket-workflow在 X 查看被引用的帖子
来源：Rohan Paul · x.com