Routing Structured Outputs During Generation
Route M-Flight, streaming cutlines, multi-surface output, and optional in-flight lossless coding
A language model generation already contains information that most application pipelines discard: token probabilities, partial structure, confidence changes, segment boundaries, and the moment at which a typed object becomes complete. Conventional systems wait for the entire response, then invoke a parser, classifier, second model, or postprocessor to rediscover structure that was visible during emission.
Route M-Flight is a streaming architecture that routes, validates, records, and optionally entropy-codes typed segments during one generation flight. A model emits into declared channels—claims, actions, deltas, citations, explanations, tool arguments, receipts, or fallback prose. Segment validators operate at cutlines. Completed segments can be sealed with exact context, model/runtime identity, probability quantization, output digest, and raw fallback.
The immediate product value is not compression. It is lower duplication, earlier useful structure, bounded repair, and one-pass population of several surfaces. The compression extension uses the emitting model's own next-token probabilities to code exact output without a second inference pass, but bit-exact decoder conformance remains a serious research constraint.
Current evidence state
SPECIFIED
This label describes the strongest public-safe state of the specific paper claims. Open the paper's claim ledger for claim-level distinctions and limitations.
Publication
- Full paper:
/papers/p14-route-m-flight - Claim ledger:
content/papers/p14-route-m-flight/claim-ledger.json - Source manifest:
content/papers/p14-route-m-flight/source-manifest.json - Diagrams: 3
- Approximate body length: 1,407 words
Demonstrations
d10-route-m-flight-stream-router
Benchmarks
b02-fold2-codec-laboratoryb05-surfacedelta-uplift
Public boundary
The research entry publishes a public-safe architecture and evidence record. It does not grant implementation rights or expose restricted claim-ready material.