Wayfinder Router: deterministic routing of queries between local and hosted LLM

Deterministic prompt-complexity routing — send each prompt to your local or cloud model, offline, with no model call to decide. Quickstart · Benchmark · How it compares · Explainer · Changelog No model callto decide the route Deterministicand fully offline Calibrateon your own data Bring your own keyself-hosted Wayfinder looks at a prompt's structure (length, headings, lists, code) and its wording (proofs, math, hard constraints), then tells you whether to send it to your small local model or your big cloud one. It decides in microseconds, runs offline, and never calls another model to make the call: no API key, no network, no model call to decide. You get a score and a recommendation, and what you do with it is up to you.

…

Excerpt limited to ~120 words for fair-use compliance. The full article is at GitHub.