WeSearch

Show HN: Distill and serve small models with frontier quality for half the cost

·3 min read · 0 reactions · 0 comments · 8 views
#show#distill#serve#small#models
Show HN: Distill and serve small models with frontier quality for half the cost
TL;DR · WeSearch summary

World Model Optimizer wmo turns agent traces you already collect into continuous improvement. Start with a model endpoint at frontier quality with 40%+ lower cost. Keep improving it with world model simulations, meta-harness optimization, and model distillation. 🌐 Platform | 📚 Docs | Discord Getting started 1.

Key facts
About this source

Hacker News (Front Page) files mainly under programming. We currently carry 633 of its stories. Top-voted stories on Hacker News.

Original article
GitHub
Read full at GitHub →
Opening excerpt (first ~120 words) tap to expand

World Model Optimizer wmo turns agent traces you already collect into continuous improvement. Start with a model endpoint at frontier quality with 40%+ lower cost. Keep improving it with world model simulations, meta-harness optimization, and model distillation. 🌐 Platform | 📚 Docs | Discord Getting started 1. Register your providers. pip install world-model-optimizer wmo providers set 2. Tune a router on your OTel traces. wmo build --file traces.jsonl --name my-endpoint # Score every registered model on held-out tasks from your traces wmo optimize route sweep my-endpoint --traces traces.otel.jsonl # Turn those measurements into a routing policy wmo optimize route fit matrix.json --kind knn \ --out .wmo/models/my-endpoint/policy.json 3. Serve it.

Excerpt limited to ~120 words for fair-use compliance. The full article is at GitHub.

Anonymous · no account needed
Share 𝕏 Facebook Reddit LinkedIn Threads WhatsApp Bluesky Mastodon Email

Discussion

0 comments

More from GitHub