Source record

Published by Hacker News · Show HN (50+ points) (T2 source). The original is at https://github.com/experientiallabs/experiential.

Pipeline notes

The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.

Open-source Rust model gateway unifying self-hosted, frontier, and open-source model access with zero markup and under 1-2ms added latency. Routes each request to the optimal model using OTel traces, simulated rollouts, LLM judges, and a nearest-neighbor classifier on prompt embeddings. Includes 1000+ models auto-refreshed daily via a codex agent.

Concrete, deployable model router whose per-prompt simulation-based routing is a distinct approach from static single-model or round-robin strategies, with zero markup and open-source code.

Cited by

No citations on record.