devwithjevRoutes LLM Calls to Cheaper Models
tiershift routes each LLM call to the cheapest model that can handle it. Routing is decided by TypeSafe Jev in ~180 ms.
Open source time~180 ms
iamvatsalpatel@iamvatsalpatel
Shift every LLM call to the cheapest model that can handle it. Routing decided by TypeSafe Jev in ~180 ms. No training data. Policy in plain YAML. TypeScript and Python.
It requires no training data and uses a policy written in plain YAML. It supports TypeScript and Python.
Also filed under Triage & routing
- How to Build Things with Jev & OpenJevs
How to Build Things with Jev & OpenJevs In this video, we build a model router using both the API-based original Jev and also using Semif. Github: code will be up in ...
- Jev is HERE. How to use it
Jev is HERE. How to use it In this episode, I talk with Ryan Vogel about Jev, a new type of AI built for classification. Ryan shows how Jev takes an input plus ...
- Jev-Shaped Classification Wrapper
jevper is a Jev-shaped classification wrapper over OpenAI-compatible clients that returns probabilities and confidence.
- Local Jev Protocol Multi-Upstream Router
jev-switch is a local multi-upstream router for the Jev protocol with a Rust backend and React interface.