devwithjev
— reading now— views
Submit a build

Framework-Agnostic Jev Intent and Tool Router

Huzeyfe_dev built a lightweight, framework-agnostic intent and tool router using TypeSafe’s Jev decision model to speed up agent loops.

View on Reddit
Huzeyfe_dev in r/LLMDevs@Huzeyfe_dev
Built a lightweight, framework-agnostic intent & tool router using Jev AI (to speed up agent loops) Hey everyone, Lately, while building agent architectures, I kept running into the same bottleneck: waiting for large generative LLMs to decide which tool to call or which path to take at every step is both costly and slow. Especially when low latency matters, traditional generative LLMs tend to bloat. TypeSafe's newly released "System One" decision model, Jev (typesafe/jev-1.13), offers a pretty solid alternative for this. Since it returns typed Choice and Score primitives instead of generating text, it's remarkably fast. However, there was a gap: there wasn't a standard, independent (framework-agnostic) router layer that you could just plug and play behind existing agent frameworks. Everyo
Sep 26, 2026Reddit postsView on Reddit
The project addresses the cost and delay of using large generative LLMs at each agent step to choose a tool or path. Jev returns typed Choice and Score primitives instead of generating text.

Also filed under Triage & routing

  • Jev-Assisted Codex Model and Effort Routing

    The project provides Jev-assisted model and reasoning-effort routing for local Codex Desktop and CLI.

  • Plain-English Gmail Filter Judge

    The project uses Jev (TypeSafe) to judge Gmail filters written in plain English.

  • MCP Tool Router with Jev and MCTS

    Harness-router is a lightweight tool router that uses Jev for fast tool selection and Monte Carlo Tree Search for harder multi-step decisions. It uses MCP as the tool interface and falls back when routing is uncertain.

  • Jev Intent and Tool Router

    Huzeyfe_dev built a lightweight, framework-agnostic intent and tool router using Jev AI. It is designed to speed up agent loops by routing decisions without relying on large generative LLMs at every step.