devwithjevJev Answers Typed State Questions
0xBakeer says Jev runs alongside an LLM on a Spark, answering typed questions about a state in one forward pass and returning a probability for each answer.
View on X timeOne question takes 20.6 ms on the Spark and 30.3 ms on my M2 Max. Fifty questions in one call take 157
0xBakeer@0xBakeer𝕏
I put a second model next to the LLM on my Spark. It does not write text. You send it a state and typed questions, and it answers every one of them in a single forward pass, each with a probability. Yes it is Jev the open source version. It can be installed on macOS, any Nvidia gpu or dgx sparks One question takes 20.6 ms on the Spark and 30.3 ms on my M2 Max. Fifty questions in one call take 157
The author says Jev can be installed on macOS, Nvidia GPUs, and DGX Sparks. They report timings for one question on a Spark and an M2 Max, and for fifty questions in one call.
Also filed under Tools & apps
- Meta Ad Analysis Chrome Extension
The Chrome extension analyzes ads from Meta’s Ads Library using JEV (typesafe/jev-1.13) via OpenRouter, surfacing result potential, angle, hook, and niche. The user’s key stays in their browser.
- Jev Plugin for the PI Harness
The repository provides a Jev plugin for the PI Harness.
- Jev Suggestion Plugin for Hermes
The repository is a Hermes plugin named `jev-suggest`.
- OpenRouter Draft Evaluator
This local prototype evaluates and compares drafts generated with OpenRouter using Jev.