devwithjev
โ€” reading nowโ€” views
Submit a build

Jev Calibration Reports and CI Checks

jeval analyzes Jev logs to assess confidence calibration and when a human should take over. It produces an HTML report and can fail CI when a new model behind jev-latest shifts calibration.

HOPE | Engineer.HOPE | Engineer.@rlaope๐•
Using Jev? Every answer comes back with a confidence. But is 0.9 really right 90% of the time, and at what confidence should a human take over? jeval answers both from your own Jev logs in a single HTML report, and fails your CI when a new model behind jev-latest shifts calibration. Don't want to learn the CLI? It ships with agent skills: hand it to your coding agent and get the report back. https://t.co/ycFYZ5bdNs #jev #skill
Sep 27, 2026X postsView on X
It also ships with agent skills, so a coding agent can run it and return the report without requiring users to learn the CLI.

Also filed under Tools & apps