devwithjevTests Jev’s Confidence Calibration
Anshul tested whether Jev was correct 90% of the time when it said it was 90% sure, using 385 real bank-support messages.
Anshul@realanshull𝕏
Everyone's posting how fast Jev is. I tested something else: when it says it's 90% sure, is it actually right 90% of the time? 385 real bank-support messages later, here's what I found 🧵 https://t.co/JY0ItyHtYo
He framed the test as an alternative to measuring Jev’s speed and shared his findings in a thread.
Also filed under Tools & apps
- Jev Auth Event Auditing and Alert Telemetry
It provides shadow-mode Jev authn/authz event auditing and alert telemetry for OAuth2 and IAM.
- Ask Questions About Git History
HekaJev lets users ask questions about Git history in plain English. The open-source tool is built using Jev.
- Local Jev-Compatible Decision-Model Runner
ollaya is a local decision-model runner with a Jev-compatible System One API.
- Open Jev-Style Decision Model
JevAny is an open Jev-style model and training stack for typed decisions and option probabilities.