Parallel Token Compression Engine
Praash built a token compression engine using Jev that evaluates large-document chunks in parallel and strips 85% of boilerplate. It aims to reserve Claude or GPT-4 for high-signal answers.
View on X timesub-100ms passes
I built a token compression engine using Jev.
It evaluates document (huge text) chunks in parallel, in sub-100ms passes, stripping 85% of boilerplate so we only pay Claude or GPT-4 for high-signal answers.
Here is a demo https://t.co/3nVjtG8zZY
The author shared a demo.
Also filed under Tools & apps
- Swift Client for TypeSafe Jev Judgments
swift-jev is a Swift client for TypeSafe Jev that uses typed judgments instead of generated text.
- Go SDK and CLI for Jev Decisions
go-jev provides a Go SDK and CLI for TypeSafe Jev typed yes/no, Choice, and Score decisions.
- Open-Model Semantic-If Engine
SemIf-OpenJev is an open-model semantic-if engine for local Jev-style decisions.
- Open-Weight Jev Decision Model
JevK5 is an open-weight Jev alternative that returns typed decisions with probabilities in one forward pass.