devwithjevJevify Speeds Up Local Model Responses
The author compares Qwen3.8-27B heretic Q4 with and without Jevify, reporting that Jevify returns choice probabilities instead of generated prose. The author says it is 3–5 times faster, suited to simple probability-based replies, and not suited to answers requiring explanations, code, or long text.
View on X time15秒（2回目は2秒）; 45秒（2回目は10秒）
石ちゃん🎤LLMでアプリ開発@Isichan_Hitori𝕏
【 無検閲の Jev？ 】 ～hereticが3〜5倍速くなった～ Qwen3.8-27B heretic Q4と heretic＋Jevify に同じ質問を投げました。 heretic + Jevify 15秒（2回目は2秒） → 選択肢の確率だけ返す heretic だけ 45秒（2回目は10秒） → 普通に文章を生成 ・速度は3～5倍 ・知識はhereticのまま ・手元のローカルモデルで可能 ・回線に速度に影響されない 向く ・単純な確率で返せる返事 ・0.95超えたら流すなどの条件分け 向かない ・理由が要る回答 ・コードや長文 無検閲のJevではないですが、無検閲のモデルにJevの返し方を載せられます。
The author says Jevify can be used with a local model and that network speed does not affect it. The model’s knowledge remains that of heretic.
Also filed under Tools & apps
- Jev Auth Event Auditing and Alert Telemetry
It provides shadow-mode Jev authn/authz event auditing and alert telemetry for OAuth2 and IAM.
- Ask Questions About Git History
HekaJev lets users ask questions about Git history in plain English. The open-source tool is built using Jev.
- Local Jev-Compatible Decision-Model Runner
ollaya is a local decision-model runner with a Jev-compatible System One API.
- Open Jev-Style Decision Model
JevAny is an open Jev-style model and training stack for typed decisions and option probabilities.