DeepSeek Flash Jev-Style Endpoint
Nick Khami says the team built an endpoint called deepseek-v4.1-flash-jev to make an open-source model behave like Jev using inference engineering.
Nick Khami@skeptrune𝕏
you can make any open source model behave like jev with just a bit of inference engineering. it's shockingly easy. to prove it, we built a new endpoint we're calling deepseek-v4.1-flash-jev. see the demo below. here's how it's done: sglang (an inference engine) offers a scoring endpoint in addition to the normal generation one. in scoring mode, given an input & set of possible answers, it forces t
The team used SGLang, which offers a scoring endpoint alongside normal generation. Khami says scoring mode takes an input and a set of possible answers.
Also filed under Tools & apps
- Meta Ad Analysis Chrome Extension
The Chrome extension analyzes ads from Meta’s Ads Library using JEV (typesafe/jev-1.13) via OpenRouter, surfacing result potential, angle, hook, and niche. The user’s key stays in their browser.
- Jev Plugin for the PI Harness
The repository provides a Jev plugin for the PI Harness.
- Jev Suggestion Plugin for Hermes
The repository is a Hermes plugin named `jev-suggest`.
- OpenRouter Draft Evaluator
This local prototype evaluates and compares drafts generated with OpenRouter using Jev.