devwithjevJev Search and Rerank Evaluation
The project evaluates whether a TypeSafe Jev reranker beats embedding search on the Agent Skills Hub catalog. It uses graded relevance evaluation over 9,831 pairs and 164 zh/en queries, with judge-circularity bias measured.
zhuyansen@zhuyansen
Does a TypeSafe Jev rerank beat embedding search? Graded relevance eval (9,831 pairs, 164 zh/en queries) over the Agent Skills Hub catalog, with the judge-circularity bias measured.
Also filed under Research & data
- Visualizes French Wikipedia Elites
The project is a data visualization of French elites on Wikipedia. Its crawl is ongoing, with new biographies arriving.
- GraphRAG with Swappable Laya and Jev Models
This project is an agentic GraphRAG pipeline with swappable local Laya or cloud Jev decision models.
- Jev Probability Calibration Experiments
The repository presents reproducible experiments on Jev probability calibration, uncertainty, and forecast preservation.
- Benchmarks Jev for Malicious Skill Detection
jev-skillbench benchmarks Jev as a malicious agent-skill detector on MalSkillBench with verify-and-escalate evaluation.