Jev-Powered Simulated Robot Manipulation
The build uses Jev with SAM 3 on a simulated mobile robot, combining camera-depth observations with joint-state and contact feedback. Parallel Jev calls rank sampled movement, grasp, and placement poses, and a final Choice selects the action.
Zhuo Tao@runzhuotaoπ
Ok I got Jev + SAM 3 working on a simulated mobile robot! SAM 3 + camera depth provide 3D observations, alongside joint state and contact feedback. Code samples numerical movement, grasp and placement poses; parallel Jev calls rank them, then a final Choice picks the action. Noul and Score add supporting judgments, while deterministic controllers handle IK and motor control. Itβs almost through th
Noul and Score provide supporting judgments. Deterministic controllers handle IK and motor control.
Also filed under Robotics & devices
- Evaluates Machine Faults with Jev
The project replays compressor telemetry through an emulated device, uses code to flag suspicious behavior, and asks Jev to identify the fault described by a machine manual.
- Hand Gestures Control a Computer
Jev detects hand gestures and movement to control a computer in real time.
- MuJoCo Robot Decision Workbench
EmbodiedJev is a MuJoCo robot decision workbench with MiniCPM5-2B, Jev, and compatible model APIs.
- Jev Controls an xArm7 in MuJoCo
The MuJoCo xArm7 study has Jev choose movement directions and gripper actions from physical feedback.