devwithjevG1 Humanoid Navigates Virtual Kitchen
JEV controls a G1 humanoid in a virtual kitchen, guiding it around obstacles to reach the stove.
View on X timeabout 64 seconds of simulation time
jpmonty@jpmontoya271𝕏
I put TypeSafe’s JEV in control of G1 humanoid in my virtual kitchen. The mission: reach the stove with obstacles on the way. A VLM and depth information helped map the kitchen. A path planner produced possible ways around the obstacles, and JEV chose which move to make next. A pretrained walking policy handled locomotion, with calibrated controls for turns, forward movement, and curves. The robot reached the stove in about 64 seconds of simulation time. This video shows the highlights. Still a prototype, but pretty cool watching perception, decisions, and movement come together.
A VLM and depth information helped map the kitchen, and a path planner generated possible routes around obstacles. JEV chose the next move while a pretrained walking policy handled locomotion with calibrated controls for turns, forward movement, and curves. The author describes the build as a prototype.
Also filed under Robotics & devices
- Hand Gestures Control a Computer
Jev detects hand gestures and movement to control a computer in real time.
- MuJoCo Robot Decision Workbench
EmbodiedJev is a MuJoCo robot decision workbench with MiniCPM5-2B, Jev, and compatible model APIs.
- Jev Controls an xArm7 in MuJoCo
The MuJoCo xArm7 study has Jev choose movement directions and gripper actions from physical feedback.
- Testing Jev for Real-Time Robot Supervision
Engineermaxxing’s team tested whether Jev could supervise a robot in real time during the “Rebuild With Jev” hackathon, where they won.