Jev Controls a MuJoCo Metal Arm
Isaac Sin reports using Jev to drive a MakerMods AI Metal arm in MuJoCo. Jev receives the environment state as JSON and selects bounded actions to carry out instructions such as putting a red apple in a blue bin.
View on X time9 decisions at ~150 ms each
Isaac Sin@IsaacSin12๐
Got @typesafeai Jev driving our @makermodsai Metal arm in MuJoCo. Images are of the sim camera is not passed in, sim hands Jev the state of the environment in JSON and it picks the next bounded action (hover, descend, grasp, lift, place) as a typed choice with a confidence score. Jev makes the decisions for example "Put the red apple in the blue bin", and it runs in 9 decisions at ~150 ms each, an
The simulation camera is not passed to Jev. Its actions are typed choices with a confidence score.
Also filed under Robotics & devices
- Evaluates Machine Faults with Jev
The project replays compressor telemetry through an emulated device, uses code to flag suspicious behavior, and asks Jev to identify the fault described by a machine manual.
- Hand Gestures Control a Computer
Jev detects hand gestures and movement to control a computer in real time.
- MuJoCo Robot Decision Workbench
EmbodiedJev is a MuJoCo robot decision workbench with MiniCPM5-2B, Jev, and compatible model APIs.
- Jev Controls an xArm7 in MuJoCo
The MuJoCo xArm7 study has Jev choose movement directions and gripper actions from physical feedback.