The 3D view paused because the browser dropped the graphics context. It resumes when the browser returns it.
01 · Survey
Scan
Someone walks the room with a phone. LiDAR returns a cloud of points, each with a distance, a colour and a little noise.
We simulated this cloud from the twin by casting rays from stations at 1.3 m. Range noise is 3 mm plus 0.25% of range, and the cloud has points. No real iPhone capture is wired in yet.
02 · Twin · a
Twin
The points become a room a physics engine can run: walls, fixtures, objects, and every drawer and door as a joint.
walls, fixtures, articulated parts and objects, measured in metres. The dimension lines come from the twin.
02 · Twin · b
Scan against twin
Drag the divider. Left is what the scanner saw. Right is what the simulator uses.
The scan is a noisy surface with no mass and no moving parts. The twin is clean geometry with colour, friction and joints.
02 · Twin · c
Every moving part is a joint
Pull the twin apart. Each door and drawer opens, and the simulator moves it with physics.
slides and hinges, each with the opening range the sim uses.
03 · Simulate
Simulate
A seven-joint arm and two walking people share the room. The arm assembles, then runs a recorded trajectory.
MuJoCo steps physics at Hz and the arm is controlled at Hz. The physics decides whether a run succeeded.
03 · Simulate · b
Your turn
Pick a task, then scrub the run.
Click any part to inspect it.