Exea LabsSheet A-00

Arrival

Opening survey data 0 / 9

Exea LabsArrival
Repo on GitHub (opens in a new tab) Join on Devpost (opens in a new tab)

Survey Twin Simulation Dataset

Scan a room once. Get robot training data for that exact room.

One scan of a kitchen becomes a physics twin. A robot arm and two walking people run in it, and every successful run is written as a GR00T-format dataset. This page draws from that export. The room is an authored sample, and no real kitchen has been scanned yet.

Sheet
A-01 / 06
Scale
1 : 1, metres
Date
2026-10-19
Drawn
Exea Labs
Room
hero_kitchen
Source
authored sample

Sheet A-01Surveyhero_kitchen

04 · Dataset Sheet A-04

What the robot would train on

Each run is written in the LeRobot v2.1 layout that NVIDIA GR00T reads, with an eight-number state and action per frame plus the ego and wrist cameras. Six steps produce it.

Fig. 04a Scan, twin, simulate, dataset in 12 s Drawn animation of the pipeline. It contains no recorded data.
  1. Step 1

    Scan the room

    An iPhone LiDAR scan (Apple RoomPlan) captures the walls, counters, sink, stove and fridge. The twin on this page comes from the authored sample, since no real kitchen has been scanned in this repository.

  2. Step 2

    Compile the twin

    The compiler normalises the scan into fixtures with sizes, positions and colours, plus the drawers, doors and hinges they carry. Objects come from a small catalogue with mass and friction.

  3. Step 3

    Run the physics

    MuJoCo steps the room at 500 Hz. People are kinematic capsule walkers on seeded waypoint loops, and every step records their closest approach to the robot.

  4. Step 4

    Record an expert

    A scripted inverse-kinematics expert performs each task. A run counts only if the physics says it worked, such as the drawer being open or the bowl being in the sink.

  5. Step 5

    Export

    The export writes frames, states, actions and two 128 px cameras as LeRobot v2.1 in the GR00T layout.

  6. Step 6

    Validate

    A loader check reads the dataset back the way a trainer would, windows the actions, decodes the videos and reports any problems.

Step 1scan

geometry_source
room_id
bounds
scan points
stations
range noise
3 mm + 0.25% of range
status
simulated from the twin; real capture not wired in
walls
fixtures
articulated parts
objects
catalogue
frame
z up, metres
engine
physics
control
arm
people
generator
success check
attempts
successes
dropped
grasp
format
episodes
frames
fps
state / action
cameras
loader_check.ok
errors
warnings
windows
horizon
videos decoded
physically valid

Frames written

across episodes from task families

Control rate

Hz

this page plays them back resampled to fps

State and action

/

seven joint angles plus gripper opening, per frame

Cameras

at px

ego_view and wrist, shown live in the stage

05 · Evaluate Sheet A-05

Results from a small batch

The evaluation harness ran a small batch with the scripted expert while people walked through the room. The figures below come from the export.

Success per family, with a 95% Wilson interval around each result

Limits of these numbers

    Not done

      06 · Close Sheet A-06

      One scan in, one dataset for that room out.

      The twin, physics and dataset on this page were produced by the pipeline in this repository. A GR00T fine-tune and a scan of a real kitchen are both still missing, so this is a working pipeline without a result.