Domains

Example results

Humanoid · legged robots

Humanoid grasp-and-carry tasks and the locomotion policies of walking robots are judged the same way.

Simulation view · Legged robot terrain course completion — slopes, stairs

Tests

What is tested in this domain

Simulation view · Humanoid grasp · carry

Predefined motion (scripted controller) — not a trained AI policy, not a scored result

Humanoid grasp · carry

Approaching a workbench, grasping and moving an object — drops and falls are judged too.

Terrain course completion

Whether a walking policy gets through uphill, downhill, uneven ground and stairs to the end without falling.

Example result for this test

Walking by mass level

On the same course, changing only the robot mass: up to what weight it walks to the end.

Example result for this test

Locomotion policy evaluation

Whether a walking policy holds up against pushes, obstacles and approaching people.

Physics engine cross-check

Runs the same policy in another physics engine (MuJoCo) and compares results.

Demonstration recording

Saves robot cameras, state and actions as training data.

Conditions and environment

Conditions you can apply to the same test

Conditions

Slope · stair terrainRobot massPush strengthObstaclesObject position

Environment

WorkbenchIndoor · outdoor terrain

Results

Example results

Example results from legged robot tests run by imSim itself. The humanoid grasp-and-carry video shows predefined motion (scripted controller) and is not a scored result. Commissioned results are delivered in the same format (video, verdict, evidence, limitations).

Simulation view · Legged robot terrain course completion

Example results

Measured on 2026-10-13 · imSim common verdict criteria v1 · scenario definition criteria

Legged robot terrain course completion

Pass

A 4-legged robot starts on flat ground and walks over an uphill slope, a downhill slope, rough terrain and 10 stair steps to the landing at the top of the stairs. Every section spans the full path width, so none can be bypassed.

7 of 7 verdict items passed · 2 not measured · same verdict across 2 repeated runs of the same test

Verdict items — thresholds without a source are common defaults used in all domains
ItemCriterionMeasuredVerdicts
Abnormal terminationCriterion 000Pass
CollisionCriterion 00Not measuredNot applicable
Near missCriterion 2 or fewer2 or fewer0Pass
Emergency stopCriterion 5 or fewer5 or fewer0 timesPass
AnomaliesCriterion 3 or fewer3 or fewerNot measuredNot applicable
Maximum tilt — post-run checkCriterion 30.0° or less · Scenario definition30.0° or lessScenario definition10.5°Pass
Maximum tilt — in-run checkCriterion 30.0° or less · Scenario definitionThis row checks the same criterion as the row above at a different time. Both rows count as verdict items.30.0° or lessScenario definition10.5°Pass
FallsCriterion 0 times · Scenario definition0 timesScenario definition0 timesPass
Waypoints reachedCriterion 7 or more · Scenario definition7 or moreScenario definition7Pass

Scenario's own summary: Pass — not scored by the judge; the overall verdict takes the worse of this and the items above.

  • Walking is done by an AI locomotion policy that imSim trained on the rough-terrain locomotion task of a public robot learning environment. The route (7 waypoints) is set by the scenario, and velocity commands come from the imSim waypoint follower.
  • A gentle test course: uphill and downhill slopes of about 5° (height 0.7 m), rough terrain of 0.5 m boards 2 to 8 cm high, and stairs with 5 cm steps, 10 steps (0.5 m).
  • The course has no obstacles or people, so common items such as near miss and emergency stop read 0 without any stimulus. Collision and anomalies are not measured in this test.
  • Fall, waypoint and tilt criteria are set by this scenario. 30° is the start angle of the imSim fall warning range. The other criteria are imSim common defaults used in all domains.
  • The tilt verdict value excludes the tilt at the start (about 1.7°). The maximum of 10.5° occurred while walking the course, with large tilts on the uphill, rough terrain and stair sections. Relative to gravity, the maximum is about 12°.
  • Both runs used the same settings. The two runs moved through the course sections identically and had the same maximum tilt (10.5°). Only the motion after reaching the end point differed slightly. This is not a robustness test with varied conditions.
  • Ground friction (1.0) and foot friction (0.8, 0.6 when sliding) match the training settings.
  • The robot is a 4-legged robot imported from a public model. These are not humanoid results.
  • These are simulation results and do not replace physical testing.
By Robot mass stage — waypoints reached and verdict07criterion: 7 waypoints · 0 fallsPass×17 waypointsFail×1.57 waypointsFail×1.757 waypointsFail×2Fell at startFail×2.5Fell at startFail×3Fell at start

Graph · Terrain course completion by robot mass step

Example results

Measured on 2026-10-13 · imSim common verdict criteria v1 · scenario definition criteria

Terrain course completion by robot mass step

The same terrain course completion test is run once per step, changing only the robot's total body mass (×1 to ×3), to see up to which mass it walks to the end without falling or tilting heavily.

Pass up to ×1 · Fail from ×1.5

1 of 6 stages passed · one run per stage

Verdict by stage — same criterion for every stage: 0 falls · 7 waypoints · tilt 30° or less (scenario definition) + imSim common defaults
StageMeasuredVerdicts
Robot mass ×10 falls · 7 waypoints · tilt 10.5°Pass
Robot mass ×1.50 falls · 7 waypoints · tilt 34.0°Fail
Robot mass ×1.754 falls recorded · 7 waypoints · tilt 45.9°Fail
Robot mass ×2Fell at start position · max travel 0.3 m · waypoints not measured · tilt invalid · ended stalledFail
Robot mass ×2.5Fell at start position · max travel 0.3 m · waypoints not measured · tilt invalid · ended stalledFail
Robot mass ×3Fell at start position · max travel 0.8 m · waypoints not measured · tilt invalid · ended stalledFail
  • The masses of the robot body and its 12 leg links were scaled by the same factor (feet and rotational inertia unchanged). This differs from loading cargo on the body.
  • Joint force limits are unchanged, and the AI locomotion policy that handles walking is not aware of the mass change. imSim trained the policy on the rough-terrain locomotion task of a public robot learning environment.
  • ×1.5 passed all 7 waypoints without falling. It swayed heavily sideways on the rough terrain (34°), exceeding the tilt threshold (30°), so the result is Fail.
  • ×1.75 passed all 7 waypoints, then collapsed and flipped over while standing on the landing. It fell once, but the sensors recorded again while the flipped body rocked, so 4 falls were recorded.
  • The tilt verdict value for ×1.75 (45.9°) is the value at the moment of falling. Tilt is not measured after a fall, so the flipped posture is not included in this value.
  • From ×2 up, the robot could not support its body while settling before the start and collapsed. Tilt at these steps was measured relative to the already collapsed posture and is not used. Falls are 2 because two sensors both recorded the single collapse.
  • Each step was run once. The boundary lies between ×1 and ×1.5.
  • Verdict criteria are the values set by this scenario (falls, waypoints, tilt) and imSim common defaults. Tilt excludes the tilt at the start.
  • Ground friction (1.0) and foot friction (0.8, 0.6 when sliding) match the training settings.
  • The robot is a 4-legged robot imported from a public model. These are not humanoid results.
  • These are simulation results and do not replace physical testing.

Get started

How to use