imSim
Log inGet started

Public results · robot arm

5 robots × 4 imSim standard tests.
20 verdicts published with video and evidence.

Select a test in the table to open its video and the reason for its verdict.

Robot ＼ test

Position accuracy

 

Pick and place

Fixed position

Pick and place

Find by itself

Part insertion

 

Panda

Franka

UR10

Universal Robots

PiPER

AgileX

Gen3

Kinova

TM12

Techman

Your robot · your AI

The same 4 tests, scored by the same rules

Pass
Fail
Caution · Inconclusive
Numbers: key value per test (mm, trials meeting the criteria, successes/measured)

All values are baselines. All robots were moved by the imSim baseline controller (not the manufacturer's controller or an AI), so this is not a performance ranking of robot manufacturers. Results in other domains are delivered to the requester in the same format. Test method

PiPER · Part insertion — Fail 3/4

AgileX PiPER · 6 axes · reach 0.626 m · payload 1.5 kg

Part insertion

Ask about this test

Trial 4 · Not met

0:00 / 0:45

4 trials

Met 3
Not met 1
Outlined square: video available

Fail

3/4

Trials meeting criteria

Reason

Of 4 trials, 1 did not meet the verdict items. This test is a Pass only if every trial meets the verdict items and direction reversals are Stable.

Direction reversals could not be judged because the observed travel distance was too short (95% interval 5.9~12.49/m, threshold 8/m).

Fixed-position trial verdict (met in all trials · direction reversals combined)
Rule version v2.3b-2026-10-04 · measured 2026-10-10

Verdict evidence

Measured values and criteria

Item

Measured value

Criterion

Results

Trial results

3 / 4 met

Met in all trials (items other than direction reversals)

Some trials not met

Direction reversals (all trials combined)

8.75/m · 95% interval 5.90 ~ 12.49/m

Interval upper bound < 8/m = Stable

Inconclusive (observed distance too short)

Same test, 5 robots

Direction reversals: how many times the end effector reversed its direction of travel (per 1 m traveled). If the upper bound of the 95% interval (bar) is below the dashed line 8 /m then it is Stable. Left dots: whether each trial met the criteria.

0

4

8

12

16

Test conditions and limits

Measured

Accuracy of inserting a part into a defined hole position — grasp · in-hand part orientation observation · alignment · seating all without ground truth (sensors · kinematics · contact forces)

Placement

Fixed hole position — reference pose 1 + position randomization within a defined range 3

Trial

Planned 4 · measured 4

Robot control

imSim baseline controller (neither the manufacturer's controller nor an AI)

Robot model

Checked against the manufacturer's published specifications (not against real robot behavior)

Test environment

In-house simulation test environment (not recognized by an accredited test body)

What this result does not show

  • Finding parts · holes in the workspace (hole position = preset value)
  • Behavior at the level of a real compliance device · wrist force sensor (models used)
  • Real robot performance — these are simulation results and do not replace physical tests
  • Performance ranking of robot manufacturers — this is a baseline produced with the imSim baseline controller
  • Official third-party approval — this is self-scoring in an in-house test environment

Also recorded

Not used for the verdict

Pass and fail are decided only by the evidence above. The items below are recorded for every trial and published as measured.

No collision other than with the work object

Failed 4 · Passed 0 / evaluated 4

Overall task success (lift · place · no drop · hold)

Failed 1 · Passed 3 / evaluated 4

Grasp · lift occurred

Failed 1 · Passed 3 / evaluated 4

Overall task success (common criteria)

Caution 1 · Passed 3 / evaluated 4

The same test with your robot · your AI

Same verdict rules, same result format — video, verdict, evidence.

Get started