imSim
Log inGet started

Public results · robot arm

5 robots × 4 imSim standard tests.
20 verdicts published with video and evidence.

Select a test in the table to open its video and the reason for its verdict.

Robot ＼ test

Position accuracy

 

Pick and place

Fixed position

Pick and place

Find by itself

Part insertion

 

Panda

Franka

UR10

Universal Robots

PiPER

AgileX

Gen3

Kinova

TM12

Techman

Your robot · your AI

The same 4 tests, scored by the same rules

Pass
Fail
Caution · Inconclusive
Numbers: key value per test (mm, trials meeting the criteria, successes/measured)

All values are baselines. All robots were moved by the imSim baseline controller (not the manufacturer's controller or an AI), so this is not a performance ranking of robot manufacturers. Results in other domains are delivered to the requester in the same format. Test method

TM12 · Pick and place — find by itself at random positions — Pass 25/25

Techman TM12 + Robotiq 2F-85 · 6 axes · reach 1.3 m · payload 12 kg

Pick and place — find by itself at random positions

Ask about this test

Trial 1 · Success

0:00 / 0:16

25 trials

Success 25
Outlined square: video available

Pass

25/25

Successes / measured

Reason

25 of 25 measured trials succeeded. The lower bound of the 95% confidence interval of the success rate, 86.6%, is above the pass threshold of 80%, so the result is Pass.

Success rate 95% confidence interval verdict
Rule version v2.3b-2026-10-04 · measured 2026-10-11

Verdict evidence

Measured values and criteria

Item

Measured value

Criterion

Results

Successes

25 / 25

Successes among measured trials

For reference

Success rate

100.0%

Point estimate (for reference)

For reference

Success rate 95% confidence interval

86.6% ~ 100.0%

Lower bound > 80.0% = Pass · upper bound < 40.0% = Fail

Pass

Excluded from measurement

0 / 25

None

Excluded from the count (counted as neither failure nor success)

Minimum measured trials

25

4 or more

Met

Same test, 5 robots

95% confidence interval of the success rate (bar) and the success rate (dot). Dashed line: pass line 80% — Pass if the lower bound of the interval is above this line.

50%

60%

70%

80%

90%

100%

Test conditions and limits

Measured

Success rate of the robot finding an object at a random position within a defined range with its camera, grasping it and placing it at a defined spot — ground-truth object position used only for scoring (not for motion)

Placement

Random positions within a defined range

Trial

Planned 25 · measured 25

Robot control

imSim baseline controller (neither the manufacturer's controller nor an AI)

Robot model

Checked against the manufacturer's published specifications (not against real robot behavior)

Test environment

In-house simulation test environment (not recognized by an accredited test body)

What this result does not show

  • Finding objects outside the defined range
  • Re-recognizing object pose in the hand
  • Grasp detection at the level of a real robot force sensor
  • Real robot performance — these are simulation results and do not replace physical tests
  • Performance ranking of robot manufacturers — this is a baseline produced with the imSim baseline controller
  • Official third-party approval — this is self-scoring in an in-house test environment

Also recorded

Not used for the verdict

Pass and fail are decided only by the evidence above. The items below are recorded for every trial and published as measured.

No failures or cautions among the evaluated items.

The same test with your robot · your AI

Same verdict rules, same result format — video, verdict, evidence.

Get started