Domains
Public resultsRobot arm
Grasping, moving, insertion, positioning accuracy. Simulation test results for 5 robot models are published with video and evidence.
Simulation view · Part insertion · Kinova Gen3
Tests
What is tested in this domain
Simulation view · Position accuracy
Position accuracy
TCP deviation from target at set poses — test load: 100% of manufacturer payload
Public results for this test
Simulation view · Pick and place — fixed position
Pick and place — fixed position
Path-planned grasping and moving of an object at a fixed position, and contact forces
Public results for this test
Simulation view · Pick and place — find by itself at random positions
Pick and place — find by itself at random positions
Success rate of the robot finding an object at a random position within a defined range with its camera, grasping it and placing it at a defined spot — ground-truth object position used only for scoring (not for motion)
Public results for this test
Simulation view · Part insertion
Part insertion
Accuracy of inserting a part at a set hole position — grasp, in-gripper part orientation sensing, alignment and seating all without ground-truth values (sensors, kinematics, contact force)
Public results for this test
Conditions and environment
Conditions you can apply to the same test
Conditions
Environment
Features
Features used in Robot arm
Grouped in the order of the parts that make up a test. Select a feature to see its description on the all-features page.
- Test subject
- Robot arm manipulationRegister a robot with one settings fileLearned policy execution · reinforcement learningExternal AI connectionPerception · motion planningReal robot integration · calibrationTask adaptation workflow
- Test environment
- Test environment libraryPhysics-ready scenes
Results
Public results
5 robot models × 4 tests: all 20 results can be viewed without signing up.
Open results boardRobot ＼ test
Position accuracy
Pick and place
Fixed position
Pick and place
Find by itself
Part insertion
Panda
Franka
UR10
Universal Robots
PiPER
AgileX
Gen3
Kinova
TM12
Techman
Your robot · your AI
The same 4 tests, scored by the same rules
What you can do
What you can do in Robot arm
Test whether it gets the job done
Scores whether the robot or AI completes the task, using the same scenarios and real physical values.
Connect your AI to the same tests
Your AI stays on your server and connects to the test. Results are placed side by side with the baseline.
AI connection is open now; running with your AI opens to invited members first.
Upload your robot
One robot settings file goes through automatic checks and onto the same tests.
Upload from the portal is in preparation — for now, this is done through a custom validation request or a joint pilot test.
Adapt to your task
A workflow that collects demonstrations into training data, trains further, then re-scores on the same test. Whether adaptation is included, and its scope, are agreed in a joint pilot test.
Inclusion and scope of adaptation: agreed in a joint pilot test
Generate training data
Exports test recordings (robot cameras, state, actions) in training data formats.
Get started
How to use
View nowRobot arm
View videos, verdicts and evidence of public results without signing up.
Self-service runRobot armInvited members first
Members pick from ready robots and tests, run them themselves and get the results.
Custom validation request
Send a request form and imSim tests, scores and delivers the results.
Joint pilot test
One joint validation and report, using one of your robot models and one task.
On-premises installation
Installed on-premises so data and results never leave your company.