GLM-5.3 · Claude Code · robosuite

arise-initiative/robosuite · Sep 27, 2026 · 17 of 20 solved · 1 other trial not scored

Search tasks


Fit the round nut over the round pegRate-limited	Infra failure	Rate-limited	469 / 500	15 min 59 s
Fit the square nut over the square pegAgent gave up	Not solved	Agent gave up	459 / 500	15 min 20 s
Move the bread from the bin on the robot's right into its compartment of the divided bin on its left	Solved		173 / 400	53 s
Move the can from the bin on the robot's right into its compartment of the divided bin on its left · Franka Panda	Solved		231 / 400	1 min 41 s
Move the can from the bin on the robot's right into its compartment of the divided bin on its left · Kinova Gen3	Solved		248 / 400	39 s
Move the cereal from the bin on the robot's right into its compartment of the divided bin on its left	Solved		256 / 400	2 min 44 s
Move the milk from the bin on the robot's right into its compartment of the divided bin on its left	Solved		256 / 400	3 min 20 s
One robot holds a peg, the other a plate with a hole; get the peg through the hole	Solved		295 / 500	12 min 10 s
Pick up the red cube from the table with a IIWA arm	Solved		64 / 400	2 min 2 s
Pick up the red cube from the table with a Kinova3 arm	Solved		80 / 400	58 s
Pick up the red cube from the table with a Panda arm	Solved		65 / 400	1 min 32 s
Pick up the red cube from the table with a Sawyer arm	Solved		211 / 400	2 min 10 s
Pick up the red cube from the table with a UR5e arm	Solved		61 / 400	50 s
Put the red cube on top of the green cube · Franka Panda	Solved		164 / 400	9 min 57 s
Put the red cube on top of the green cube · UR5e	Solved		161 / 400	2 min 36 s
Robot0 picks up a hammer and hands it to robot1Trial time limit	Not solved	Trial time limit	378 / 700	45 min 59 s
Turn the door's lever handle to release the latch, then pull the door open · Franka Panda	Solved		151 / 400	2 min 23 s
Turn the door's lever handle to release the latch, then pull the door open · KUKA IIWAAgent gave up	Not solved	Agent gave up	391 / 400	8 min 38 s
Two robots, facing each other across the table, lift a pot by its two handles · Franka Panda	Solved		59 / 400	3 min 17 s
Two robots, facing each other across the table, lift a pot by its two handles · KUKA IIWA	Solved		165 / 400	10 min 48 s
Wipe a line of dirt off the table with a sponge-like tool	Solved		261 / 600	8 min 52 s