Robo Use

GLM-5.3 · Codex · robosuite

arise-initiative/robosuite · Sep 27, 2026 · 6 of 10 solved · 11 other trials not scored no image input

GLM-5.3 · Codex: the model's API rejected the camera images the harness attached, so its vision trials failed as infrastructure failures and are not scored (31 of its 43; the other 12 because the episode server did not start). Its scored trials saw no images.
Fit the round nut over the round pegStep budget used upNot solvedStep budget used up500 / 5002 min 13 s
Fit the square nut over the square pegAgent gave upNot solvedAgent gave up464 / 5002 min 45 s
Move the bread from the bin on the robot's right into its compartment of the divided bin on its leftAPI rejected the imageInfra failureAPI rejected the image18 / 40025 s
Move the can from the bin on the robot's right into its compartment of the divided bin on its left · Franka PandaSolved205 / 40044 s
Move the can from the bin on the robot's right into its compartment of the divided bin on its left · Kinova Gen3Solved220 / 40045 s
Move the cereal from the bin on the robot's right into its compartment of the divided bin on its leftAPI rejected the imageInfra failureAPI rejected the image146 / 4001 min 17 s
Move the milk from the bin on the robot's right into its compartment of the divided bin on its leftAPI rejected the imageInfra failureAPI rejected the image62 / 40030 s
One robot holds a peg, the other a plate with a hole; get the peg through the holeAPI rejected the imageInfra failureAPI rejected the image132 / 5002 min 2 s
Pick up the red cube from the table with a IIWA armAPI rejected the imageInfra failureAPI rejected the image27 / 40028 s
Pick up the red cube from the table with a Kinova3 armAPI rejected the imageInfra failureAPI rejected the image77 / 40058 s
Pick up the red cube from the table with a Panda armAPI rejected the imageInfra failureAPI rejected the image54 / 40031 s
Pick up the red cube from the table with a Sawyer armAPI rejected the imageInfra failureAPI rejected the image51 / 40030 s
Pick up the red cube from the table with a UR5e armSolved74 / 40047 s
Put the red cube on top of the green cube · Franka PandaSolved112 / 40044 s
Put the red cube on top of the green cube · UR5eSolved99 / 40056 s
Robot0 picks up a hammer and hands it to robot1Agent gave upNot solvedAgent gave up634 / 7009 min 11 s
Turn the door's lever handle to release the latch, then pull the door open · Franka PandaSolved217 / 4001 min 11 s
Turn the door's lever handle to release the latch, then pull the door open · KUKA IIWAAgent gave upNot solvedAgent gave up393 / 4002 min 56 s
Two robots, facing each other across the table, lift a pot by its two handles · Franka PandaAPI rejected the imageInfra failureAPI rejected the image17 / 40032 s
Two robots, facing each other across the table, lift a pot by its two handles · KUKA IIWAAPI rejected the imageInfra failureAPI rejected the image24 / 40037 s
Wipe a line of dirt off the table with a sponge-like toolAPI rejected the imageInfra failureAPI rejected the image54 / 60051 s