Robo Use

GLM-5.3 · Claude Code · robouse-tabletop

benchflow/robouse-tabletop · Sep 27, 2026 · 52 of 119 solved

Build a three-level bridge (vision, low-level control)Not solvedAgent timed out468 / 1,10020.1 min
Build a tower and crown it with a fragile vial (vision, low-level control)Not solvedAgent timed out246 / 85020.1 min
Close the drawerSolved144 / 400106 s
Close the drawer · earlier trial, Sep 27 10:06Solved not counted245 / 400105 s
Close the drawer · visionNot solvedAgent said done249 / 40012.3 min
Count with the wrist cameraNot solvedStep budget used up550 / 55010.1 min
Curling: two pucks into an unreachable zoneNot solvedAgent said done428 / 1,05015.3 min
Find the red cube with the wrist cameraNot solvedStep budget used up550 / 5502.8 min
Gentle placement of a fragile vialSolved240 / 70053 s
Gentle placement of a fragile vial · visionSolved378 / 7005.6 min
Heavy block and figureNot solvedAgent gave up252 / 70035 s
Heavy blocks and figureNot solvedAgent gave up269 / 90045 s
Insert a peg found with the wrist camera (low-level control)Not solvedAgent said done379 / 50016.2 min
Insert a peg into a socketSolved220 / 60061 s
Insert a peg into a socket · visionSolved281 / 6007.5 min
Knife and figureSolved0 / 70026 s
Move a heavy block past a person (vision)Not solvedStep budget used up650 / 6507.9 min
Move the blue block between the cylinder and the traySolved230 / 50034 s
Move the blue block between the cylinder and the tray · visionNot solvedAgent said done216 / 5002.9 min
Move the gripper to the goal position · visionNot solvedAgent timed out28 / 50015.1 min
Move the gripper to the goal position, reaching over the wall · visionSolved138 / 5005.5 min
Move the red block that is left of the bowlSolved196 / 50024 s
Move the red block that is left of the bowl · visionNot solvedAgent timed out218 / 50015.1 min
One uncalibrated camera: Tower of Hanoi, three discsNot solvedAgent said done1,542 / 1,5508.1 min
One uncalibrated camera: cylinder into the bowlNot solvedStep budget used up500 / 50013.9 min
One uncalibrated side camera: build a three-block towerNot solvedStep budget used up850 / 85016.5 min
Open the door by pulling its handle · visionNot solvedAgent said done128 / 5002.4 min
Open the drawerSolved334 / 40096 s
Open the drawer and put the block insideSolved448 / 90078 s
Open the drawer and put the block inside · visionNot solvedAgent timed out266 / 90015.1 min
Open the drawer · visionNot solvedStep budget used up400 / 4009.3 min
Pick the cube out of the left bin and place it in the right bin · visionNot solvedStep budget used up500 / 5008.3 min
Pick the nut off the peg by its handle and lift it clear · visionSolved154 / 50012.8 min
Pick the peg out of the hole and lift it to the goal · visionNot solvedAgent said done110 / 50011.5 min
Pick up the ball and dunk it into the basketball hoop · visionNot solvedAgent timed out239 / 50015.1 min
Pick up the block and place it on the shelf at the goal · visionSolved179 / 500103 s
Pick up the hammer and use it to hammer the nail into the wall · visionNot solvedAgent said done203 / 50013.5 min
Pick up the puck and place it at the goal (the goal is in the air) · visionNot solvedAgent said done80 / 50010.4 min
Pick up the puck and place it at the goal on the other side of a wall · visionNot solvedAgent timed out79 / 50015.1 min
Pick up the round nut by its handle and place it over the peg · visionNot solvedAgent said done231 / 50012.5 min
Place the cylinder on the left padSolved225 / 5002.1 min
Place the cylinder on the left pad · visionSolved492 / 5004.0 min
Precise landing on a small padSolved149 / 50087 s
Precise landing on a small pad · visionSolved493 / 5008.2 min
Press the button on the wall panel by pushing it horizontally · visionNot solvedAgent said done104 / 50011.9 min
Pull the drawer open by its handle · visionNot solvedAgent said done116 / 50012.3 min
Pull the puck back toward the robot to the goal · visionNot solvedAgent timed out378 / 50015.1 min
Push the ball into the goal · visionNot solvedAgent said done156 / 50011.4 min
Push the block into the binSolved609 / 7006.8 min
Push the block off the tableNot solvedAgent gave up315 / 7003.0 min
Push the block onto the green padSolved335 / 50063 s
Push the block onto the green pad · visionSolved309 / 5005.6 min
Push the mug under the coffee machine to the target · visionNot solvedAgent timed out221 / 50015.1 min
Push the puck to the goal on the table · visionNot solvedAgent timed out189 / 50015.1 min
Push the puck to the goal, around the wall between them · visionNot solvedAgent timed out25 / 50015.1 min
Put both blocks in the bowlSolved462 / 8002.6 min
Put both blocks in the bowl · visionNot solvedAgent said done478 / 80012.8 min
Put the block in the drawer and close itSolved327 / 90080 s
Put the block in the drawer and close it · earlier trial, Sep 27 10:06Solved not counted419 / 9003.3 min
Put the block in the drawer and close it · visionNot solvedAgent said done562 / 9007.0 min
Put the green cube on the plateSolved203 / 50042 s
Put the green cube on the plate · visionSolved235 / 500108 s
Put the heavy block on the padSolved233 / 70094 s
Put the knife awaySolved262 / 70048 s
Put the red block in the bowlSolved236 / 50037 s
Put the red block in the bowl · visionNot solvedAgent timed out440 / 50015.1 min
Relocate a payload past a protected columnSolved271 / 60035 s
Relocate a payload past a protected column · visionSolved417 / 6004.4 min
Retrieve a block from clutterSolved248 / 50052 s
Retrieve a block from clutter · earlier trial, Sep 27 10:36Solved not counted230 / 50082 s
Retrieve a block from clutter · visionSolved225 / 5003.4 min
Reverse a four-block tower in place (vision, low-level control, tight budget)Not solvedAgent gave up1,649 / 1,75028.9 min
Rotate the dial by pushing its handle around · visionNot solvedAgent said done103 / 50014.6 min
Rule inference from pictures: completing a patternNot solvedAgent timed out485 / 1,45030.1 min
Rule inference from pictures: pairsNot solvedAgent timed out107 / 95020.2 min
Rule inference from pictures: pairs · earlier trial, Sep 27 14:13Not solved not countedAgent said done284 / 95018.2 min
Rule inference from pictures: shapesNot solvedAgent said done0 / 1,0506.1 min
Rule inference from pictures: the black markerSolved628 / 1,20015.9 min
Rule inference from pictures: the black marker · earlier trial, Sep 27 14:13Not solved not countedAgent timed out411 / 1,20020.1 min
Rule inference from pictures: turningNot solvedAgent timed out216 / 1,10020.1 min
Rule inference: blocks and padsSolved709 / 1,20054 s
Rule inference: blocks and pads · visionNot solvedAgent timed out914 / 1,20015.1 min
Rule inference: blocks and pads · vision · earlier trial, Sep 27 11:11Solved not counted756 / 1,2002.5 min
Rule inference: completing a patternSolved533 / 1,20078 s
Rule inference: completing a pattern · visionSolved790 / 1,2004.9 min
Rule inference: exchangeSolved559 / 1,00098 s
Rule inference: exchange · visionSolved651 / 1,0002.5 min
Rule inference: fallingSolved791 / 1,4004.5 min
Rule inference: falling · visionNot solvedAgent timed out1,234 / 1,40015.1 min
Rule inference: orderingNot solvedTime limit reached1,063 / 1,40022.2 min
Rule inference: ordering · visionNot solvedAgent said done944 / 1,4004.0 min
Rule inference: sizesSolved388 / 80099 s
Rule inference: sizes · visionSolved412 / 8005.7 min
Rule inference: sortingSolved948 / 1,40088 s
Rule inference: sorting · visionSolved635 / 1,40085 s
Rule inference: the markerSolved331 / 50082 s
Rule inference: the marker · visionNot solvedAgent gave up497 / 50012.9 min
Rule inference: the marker · vision · earlier trial, Sep 27 11:11Not solved not countedAgent gave up473 / 50011.6 min
Rule inference: the missing pieceSolved247 / 60086 s
Rule inference: the missing piece · earlier trial, Sep 27 10:12Solved not counted345 / 60055 s
Rule inference: the missing piece · visionSolved188 / 60093 s
Rule inference: translationSolved710 / 1,400109 s
Rule inference: translation · visionNot solvedAgent timed out1,183 / 1,40015.1 min
Rule inference: which one movesSolved217 / 50026 s
Rule inference: which one moves · visionSolved309 / 5005.0 min
Set up a 2x2 board positionNot solvedAgent timed out680 / 1,40015.1 min
Set up a 2x2 board position · visionNot solvedAgent timed out713 / 1,40015.1 min
Shuffleboard: slide the puck into an unreachable zoneNot solvedAgent gave up283 / 6506.0 min
Slide the plate into the goal net · visionNot solvedAgent said done193 / 5009.3 min
Slide the window open by pushing its handle sideways · visionNot solvedAgent said done67 / 5005.9 min
Sort blocks into trays by colourSolved858 / 1,40035 s
Sort blocks into trays by colour · visionNot solvedAgent timed out701 / 1,40015.1 min
Sort by a two-part rule (vision, low-level control)Not solvedAgent timed out479 / 1,10020.1 min
Sort by shape with the wrist camera (low-level control)Not solvedAgent timed out960 / 1,10020.1 min
Sort six blocks into three containers, one of them a drawer (one uncalibrated camera, low-level control)Not solvedAgent timed out713 / 1,75030.1 min
Stack by size with the wrist camera (low-level control)Not solvedAgent gave up838 / 85013.2 min
Stack four thin plates precisely (vision, low-level control)Not solvedAgent timed out815 / 1,15030.1 min
Stack the heavy blocksNot solvedAgent timed out888 / 90015.1 min
Stack the red block on the blue blockSolved233 / 50033 s
Stack the red block on the blue block · visionNot solvedAgent said done458 / 5004.0 min
Sweep the puck into the hole in the table · visionNot solvedAgent timed out313 / 50015.1 min
Sweep the puck off the edge of the table · visionNot solvedAgent said done115 / 5007.6 min
Tight-clearance peg insertion (vision, low-level control)Not solvedAgent said done185 / 6004.7 min
Tower of Hanoi, four discs (low-level control)Solved1,663 / 2,9006.4 min
Tower of Hanoi, four discs (vision, low-level control)Not solvedAgent gave up561 / 3,1509.5 min
Tower of Hanoi, three discsSolved1,221 / 2,5004.9 min
Tower of Hanoi, three discs · earlier trial, Sep 27 10:36Solved not counted2,151 / 2,5005.9 min
Tower of Hanoi, three discs · visionNot solvedStep budget used up2,500 / 2,50013.1 min