Robo Use

GLM-5.3 · mini-swe-agent · robouse-tabletop

benchflow/robouse-tabletop · Sep 27, 2026 · 74 of 118 solved · 1 trial removed from the leaderboard no image input
Build a three-level bridge (vision, low-level control)Agent gave upNot solvedAgent gave up150 / 1,10010 min 43 s
Build a tower and crown it with a fragile vial (vision, low-level control)Agent gave upNot solvedAgent gave up20 / 8506 min 33 s
Close the drawerSolved306 / 4001 min 51 s
Close the drawer · visionSolved242 / 4007 min 58 s
Count with the wrist cameraStep budget used upNot solvedStep budget used up550 / 5508 min 48 s
Curling: two pucks into an unreachable zoneAgent gave upNot solvedAgent gave up520 / 1,05013 min 54 s
Find the red cube with the wrist cameraSolved533 / 5503 min 7 s
Gentle placement of a fragile vialSolved230 / 7001 min 13 s
Gentle placement of a fragile vial · visionAgent gave upNot solvedAgent gave up79 / 70010 min 42 s
Heavy block and figureAgent gave upNot solvedAgent gave up266 / 7001 min
Heavy blocks and figureAgent gave upNot solvedAgent gave up881 / 9006 min 40 s
Insert a peg found with the wrist camera (low-level control)Agent gave upNot solvedAgent gave up132 / 5009 min 5 s
Insert a peg into a socketSolved208 / 60051 s
Insert a peg into a socket · visionAgent gave upNot solvedAgent gave up122 / 6008 min 35 s
Knife and figureAgent gave upNot solvedAgent gave up360 / 7005 min 11 s
Move a heavy block past a person (vision)Solved572 / 6509 min 53 s
Move the blue block between the cylinder and the traySolved213 / 50028 s
Move the blue block between the cylinder and the tray · visionSolved344 / 5008 min 33 s
Move the gripper to the goal position · visionSolved49 / 5002 min 32 s
Move the gripper to the goal position, reaching over the wall · visionSolved54 / 5003 min 36 s
Move the red block that is left of the bowlSolved218 / 50023 s
Move the red block that is left of the bowl · visionSolved316 / 5004 min 21 s
One uncalibrated camera: Tower of Hanoi, three discsAgent gave upNot solvedAgent gave up1,483 / 1,5503 min 27 s
One uncalibrated camera: cylinder into the bowlSolved293 / 50015 min 18 s
One uncalibrated side camera: build a three-block towerAgent gave upNot solvedAgent gave up606 / 85013 min 42 s
Open the door by pulling its handle · visionAgent said doneNot solvedAgent said done495 / 50013 min 41 s
Open the drawerSolved384 / 4001 min 10 s
Open the drawer and put the block insideSolved440 / 9001 min 12 s
Open the drawer and put the block inside · visionSolved612 / 90012 min 8 s
Open the drawer · visionAgent gave upNot solvedAgent gave up32 / 40010 min 29 s
Pick the cube out of the left bin and place it in the right bin · visionStep budget used upNot solvedStep budget used up500 / 50010 min 3 s
Pick the nut off the peg by its handle and lift it clear · visionHarness timeoutNot solvedHarness timeout266 / 50015 min 7 s
Pick the peg out of the hole and lift it to the goal · visionStep budget used upNot solvedStep budget used up500 / 50011 min
Pick up the ball and dunk it into the basketball hoop · visionAgent gave upNot solvedAgent gave up495 / 5009 min 50 s
Pick up the block and place it on the shelf at the goal · visionSolved127 / 5002 min 36 s
Pick up the hammer and use it to hammer the nail into the wall · vision · removed from the leaderboardSolved not counted262 / 5009 min 21 s
Pick up the puck and place it at the goal (the goal is in the air) · visionAgent gave upNot solvedAgent gave up273 / 50013 min 5 s
Pick up the puck and place it at the goal on the other side of a wall · visionSolved419 / 50011 min 50 s
Pick up the round nut by its handle and place it over the peg · visionSolved297 / 5008 min 52 s
Place the cylinder on the left padSolved226 / 50015 min 40 s
Place the cylinder on the left pad · visionSolved297 / 5006 min 26 s
Precise landing on a small padSolved262 / 50046 s
Precise landing on a small pad · visionSolved483 / 5007 min 10 s
Press the button on the wall panel by pushing it horizontally · visionSolved200 / 5005 min 43 s
Pull the drawer open by its handle · visionAgent gave upNot solvedAgent gave up99 / 5009 min 16 s
Pull the puck back toward the robot to the goal · visionSolved392 / 5006 min 18 s
Push the ball into the goal · visionAgent gave upNot solvedAgent gave up498 / 50014 min 4 s
Push the block into the binSolved232 / 70051 s
Push the block off the tableAgent gave upNot solvedAgent gave up357 / 7003 min 2 s
Push the block onto the green padSolved338 / 5001 min 4 s
Push the block onto the green pad · visionAgent gave upNot solvedAgent gave up149 / 50010 min 21 s
Push the mug under the coffee machine to the target · visionSolved144 / 5009 min 39 s
Push the puck to the goal on the table · visionSolved281 / 5008 min 29 s
Push the puck to the goal, around the wall between them · visionAgent gave upNot solvedAgent gave up382 / 5009 min 57 s
Put both blocks in the bowlSolved471 / 80046 s
Put both blocks in the bowl · visionSolved694 / 80010 min 47 s
Put the block in the drawer and close itSolved534 / 9002 min 20 s
Put the block in the drawer and close it · visionSolved651 / 90010 min 7 s
Put the green cube on the plateSolved204 / 50015 min 34 s
Put the green cube on the plate · visionSolved190 / 5004 min 37 s
Put the heavy block on the padSolved244 / 70034 s
Put the knife awaySolved276 / 7001 min 20 s
Put the red block in the bowlSolved216 / 50032 s
Put the red block in the bowl · visionSolved277 / 50010 min 20 s
Relocate a payload past a protected columnSolved290 / 60033 s
Relocate a payload past a protected column · visionSolved337 / 6005 min 30 s
Retrieve a block from clutterSolved187 / 5001 min 3 s
Retrieve a block from clutter · visionSolved215 / 5006 min
Reverse a four-block tower in place (vision, low-level control, tight budget)Agent gave upNot solvedAgent gave up109 / 1,7506 min 6 s
Rotate the dial by pushing its handle around · visionAgent gave upNot solvedAgent gave up305 / 5009 min 6 s
Rule inference from pictures: completing a patternAgent gave upNot solvedAgent gave up535 / 1,4509 min 40 s
Rule inference from pictures: pairsAgent gave upNot solvedAgent gave up20 / 9506 min 32 s
Rule inference from pictures: shapesAgent gave upNot solvedAgent gave up35 / 1,0509 min 41 s
Rule inference from pictures: the black markerStep budget used upNot solvedStep budget used up1,200 / 1,2008 min 4 s
Rule inference from pictures: turningAgent said doneNot solvedAgent said done911 / 1,1009 min 3 s
Rule inference: blocks and padsSolved554 / 1,20021 s
Rule inference: blocks and pads · visionSolved917 / 1,2004 min 21 s
Rule inference: completing a patternSolved655 / 1,20039 s
Rule inference: completing a pattern · visionSolved748 / 1,2007 min 18 s
Rule inference: exchangeSolved655 / 1,00028 s
Rule inference: exchange · visionSolved565 / 1,0001 min 42 s
Rule inference: fallingSolved970 / 1,4001 min 10 s
Rule inference: falling · visionSolved853 / 1,4005 min 21 s
Rule inference: orderingSolved1,238 / 1,4001 min 18 s
Rule inference: ordering · visionSolved644 / 1,4003 min 1 s
Rule inference: sizesSolved592 / 8002 min 47 s
Rule inference: sizes · visionSolved612 / 8005 min 1 s
Rule inference: sortingSolved760 / 1,40040 s
Rule inference: sorting · visionSolved986 / 1,4004 min 53 s
Rule inference: the markerSolved255 / 50027 s
Rule inference: the marker · visionAgent said doneNot solvedAgent said done472 / 5008 min 34 s
Rule inference: the missing pieceSolved285 / 60038 s
Rule inference: the missing piece · visionSolved224 / 6004 min 11 s
Rule inference: translationSolved679 / 1,4001 min 4 s
Rule inference: translation · visionSolved903 / 1,4002 min 53 s
Rule inference: which one movesSolved221 / 50022 s
Rule inference: which one moves · visionSolved272 / 5004 min 17 s
Set up a 2x2 board positionStep budget used upNot solvedStep budget used up1,400 / 1,4008 min 34 s
Set up a 2x2 board position · visionHarness timeoutNot solvedHarness timeout1,258 / 1,40015 min 6 s
Shuffleboard: slide the puck into an unreachable zoneAgent gave upNot solvedAgent gave up327 / 6505 min 20 s
Slide the plate into the goal net · visionSolved414 / 5008 min 30 s
Slide the window open by pushing its handle sideways · visionSolved304 / 5007 min 36 s
Sort blocks into trays by colourSolved775 / 1,40049 s
Sort blocks into trays by colour · visionSolved967 / 1,4004 min 23 s
Sort by a two-part rule (vision, low-level control)Step budget used upNot solvedStep budget used up1,100 / 1,1008 min 32 s
Sort by shape with the wrist camera (low-level control)Agent said doneNot solvedAgent said done674 / 1,10013 min 56 s
Sort six blocks into three containers, one of them a drawer (one uncalibrated camera, low-level control)Agent said doneNot solvedAgent said done1,728 / 1,75015 min 1 s
Stack by size with the wrist camera (low-level control)Step budget used upNot solvedStep budget used up850 / 85014 min 5 s
Stack four thin plates precisely (vision, low-level control)Agent gave upNot solvedAgent gave up242 / 1,15011 min 28 s
Stack the heavy blocksSolved496 / 9001 min 14 s
Stack the red block on the blue blockSolved251 / 50033 s
Stack the red block on the blue block · visionSolved239 / 5002 min 26 s
Sweep the puck into the hole in the table · visionAgent gave upNot solvedAgent gave up455 / 50010 min 8 s
Sweep the puck off the edge of the table · visionStep budget used upNot solvedStep budget used up500 / 50011 min 3 s
Tight-clearance peg insertion (vision, low-level control)Agent gave upNot solvedAgent gave up220 / 6008 min 7 s
Tower of Hanoi, four discs (low-level control)Solved2,772 / 2,9003 min 54 s
Tower of Hanoi, four discs (vision, low-level control)Agent gave upNot solvedAgent gave up1,436 / 3,15027 min 56 s
Tower of Hanoi, three discsSolved2,208 / 2,5003 min 32 s
Tower of Hanoi, three discs · visionSolved1,381 / 2,5009 min 56 s