Robo Use

GLM-5.3 · mini-swe-agent · robouse-tabletop

benchflow/robouse-tabletop · Sep 27, 2026 · 75 of 119 solved
Build a three-level bridge (vision, low-level control)Not solvedAgent gave up150 / 1,10010.7 min
Build a tower and crown it with a fragile vial (vision, low-level control)Not solvedAgent gave up20 / 8506.6 min
Close the drawerSolved306 / 400111 s
Close the drawer · visionSolved242 / 4008.0 min
Count with the wrist cameraNot solvedStep budget used up550 / 5508.8 min
Curling: two pucks into an unreachable zoneNot solvedAgent gave up520 / 1,05013.9 min
Find the red cube with the wrist cameraSolved533 / 5503.1 min
Gentle placement of a fragile vialSolved230 / 70073 s
Gentle placement of a fragile vial · visionNot solvedAgent gave up79 / 70010.7 min
Heavy block and figureNot solvedAgent gave up266 / 70060 s
Heavy blocks and figureNot solvedAgent gave up881 / 9006.7 min
Insert a peg found with the wrist camera (low-level control)Not solvedAgent gave up132 / 5009.1 min
Insert a peg into a socketSolved208 / 60051 s
Insert a peg into a socket · visionNot solvedAgent gave up122 / 6008.6 min
Knife and figureNot solvedAgent gave up360 / 7005.2 min
Move a heavy block past a person (vision)Solved572 / 6509.9 min
Move the blue block between the cylinder and the traySolved213 / 50028 s
Move the blue block between the cylinder and the tray · visionSolved344 / 5008.6 min
Move the gripper to the goal position · visionSolved49 / 5002.5 min
Move the gripper to the goal position, reaching over the wall · visionSolved54 / 5003.6 min
Move the red block that is left of the bowlSolved218 / 50023 s
Move the red block that is left of the bowl · visionSolved316 / 5004.3 min
One uncalibrated camera: Tower of Hanoi, three discsNot solvedAgent gave up1,483 / 1,5503.5 min
One uncalibrated camera: cylinder into the bowlSolved293 / 50015.3 min
One uncalibrated side camera: build a three-block towerNot solvedAgent gave up606 / 85013.7 min
Open the door by pulling its handle · visionNot solvedAgent said done495 / 50013.7 min
Open the drawerSolved384 / 40070 s
Open the drawer and put the block insideSolved440 / 90072 s
Open the drawer and put the block inside · visionSolved612 / 90012.1 min
Open the drawer · visionNot solvedAgent gave up32 / 40010.5 min
Pick the cube out of the left bin and place it in the right bin · visionNot solvedStep budget used up500 / 50010.0 min
Pick the nut off the peg by its handle and lift it clear · visionNot solvedAgent timed out266 / 50015.1 min
Pick the peg out of the hole and lift it to the goal · visionNot solvedStep budget used up500 / 50011.0 min
Pick up the ball and dunk it into the basketball hoop · visionNot solvedAgent gave up495 / 5009.8 min
Pick up the block and place it on the shelf at the goal · visionSolved127 / 5002.6 min
Pick up the hammer and use it to hammer the nail into the wall · visionSolved262 / 5009.4 min
Pick up the puck and place it at the goal (the goal is in the air) · visionNot solvedAgent gave up273 / 50013.1 min
Pick up the puck and place it at the goal on the other side of a wall · visionSolved419 / 50011.8 min
Pick up the round nut by its handle and place it over the peg · visionSolved297 / 5008.9 min
Place the cylinder on the left padSolved226 / 50015.7 min
Place the cylinder on the left pad · visionSolved297 / 5006.4 min
Precise landing on a small padSolved262 / 50046 s
Precise landing on a small pad · visionSolved483 / 5007.2 min
Press the button on the wall panel by pushing it horizontally · visionSolved200 / 5005.7 min
Pull the drawer open by its handle · visionNot solvedAgent gave up99 / 5009.3 min
Pull the puck back toward the robot to the goal · visionSolved392 / 5006.3 min
Push the ball into the goal · visionNot solvedAgent gave up498 / 50014.1 min
Push the block into the binSolved232 / 70051 s
Push the block off the tableNot solvedAgent gave up357 / 7003.0 min
Push the block onto the green padSolved338 / 50064 s
Push the block onto the green pad · visionNot solvedAgent gave up149 / 50010.3 min
Push the mug under the coffee machine to the target · visionSolved144 / 5009.7 min
Push the puck to the goal on the table · visionSolved281 / 5008.5 min
Push the puck to the goal, around the wall between them · visionNot solvedAgent gave up382 / 5009.9 min
Put both blocks in the bowlSolved471 / 80046 s
Put both blocks in the bowl · visionSolved694 / 80010.8 min
Put the block in the drawer and close itSolved534 / 9002.3 min
Put the block in the drawer and close it · visionSolved651 / 90010.1 min
Put the green cube on the plateSolved204 / 50015.6 min
Put the green cube on the plate · visionSolved190 / 5004.6 min
Put the heavy block on the padSolved244 / 70034 s
Put the knife awaySolved276 / 70080 s
Put the red block in the bowlSolved216 / 50032 s
Put the red block in the bowl · visionSolved277 / 50010.3 min
Relocate a payload past a protected columnSolved290 / 60033 s
Relocate a payload past a protected column · visionSolved337 / 6005.5 min
Retrieve a block from clutterSolved187 / 50063 s
Retrieve a block from clutter · visionSolved215 / 5006.0 min
Reverse a four-block tower in place (vision, low-level control, tight budget)Not solvedAgent gave up109 / 1,7506.1 min
Rotate the dial by pushing its handle around · visionNot solvedAgent gave up305 / 5009.1 min
Rule inference from pictures: completing a patternNot solvedAgent gave up535 / 1,4509.7 min
Rule inference from pictures: pairsNot solvedAgent gave up20 / 9506.5 min
Rule inference from pictures: shapesNot solvedAgent gave up35 / 1,0509.7 min
Rule inference from pictures: the black markerNot solvedStep budget used up1,200 / 1,2008.1 min
Rule inference from pictures: turningNot solvedAgent said done911 / 1,1009.1 min
Rule inference: blocks and padsSolved554 / 1,20021 s
Rule inference: blocks and pads · visionSolved917 / 1,2004.3 min
Rule inference: completing a patternSolved655 / 1,20039 s
Rule inference: completing a pattern · visionSolved748 / 1,2007.3 min
Rule inference: exchangeSolved655 / 1,00028 s
Rule inference: exchange · visionSolved565 / 1,000102 s
Rule inference: fallingSolved970 / 1,40070 s
Rule inference: falling · visionSolved853 / 1,4005.3 min
Rule inference: orderingSolved1,238 / 1,40078 s
Rule inference: ordering · visionSolved644 / 1,4003.0 min
Rule inference: sizesSolved592 / 8002.8 min
Rule inference: sizes · visionSolved612 / 8005.0 min
Rule inference: sortingSolved760 / 1,40040 s
Rule inference: sorting · visionSolved986 / 1,4004.9 min
Rule inference: the markerSolved255 / 50027 s
Rule inference: the marker · visionNot solvedAgent said done472 / 5008.6 min
Rule inference: the missing pieceSolved285 / 60038 s
Rule inference: the missing piece · visionSolved224 / 6004.2 min
Rule inference: translationSolved679 / 1,40064 s
Rule inference: translation · visionSolved903 / 1,4002.9 min
Rule inference: which one movesSolved221 / 50022 s
Rule inference: which one moves · visionSolved272 / 5004.3 min
Set up a 2x2 board positionNot solvedStep budget used up1,400 / 1,4008.6 min
Set up a 2x2 board position · visionNot solvedAgent timed out1,258 / 1,40015.1 min
Shuffleboard: slide the puck into an unreachable zoneNot solvedAgent gave up327 / 6505.3 min
Slide the plate into the goal net · visionSolved414 / 5008.5 min
Slide the window open by pushing its handle sideways · visionSolved304 / 5007.6 min
Sort blocks into trays by colourSolved775 / 1,40049 s
Sort blocks into trays by colour · visionSolved967 / 1,4004.4 min
Sort by a two-part rule (vision, low-level control)Not solvedStep budget used up1,100 / 1,1008.5 min
Sort by shape with the wrist camera (low-level control)Not solvedAgent said done674 / 1,10013.9 min
Sort six blocks into three containers, one of them a drawer (one uncalibrated camera, low-level control)Not solvedAgent said done1,728 / 1,75015.0 min
Stack by size with the wrist camera (low-level control)Not solvedStep budget used up850 / 85014.1 min
Stack four thin plates precisely (vision, low-level control)Not solvedAgent gave up242 / 1,15011.5 min
Stack the heavy blocksSolved496 / 90074 s
Stack the red block on the blue blockSolved251 / 50033 s
Stack the red block on the blue block · visionSolved239 / 5002.4 min
Sweep the puck into the hole in the table · visionNot solvedAgent gave up455 / 50010.1 min
Sweep the puck off the edge of the table · visionNot solvedStep budget used up500 / 50011.1 min
Tight-clearance peg insertion (vision, low-level control)Not solvedAgent gave up220 / 6008.1 min
Tower of Hanoi, four discs (low-level control)Solved2,772 / 2,9003.9 min
Tower of Hanoi, four discs (vision, low-level control)Not solvedAgent gave up1,436 / 3,15027.9 min
Tower of Hanoi, three discsSolved2,208 / 2,5003.5 min
Tower of Hanoi, three discs · visionSolved1,381 / 2,5009.9 min