GLM-5.3 · Claude Code · robouse-tabletop
| Build a three-level bridge (vision, low-level control)Harness timeout | Not solved | Harness timeout | 468 / 1,100 | 20 min 6 s |
|---|---|---|---|---|
| Build a tower and crown it with a fragile vial (vision, low-level control)Harness timeout | Not solved | Harness timeout | 246 / 850 | 20 min 6 s |
| Close the drawer | Solved | 144 / 400 | 1 min 46 s | |
| Close the drawer | Solved not counted | 245 / 400 | 1 min 45 s | |
| Close the drawer · visionAgent said done | Not solved | Agent said done | 249 / 400 | 12 min 17 s |
| Count with the wrist cameraStep budget used up | Not solved | Step budget used up | 550 / 550 | 10 min 6 s |
| Curling: two pucks into an unreachable zoneAgent said done | Not solved | Agent said done | 428 / 1,050 | 15 min 17 s |
| Find the red cube with the wrist cameraStep budget used up | Not solved | Step budget used up | 550 / 550 | 2 min 48 s |
| Gentle placement of a fragile vial | Solved | 240 / 700 | 53 s | |
| Gentle placement of a fragile vial · vision | Solved | 378 / 700 | 5 min 36 s | |
| Heavy block and figureAgent gave up | Not solved | Agent gave up | 252 / 700 | 35 s |
| Heavy blocks and figureAgent gave up | Not solved | Agent gave up | 269 / 900 | 45 s |
| Insert a peg found with the wrist camera (low-level control)Agent said done | Not solved | Agent said done | 379 / 500 | 16 min 15 s |
| Insert a peg into a socket | Solved | 220 / 600 | 1 min 1 s | |
| Insert a peg into a socket · vision | Solved not counted | 281 / 600 | 7 min 27 s | |
| Knife and figure | Solved | 0 / 700 | 26 s | |
| Move a heavy block past a person (vision)Step budget used up | Not solved | Step budget used up | 650 / 650 | 7 min 52 s |
| Move the blue block between the cylinder and the tray | Solved | 230 / 500 | 34 s | |
| Move the blue block between the cylinder and the tray · visionAgent said done | Not solved | Agent said done | 216 / 500 | 2 min 52 s |
| Move the gripper to the goal position · visionHarness timeout | Not solved | Harness timeout | 28 / 500 | 15 min 7 s |
| Move the gripper to the goal position, reaching over the wall · vision | Solved | 138 / 500 | 5 min 31 s | |
| Move the red block that is left of the bowl | Solved | 196 / 500 | 24 s | |
| Move the red block that is left of the bowl · visionHarness timeout | Not solved | Harness timeout | 218 / 500 | 15 min 6 s |
| One uncalibrated camera: Tower of Hanoi, three discsAgent said done | Not solved | Agent said done | 1,542 / 1,550 | 8 min 5 s |
| One uncalibrated camera: cylinder into the bowlStep budget used up | Not solved | Step budget used up | 500 / 500 | 13 min 53 s |
| One uncalibrated side camera: build a three-block towerStep budget used up | Not solved | Step budget used up | 850 / 850 | 16 min 30 s |
| Open the door by pulling its handle · visionAgent said done | Not solved | Agent said done | 128 / 500 | 2 min 21 s |
| Open the drawer | Solved | 334 / 400 | 1 min 36 s | |
| Open the drawer and put the block inside | Solved | 448 / 900 | 1 min 18 s | |
| Open the drawer and put the block inside · visionHarness timeout | Not solved | Harness timeout | 266 / 900 | 15 min 6 s |
| Open the drawer · visionStep budget used up | Not solved | Step budget used up | 400 / 400 | 9 min 16 s |
| Pick the cube out of the left bin and place it in the right bin · visionStep budget used up | Not solved | Step budget used up | 500 / 500 | 8 min 16 s |
| Pick the nut off the peg by its handle and lift it clear · vision | Solved | 154 / 500 | 12 min 48 s | |
| Pick the peg out of the hole and lift it to the goal · visionAgent said done | Not solved | Agent said done | 110 / 500 | 11 min 28 s |
| Pick up the ball and dunk it into the basketball hoop · visionHarness timeout | Not solved | Harness timeout | 239 / 500 | 15 min 6 s |
| Pick up the block and place it on the shelf at the goal · vision | Solved | 179 / 500 | 1 min 43 s | |
| Pick up the hammer and use it to hammer the nail into the wall · visionAgent said done | Not solved | Agent said done | 203 / 500 | 13 min 31 s |
| Pick up the puck and place it at the goal (the goal is in the air) · visionAgent said done | Not solved | Agent said done | 80 / 500 | 10 min 25 s |
| Pick up the puck and place it at the goal on the other side of a wall · visionHarness timeout | Not solved | Harness timeout | 79 / 500 | 15 min 6 s |
| Pick up the round nut by its handle and place it over the peg · visionAgent said done | Not solved | Agent said done | 231 / 500 | 12 min 28 s |
| Place the cylinder on the left pad | Solved | 225 / 500 | 2 min 6 s | |
| Place the cylinder on the left pad · vision | Solved | 492 / 500 | 4 min 3 s | |
| Precise landing on a small pad | Solved | 149 / 500 | 1 min 27 s | |
| Precise landing on a small pad · vision | Solved | 493 / 500 | 8 min 14 s | |
| Press the button on the wall panel by pushing it horizontally · visionAgent said done | Not solved | Agent said done | 104 / 500 | 11 min 52 s |
| Pull the drawer open by its handle · visionAgent said done | Not solved | Agent said done | 116 / 500 | 12 min 15 s |
| Pull the puck back toward the robot to the goal · visionHarness timeout | Not solved | Harness timeout | 378 / 500 | 15 min 6 s |
| Push the ball into the goal · visionAgent said done | Not solved | Agent said done | 156 / 500 | 11 min 24 s |
| Push the block into the bin | Solved | 609 / 700 | 6 min 51 s | |
| Push the block off the tableAgent gave up | Not solved | Agent gave up | 315 / 700 | 2 min 58 s |
| Push the block onto the green pad | Solved | 335 / 500 | 1 min 3 s | |
| Push the block onto the green pad · vision | Solved | 309 / 500 | 5 min 36 s | |
| Push the mug under the coffee machine to the target · visionHarness timeout | Not solved | Harness timeout | 221 / 500 | 15 min 6 s |
| Push the puck to the goal on the table · visionHarness timeout | Not solved | Harness timeout | 189 / 500 | 15 min 6 s |
| Push the puck to the goal, around the wall between them · visionHarness timeout | Not solved | Harness timeout | 25 / 500 | 15 min 6 s |
| Put both blocks in the bowl | Solved | 462 / 800 | 2 min 34 s | |
| Put both blocks in the bowl · visionAgent said done | Not solved | Agent said done | 478 / 800 | 12 min 46 s |
| Put the block in the drawer and close it | Solved | 327 / 900 | 1 min 20 s | |
| Put the block in the drawer and close it | Solved not counted | 419 / 900 | 3 min 19 s | |
| Put the block in the drawer and close it · visionAgent said done | Not solved | Agent said done | 562 / 900 | 7 min |
| Put the green cube on the plate | Solved | 203 / 500 | 42 s | |
| Put the green cube on the plate · vision | Solved | 235 / 500 | 1 min 48 s | |
| Put the heavy block on the pad | Solved | 233 / 700 | 1 min 34 s | |
| Put the knife away | Solved | 262 / 700 | 48 s | |
| Put the red block in the bowl | Solved | 236 / 500 | 37 s | |
| Put the red block in the bowl · visionHarness timeout | Not solved | Harness timeout | 440 / 500 | 15 min 6 s |
| Relocate a payload past a protected column | Solved | 271 / 600 | 35 s | |
| Relocate a payload past a protected column · vision | Solved | 417 / 600 | 4 min 24 s | |
| Retrieve a block from clutter | Solved | 248 / 500 | 52 s | |
| Retrieve a block from clutter | Solved not counted | 230 / 500 | 1 min 22 s | |
| Retrieve a block from clutter · vision | Solved | 225 / 500 | 3 min 23 s | |
| Reverse a four-block tower in place (vision, low-level control, tight budget)Agent gave up | Not solved | Agent gave up | 1,649 / 1,750 | 28 min 51 s |
| Rotate the dial by pushing its handle around · visionAgent said done | Not solved | Agent said done | 103 / 500 | 14 min 35 s |
| Rule inference from pictures: completing a patternHarness timeout | Not solved | Harness timeout | 485 / 1,450 | 30 min 6 s |
| Rule inference from pictures: pairsHarness timeout | Not solved | Harness timeout | 107 / 950 | 20 min 10 s |
| Rule inference from pictures: pairsAgent said done | Not solved not counted | Agent said done | 284 / 950 | 18 min 11 s |
| Rule inference from pictures: shapesAgent said done | Not solved | Agent said done | 0 / 1,050 | 6 min 5 s |
| Rule inference from pictures: the black marker | Solved | 628 / 1,200 | 15 min 54 s | |
| Rule inference from pictures: the black markerHarness timeout | Not solved not counted | Harness timeout | 411 / 1,200 | 20 min 6 s |
| Rule inference from pictures: turningHarness timeout | Not solved | Harness timeout | 216 / 1,100 | 20 min 6 s |
| Rule inference: blocks and pads | Solved | 709 / 1,200 | 54 s | |
| Rule inference: blocks and pads · visionHarness timeout | Not solved | Harness timeout | 914 / 1,200 | 15 min 7 s |
| Rule inference: blocks and pads · vision | Solved not counted | 756 / 1,200 | 2 min 32 s | |
| Rule inference: completing a pattern | Solved | 533 / 1,200 | 1 min 18 s | |
| Rule inference: completing a pattern · vision | Solved | 790 / 1,200 | 4 min 54 s | |
| Rule inference: exchange | Solved | 559 / 1,000 | 1 min 38 s | |
| Rule inference: exchange · vision | Solved | 651 / 1,000 | 2 min 28 s | |
| Rule inference: falling | Solved | 791 / 1,400 | 4 min 33 s | |
| Rule inference: falling · visionHarness timeout | Not solved | Harness timeout | 1,234 / 1,400 | 15 min 6 s |
| Rule inference: orderingTrial time limit | Not solved | Trial time limit | 1,063 / 1,400 | 22 min 14 s |
| Rule inference: ordering · visionAgent said done | Not solved | Agent said done | 944 / 1,400 | 3 min 57 s |
| Rule inference: sizes | Solved | 388 / 800 | 1 min 39 s | |
| Rule inference: sizes · vision | Solved | 412 / 800 | 5 min 44 s | |
| Rule inference: sorting | Solved | 948 / 1,400 | 1 min 28 s | |
| Rule inference: sorting · vision | Solved | 635 / 1,400 | 1 min 25 s | |
| Rule inference: the marker | Solved | 331 / 500 | 1 min 22 s | |
| Rule inference: the marker · visionAgent gave up | Not solved | Agent gave up | 497 / 500 | 12 min 54 s |
| Rule inference: the marker · visionAgent gave up | Not solved not counted | Agent gave up | 473 / 500 | 11 min 34 s |
| Rule inference: the missing piece | Solved | 247 / 600 | 1 min 26 s | |
| Rule inference: the missing piece | Solved not counted | 345 / 600 | 55 s | |
| Rule inference: the missing piece · vision | Solved | 188 / 600 | 1 min 33 s | |
| Rule inference: translation | Solved | 710 / 1,400 | 1 min 49 s | |
| Rule inference: translation · visionHarness timeout | Not solved | Harness timeout | 1,183 / 1,400 | 15 min 6 s |
| Rule inference: which one moves | Solved | 217 / 500 | 26 s | |
| Rule inference: which one moves · vision | Solved | 309 / 500 | 4 min 57 s | |
| Set up a 2x2 board positionHarness timeout | Not solved | Harness timeout | 680 / 1,400 | 15 min 6 s |
| Set up a 2x2 board position · visionHarness timeout | Not solved | Harness timeout | 713 / 1,400 | 15 min 6 s |
| Shuffleboard: slide the puck into an unreachable zoneAgent gave up | Not solved | Agent gave up | 283 / 650 | 6 min 2 s |
| Slide the plate into the goal net · visionAgent said done | Not solved | Agent said done | 193 / 500 | 9 min 21 s |
| Slide the window open by pushing its handle sideways · visionAgent said done | Not solved | Agent said done | 67 / 500 | 5 min 56 s |
| Sort blocks into trays by colour | Solved | 858 / 1,400 | 35 s | |
| Sort blocks into trays by colour · visionHarness timeout | Not solved | Harness timeout | 701 / 1,400 | 15 min 6 s |
| Sort by a two-part rule (vision, low-level control)Harness timeout | Not solved | Harness timeout | 479 / 1,100 | 20 min 6 s |
| Sort by shape with the wrist camera (low-level control)Harness timeout | Not solved | Harness timeout | 960 / 1,100 | 20 min 6 s |
| Sort six blocks into three containers, one of them a drawer (one uncalibrated camera, low-level control)Harness timeout | Not solved | Harness timeout | 713 / 1,750 | 30 min 6 s |
| Stack by size with the wrist camera (low-level control)Agent gave up | Not solved | Agent gave up | 838 / 850 | 13 min 14 s |
| Stack four thin plates precisely (vision, low-level control)Harness timeout | Not solved | Harness timeout | 815 / 1,150 | 30 min 6 s |
| Stack the heavy blocksHarness timeout | Not solved | Harness timeout | 888 / 900 | 15 min 4 s |
| Stack the red block on the blue block | Solved | 233 / 500 | 33 s | |
| Stack the red block on the blue block · visionAgent said done | Not solved | Agent said done | 458 / 500 | 4 min |
| Sweep the puck into the hole in the table · visionHarness timeout | Not solved | Harness timeout | 313 / 500 | 15 min 7 s |
| Sweep the puck off the edge of the table · visionAgent said done | Not solved | Agent said done | 115 / 500 | 7 min 39 s |
| Tight-clearance peg insertion (vision, low-level control)Agent said done | Not solved | Agent said done | 185 / 600 | 4 min 40 s |
| Tower of Hanoi, four discs (low-level control) | Solved | 1,663 / 2,900 | 6 min 22 s | |
| Tower of Hanoi, four discs (vision, low-level control)Agent gave up | Not solved | Agent gave up | 561 / 3,150 | 9 min 28 s |
| Tower of Hanoi, three discs | Solved | 1,221 / 2,500 | 4 min 55 s | |
| Tower of Hanoi, three discs | Solved not counted | 2,151 / 2,500 | 5 min 54 s | |
| Tower of Hanoi, three discs · visionStep budget used up | Not solved | Step budget used up | 2,500 / 2,500 | 13 min 4 s |
No trials match these filters.