Robo Use

Opus 5.5 · Claude Code · robouse-menagerie

benchflow/robouse-menagerie · Oct 13, 2026 · 15 of 15 solved

Ran Oct 13, 2026 on Linux with Robo Use 0.4.0. The other agent pairs ran this dataset Sep 27 to 29, 2026 on macOS, with the same task text and observations, step budgets and time limits.

Bin a scrap blank and set a fragile vial down gently on a marked square (dual Panda)Solved221 / 1,0001 min 26 s
Carry a block from a bowl onto a gold-outlined square and stand it upright (dual Panda)Solved115 / 60041 s
Carry a chess pawn from a bowl onto a gold-outlined square (ALOHA 2)Solved102 / 60043 s
Deliver a payload between two pads without touching a tall protected column (dual Panda)Solved146 / 1,00049 s
Find a pawn in camera images and land it on a gold-outlined square (ALOHA 2)Solved248 / 6002 min 8 s
Find a target cylinder among protected neighbours in camera images and move it to a tray (dual Panda)Solved226 / 8001 min 51 s
Infer a composed grid rule from examples and place three tokens accordingly (ALOHA 2)Solved392 / 2,0001 min 34 s
Infer a grid rule from examples and place three tokens accordingly (dual Panda)Solved367 / 2,0001 min 51 s
Lift a target cylinder out of a ring of protected neighbours into a tray (ALOHA 2)Solved240 / 8001 min 28 s
Lift a target cylinder out of a ring of protected neighbours into a tray (dual Panda)Solved114 / 80050 s
Place eight chess pieces from two bowls on assigned squares with two arms at once (dual Panda)Solved674 / 3,0002 min 29 s
Place four chess pieces on assigned squares using both arms (ALOHA 2)Solved385 / 2,0002 min 8 s
Read each vial's hidden underside label with an upward camera, then pack it by colour (dual Panda)Solved504 / 2,5002 min 28 s
Seat a peg in a socket under a 6 N contact-force limit (ALOHA 2)Solved194 / 1,2001 min 2 s
Turn a keyed peg square to a tight rectangular socket and seat it gently (dual Panda)Solved198 / 1,5002 min 3 s