Robo Use

GLM-5.3 · Codex · metaworld

farama-foundation/metaworld · Sep 27, 2026 · 38 of 45 solved · 5 other trials not scored no image input

GLM-5.3 · Codex: the model's API rejected the camera images the harness attached, so its vision trials failed as infrastructure failures and are not scored (31 of its 43; the other 12 because the episode server did not start). Its scored trials saw no images.
Close the open door by pushing it shutSolved112 / 5001 min 21 s
Lock the door by turning the lock knob downSolved133 / 50041 s
Move the gripper to the goal positionSolved36 / 50016 s
Move the gripper to the goal position, reaching over the wallSolved135 / 50034 s
Open the door by pulling its handleSolved494 / 5002 min 43 s
Pick the cube out of the left bin and place it in the right binAPI rejected the imageInfra failureAPI rejected the image88 / 50033 s
Pick the nut off the peg by its handle and lift it clearSolved243 / 5001 min 9 s
Pick the peg out of the hole and lift it to the goalSolved89 / 50029 s
Pick up the ball and dunk it into the basketball hoopAPI rejected the imageInfra failureAPI rejected the image145 / 5001 min 11 s
Pick up the block and place it on the shelf at the goalSolved301 / 50059 s
Pick up the box lid and place it on top of the boxAPI rejected the imageInfra failureAPI rejected the image35 / 50021 s
Pick up the hammer and use it to hammer the nail into the wallSolved129 / 50048 s
Pick up the peg and insert it sideways into the hole in the boxSolved121 / 50029 s
Pick up the puck and place it at the goal (the goal is in the air)Solved136 / 50029 s
Pick up the puck and place it at the goal on the other side of a wallSolved116 / 50036 s
Pick up the round nut by its handle and place it over the pegAgent said doneNot solvedAgent said done157 / 50037 s
Pick up the stick and use it to pull the thermos to the goalAPI rejected the imageInfra failureAPI rejected the image41 / 50026 s
Pick up the stick and use it to push the thermos to the goalAgent said doneNot solvedAgent said done219 / 5001 min 14 s
Press the button down from aboveSolved64 / 50027 s
Press the button down from above; a short wall stands in front of itSolved100 / 50038 s
Press the button horizontally; reach it past the short wall in front of itSolved102 / 50041 s
Press the button on the coffee machineSolved28 / 50012 s
Press the button on the wall panel by pushing it horizontallySolved46 / 50020 s
Press the handle downSolved20 / 50029 s
Press the handle down, approaching from the sideSolved60 / 50031 s
Pull the drawer open by its handleSolved124 / 50026 s
Pull the handle upSolved206 / 5001 min 24 s
Pull the handle up, approaching from the sideSolved192 / 50047 s
Pull the lever up to the goalAgent said doneNot solvedAgent said done469 / 5001 min 31 s
Pull the mug out from under the coffee machine to the targetSolved104 / 50036 s
Pull the peg out sideways from the hole in the boxSolved86 / 50030 s
Pull the puck back toward the robot to the goalSolved144 / 50035 s
Push or carry the block into the hole in the table (the block must end within 5 cm of the hole)API rejected the imageInfra failureAPI rejected the image79 / 50035 s
Push the ball into the goalSolved73 / 50022 s
Push the drawer closedSolved120 / 50025 s
Push the mug under the coffee machine to the targetSolved135 / 5001 min 34 s
Push the puck to the goal on the tableSolved47 / 50021 s
Push the puck to the goal, around the wall between themAgent said doneNot solvedAgent said done489 / 5002 min 35 s
Rotate the dial by pushing its handle aroundStep budget used upNot solvedStep budget used up500 / 5003 min 56 s
Slide the plate back out of the net to the goalStep budget used upNot solvedStep budget used up500 / 5001 min 32 s
Slide the plate into the goal netSolved88 / 50031 s
Slide the plate sideways into the goal netSolved124 / 50032 s
Slide the plate sideways out of the net to the goalStep budget used upNot solvedStep budget used up500 / 5001 min 6 s
Slide the window closed by pushing its handle sidewaysSolved81 / 50034 s
Slide the window open by pushing its handle sidewaysSolved73 / 50031 s
Sweep the puck into the hole in the tableSolved51 / 50029 s
Sweep the puck off the edge of the tableSolved319 / 5001 min 8 s
Turn the faucet handle to close itSolved94 / 50023 s
Turn the faucet handle to open itSolved257 / 50045 s
Unlock the door by turning the lock knobSolved235 / 50055 s