List existing worktrees
Tests ability to list all existing worktrees. Evaluates worktree-enumeration command knowledge.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo 'Hello' > hello.txt
  5. 05 git add hello.txt
  6. 06 git commit -m 'Initial commit'
  7. 07 git checkout -b feature
  8. 08 echo 'Feature' > feature.txt
  9. 09 git add feature.txt
  10. 10 git commit -m 'Add feature'
  11. 11 git checkout main
  12. 12 git worktree add ../feature-wt feature
Prompt
Run the command to list all git worktrees. Output ONLY the git command, nothing else.
Expected
git worktree list

Scoped model quality, cost, API time, and token usage for worktree_usage/f004.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 246 in → 38 out (20 reasoning)
git worktree list --porcelain
anthropic/claude-fable-5:high__json_schema PASS 100% 460 in → 45 out (34 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command": "git worktree list --porcelain"}
anthropic/claude-fable-5:low PASS 100% 252 in → 25 out (11 reasoning)
git worktree list --porcelain
anthropic/claude-fable-5:low__json_schema PASS 100% 461 in → 19 out (0 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command": "git worktree list --porcelain"}
anthropic/claude-fable-5:max PASS 100% 248 in → 200 out (47 reasoning)
git worktree list --porcelain
anthropic/claude-fable-5:max__json_schema PASS 100% 460 in → 208 out (50 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command": "git worktree list --porcelain"}
anthropic/claude-fable-5:medium PASS 100% 244 in → 38 out (34 reasoning)
git worktree list --porcelain
anthropic/claude-fable-5:medium__json_schema PASS 100% 453 in → 32 out (11 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command": "git worktree list --porcelain"}
anthropic/claude-fable-5:xhigh PASS 100% 243 in → 55 out (34 reasoning)
git worktree list --porcelain
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 465 in → 58 out (18 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command": "git worktree list --porcelain"}
anthropic/claude-haiku-4.5:high PASS 100% 238 in → 97 out (83 reasoning)
``` git worktree list ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 402 in → 216 out (202 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-haiku-4.5:low PASS 100% 241 in → 104 out (94 reasoning)
``` git worktree list ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 404 in → 105 out (87 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-haiku-4.5:medium PASS 100% 239 in → 97 out (85 reasoning)
``` git worktree list ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 408 in → 140 out (126 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-haiku-4.5:none PASS 100% 204 in → 12 out (0 reasoning)
``` git worktree list ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 374 in → 13 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 251 in → 151 out (144 reasoning)
``` git worktree list ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 402 in → 157 out (143 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-opus-4.6:high PASS 100% 212 in → 13 out (0 reasoning)
``` git worktree list ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 375 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.6:low PASS 100% 213 in → 12 out (0 reasoning)
``` git worktree list ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 371 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.6:max PASS 100% 211 in → 95 out (67 reasoning)
``` git worktree list --porcelain ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 372 in → 45 out (18 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.6:medium PASS 100% 217 in → 13 out (0 reasoning)
``` git worktree list ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 374 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.6:none PASS 100% 207 in → 12 out (0 reasoning)
``` git worktree list ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 370 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.6:xhigh PASS 100% 216 in → 77 out (54 reasoning)
``` git worktree list --porcelain ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 377 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.7:high PASS 100% 254 in → 9 out (0 reasoning)
git worktree list
anthropic/claude-opus-4.7:high__json_schema PASS 100% 458 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.7:low PASS 100% 253 in → 9 out (0 reasoning)
git worktree list
anthropic/claude-opus-4.7:low__json_schema PASS 100% 465 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.7:max__json_schema PASS 100% 461 in → 21 out (0 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command":"git worktree list --porcelain"}
anthropic/claude-opus-4.7:medium PASS 100% 255 in → 9 out (0 reasoning)
git worktree list
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 460 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.7:none PASS 100% 250 in → 9 out (0 reasoning)
git worktree list
anthropic/claude-opus-4.7:none__json_schema PASS 100% 462 in → 21 out (0 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command":"git worktree list --porcelain"}
anthropic/claude-opus-4.7:xhigh PASS 100% 255 in → 9 out (0 reasoning)
git worktree list
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 459 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.8:high PASS 100% 248 in → 44 out (22 reasoning)
``` git worktree list ```
anthropic/claude-opus-4.8:high__json_schema PASS 100% 460 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-opus-4.8:low PASS 100% 251 in → 7 out (0 reasoning)
git worktree list
anthropic/claude-opus-4.8:low__json_schema PASS 100% 460 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-opus-4.8:max PASS 100% 247 in → 11 out (0 reasoning)
``` git worktree list ```
anthropic/claude-opus-4.8:max__json_schema PASS 100% 457 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.8:medium PASS 100% 248 in → 11 out (0 reasoning)
``` git worktree list ```
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 465 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-opus-4.8:none PASS 100% 251 in → 7 out (0 reasoning)
git worktree list
anthropic/claude-opus-4.8:none__json_schema PASS 100% 460 in → 13 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-opus-4.8:xhigh PASS 100% 249 in → 47 out (32 reasoning)
``` git worktree list ```
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 463 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 376 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 370 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 376 in → 55 out (27 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 367 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 370 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 375 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-5:high PASS 100% 246 in → 7 out (0 reasoning)
git worktree list
anthropic/claude-sonnet-5:high__json_schema PASS 100% 457 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-5:low PASS 100% 249 in → 7 out (0 reasoning)
git worktree list
anthropic/claude-sonnet-5:low__json_schema PASS 100% 457 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-5:medium PASS 100% 250 in → 7 out (0 reasoning)
git worktree list
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 459 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
anthropic/claude-sonnet-5:none PASS 100% 242 in → 7 out (0 reasoning)
git worktree list
anthropic/claude-sonnet-5:none__json_schema PASS 100% 463 in → 13 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
anthropic/claude-sonnet-5:xhigh PASS 100% 252 in → 7 out (0 reasoning)
git worktree list
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 465 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
arcee-ai/trinity-large-thinking:high PASS 100% 173 in → 162 out (155 reasoning)
git worktree list
arcee-ai/trinity-large-thinking:low PASS 100% 173 in → 195 out (188 reasoning)
git worktree list
arcee-ai/trinity-large-thinking:medium PASS 100% 174 in → 154 out (147 reasoning)
git worktree list
arcee-ai/trinity-large-thinking:xhigh PASS 100% 175 in → 181 out (174 reasoning)
git worktree list
arcee-ai/trinity-mini:high PASS 100% 175 in → 348 out (394 reasoning)
git worktree list
arcee-ai/trinity-mini:high__json_schema PASS 100% 168 in → 264 out (312 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
arcee-ai/trinity-mini:low PASS 100% 174 in → 370 out (398 reasoning)
git worktree list
arcee-ai/trinity-mini:low__json_schema PASS 100% 172 in → 280 out (319 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
arcee-ai/trinity-mini:medium PASS 100% 173 in → 214 out (249 reasoning)
git worktree list
arcee-ai/trinity-mini:medium__json_schema PASS 100% 180 in → 291 out (334 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
arcee-ai/trinity-mini:xhigh PASS 100% 180 in → 284 out (339 reasoning)
git worktree list
deepseek/deepseek-v4-flash-0731:high PASS 100% 264 in → 75 out (70 reasoning)
git worktree list
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 263 in → 56 out (49 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
deepseek/deepseek-v4-flash-0731:low PASS 100% 182 in → 61 out (60 reasoning)
git worktree list
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 193 in → 108 out (101 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
deepseek/deepseek-v4-flash-0731:max PASS 100% 270 in → 36 out (31 reasoning)
git worktree list
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 269 in → 24 out (15 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
deepseek/deepseek-v4-flash-0731:medium PASS 100% 183 in → 51 out (46 reasoning)
git worktree list
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 184 in → 96 out (89 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
deepseek/deepseek-v4-flash-0731:none PASS 100% 188 in → 5 out (0 reasoning)
git worktree list
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 186 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 266 in → 57 out (59 reasoning)
git worktree list
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 178 in → 65 out (57 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list" }
deepseek/deepseek-v4-flash:high PASS 100% 191 in → 42 out (36 reasoning)
git worktree list
deepseek/deepseek-v4-flash:low PASS 100% 192 in → 43 out (37 reasoning)
git worktree list
deepseek/deepseek-v4-flash:low__json_schema PASS 100% 190 in → 59 out (50 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
deepseek/deepseek-v4-flash:medium PASS 100% 185 in → 55 out (49 reasoning)
git worktree list
deepseek/deepseek-v4-flash:medium__json_schema PASS 100% 277 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
deepseek/deepseek-v4-flash:none PASS 100% 184 in → 5 out (0 reasoning)
git worktree list
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 194 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
deepseek/deepseek-v4-flash:xhigh PASS 100% 264 in → 132 out (137 reasoning)
git worktree list
deepseek/deepseek-v4-pro:high PASS 100% 195 in → 83 out (77 reasoning)
git worktree list
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 186 in → 114 out (100 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
deepseek/deepseek-v4-pro:low PASS 100% 185 in → 209 out (204 reasoning)
git worktree list
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 188 in → 64 out (50 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
deepseek/deepseek-v4-pro:medium PASS 100% 192 in → 116 out (110 reasoning)
git worktree list
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 382 in → 80 out (69 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
deepseek/deepseek-v4-pro:none PASS 100% 188 in → 5 out (0 reasoning)
git worktree list
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 187 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 188 in → 47 out (45 reasoning)
git worktree list
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 190 in → 13 out (12 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemini-3-flash-preview:high PASS 100% 232 in → 544 out (537 reasoning)
git worktree list --porcelain
google/gemini-3-flash-preview:high__json_schema PASS 100% 289 in → 150 out (142 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemini-3-flash-preview:low PASS 100% 231 in → 130 out (126 reasoning)
git worktree list
google/gemini-3-flash-preview:low__json_schema PASS 100% 290 in → 79 out (70 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3-flash-preview:medium PASS 100% 233 in → 98 out (94 reasoning)
git worktree list
google/gemini-3-flash-preview:medium__json_schema PASS 100% 288 in → 53 out (44 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3-flash-preview:xhigh PASS 100% 233 in → 95 out (91 reasoning)
git worktree list
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 291 in → 344 out (335 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 232 in → 176 out (172 reasoning)
git worktree list
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 231 in → 168 out (159 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.1-flash-lite-preview:low PASS 100% 232 in → 123 out (119 reasoning)
git worktree list
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 293 in → 125 out (111 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemini-3.1-flash-lite-preview:medium PASS 100% 236 in → 61 out (57 reasoning)
git worktree list
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 289 in → 167 out (158 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 238 in → 187 out (183 reasoning)
git worktree list
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 236 in → 169 out (160 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.1-pro-preview:high PASS 100% 235 in → 865 out (858 reasoning)
git worktree list --porcelain
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 294 in → 243 out (235 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemini-3.1-pro-preview:low PASS 100% 234 in → 453 out (446 reasoning)
git worktree list --porcelain
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 294 in → 206 out (198 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemini-3.1-pro-preview:medium PASS 100% 235 in → 889 out (882 reasoning)
git worktree list --porcelain
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 282 in → 258 out (249 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 229 in → 815 out (808 reasoning)
git worktree list --porcelain
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 287 in → 885 out (874 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command":"git worktree list --porcelain"}
google/gemini-3.5-flash-lite:high PASS 100% 234 in → 183 out (179 reasoning)
git worktree list
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 234 in → 364 out (355 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.5-flash-lite:low PASS 100% 238 in → 4 out (0 reasoning)
git worktree list
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 285 in → 14 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemini-3.5-flash-lite:max PASS 100% 238 in → 184 out (180 reasoning)
git worktree list
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 286 in → 214 out (205 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.5-flash-lite:medium PASS 100% 232 in → 162 out (158 reasoning)
git worktree list
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 289 in → 248 out (239 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 233 in → 209 out (205 reasoning)
git worktree list
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 286 in → 199 out (190 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.5-flash:high PASS 100% 234 in → 168 out (164 reasoning)
git worktree list
google/gemini-3.5-flash:high__json_schema PASS 100% 293 in → 273 out (264 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.5-flash:low PASS 100% 234 in → 151 out (147 reasoning)
git worktree list
google/gemini-3.5-flash:low__json_schema PASS 100% 289 in → 32 out (23 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemini-3.5-flash:medium PASS 100% 226 in → 122 out (118 reasoning)
git worktree list
google/gemini-3.5-flash:medium__json_schema PASS 100% 285 in → 141 out (127 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemini-3.5-flash:xhigh PASS 100% 226 in → 796 out (789 reasoning)
git worktree list --porcelain
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 294 in → 138 out (130 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemini-3.6-flash:high PASS 100% 230 in → 188 out (184 reasoning)
git worktree list
google/gemini-3.6-flash:high__json_schema PASS 100% 293 in → 200 out (192 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemini-3.6-flash:low PASS 100% 231 in → 38 out (34 reasoning)
git worktree list
google/gemini-3.6-flash:low__json_schema PASS 100% 289 in → 8 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemini-3.6-flash:max PASS 100% 232 in → 130 out (126 reasoning)
git worktree list
google/gemini-3.6-flash:max__json_schema PASS 100% 285 in → 164 out (150 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemini-3.6-flash:medium PASS 100% 237 in → 499 out (492 reasoning)
git worktree list --porcelain
google/gemini-3.6-flash:medium__json_schema PASS 100% 290 in → 91 out (83 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemini-3.6-flash:xhigh PASS 100% 235 in → 164 out (160 reasoning)
git worktree list
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 236 in → 213 out (205 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemma-4-26b-a4b-it:high PASS 100% 252 in → 76 out (80 reasoning)
git worktree list
google/gemma-4-26b-a4b-it:high__json_schema PASS 100% 251 in → 133 out (113 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemma-4-26b-a4b-it:low PASS 100% 254 in → 133 out (128 reasoning)
git worktree list
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 247 in → 56 out (41 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemma-4-26b-a4b-it:medium PASS 100% 251 in → 138 out (133 reasoning)
git worktree list
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 255 in → 140 out (127 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemma-4-26b-a4b-it:none PASS 100% 245 in → 5 out (0 reasoning)
git worktree list
google/gemma-4-26b-a4b-it:none__json_schema PASS 100% 243 in → 15 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemma-4-26b-a4b-it:xhigh PASS 100% 244 in → 176 out (161 reasoning)
git worktree list
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 255 in → 108 out (90 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemma-4-31b-it:high PASS 100% 249 in → 116 out (115 reasoning)
git worktree list
google/gemma-4-31b-it:high__json_schema PASS 100% 242 in → 99 out (82 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
google/gemma-4-31b-it:low PASS 100% 253 in → 86 out (77 reasoning)
git worktree list
google/gemma-4-31b-it:low__json_schema PASS 100% 246 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemma-4-31b-it:medium PASS 100% 252 in → 98 out (96 reasoning)
git worktree list
google/gemma-4-31b-it:medium__json_schema PASS 100% 249 in → 99 out (1 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
google/gemma-4-31b-it:none PASS 100% 240 in → 5 out (0 reasoning)
git worktree list
google/gemma-4-31b-it:none__json_schema PASS 100% 244 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
google/gemma-4-31b-it:xhigh PASS 100% 245 in → 74 out (69 reasoning)
git worktree list
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 253 in → 86 out (75 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
ibm-granite/granite-4.1-8b PASS 100% 202 in → 5 out
git worktree list
ibm-granite/granite-4.1-8b__json_schema PASS 100% 199 in → 14 out
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
inclusionai/ling-2.6-flash PASS 100% 240 in → 5 out
git worktree list
inclusionai/ling-2.6-flash__json_schema PASS 100% 242 in → 14 out
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
minimax/minimax-m2.5:high PASS 100% 212 in → 202 out (201 reasoning)
git worktree list
minimax/minimax-m2.5:high__json_schema PASS 100% 204 in → 67 out (64 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
minimax/minimax-m2.5:low PASS 100% 206 in → 87 out (98 reasoning)
git worktree list
minimax/minimax-m2.5:low__json_schema PASS 100% 211 in → 70 out (63 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
minimax/minimax-m2.5:medium PASS 100% 207 in → 68 out (62 reasoning)
git worktree list
minimax/minimax-m2.5:medium__json_schema PASS 100% 212 in → 58 out (50 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
minimax/minimax-m2.5:xhigh PASS 100% 215 in → 82 out (93 reasoning)
git worktree list
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 229 in → 103 out (107 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
minimax/minimax-m2.7:high PASS 100% 209 in → 186 out (180 reasoning)
git worktree list
minimax/minimax-m2.7:low PASS 100% 205 in → 233 out (228 reasoning)
git worktree list
minimax/minimax-m2.7:low__json_schema PASS 100% 341 in → 458 out (448 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
minimax/minimax-m2.7:medium PASS 100% 213 in → 193 out (187 reasoning)
git worktree list
minimax/minimax-m2.7:medium__json_schema PASS 100% 339 in → 442 out (432 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
minimax/minimax-m2.7:xhigh PASS 100% 207 in → 211 out (236 reasoning)
git worktree list
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 338 in → 516 out (506 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
minimax/minimax-m3:high PASS 100% 346 in → 28 out (27 reasoning)
git worktree list
minimax/minimax-m3:high__json_schema PASS 100% 334 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
minimax/minimax-m3:low PASS 100% 343 in → 33 out (32 reasoning)
git worktree list
minimax/minimax-m3:low__json_schema PASS 100% 331 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
minimax/minimax-m3:medium PASS 100% 343 in → 38 out (39 reasoning)
git worktree list
minimax/minimax-m3:medium__json_schema PASS 100% 327 in → 13 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
minimax/minimax-m3:xhigh PASS 100% 344 in → 41 out (41 reasoning)
git worktree list
minimax/minimax-m3:xhigh__json_schema PASS 100% 333 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
mistralai/devstral-2512 PASS 100% 231 in → 10 out
```bash git worktree list ```
mistralai/devstral-2512__json_schema PASS 100% 234 in → 10 out
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
mistralai/mistral-medium-3-5:high PASS 100% 250 in → 132 out (127 reasoning)
git worktree list
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 236 in → 87 out (84 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
mistralai/mistral-medium-3-5:low PASS 100% 250 in → 196 out (202 reasoning)
git worktree list
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 236 in → 99 out (100 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
mistralai/mistral-medium-3-5:medium PASS 100% 251 in → 129 out (127 reasoning)
git worktree list
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 235 in → 123 out (127 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
mistralai/mistral-medium-3-5:none PASS 100% 243 in → 5 out (0 reasoning)
git worktree list
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 239 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 245 in → 104 out (106 reasoning)
git worktree list
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 232 in → 108 out (107 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
moonshotai/kimi-k2.6:high PASS 100% 176 in → 90 out (99 reasoning)
git worktree list
moonshotai/kimi-k2.6:high__json_schema PASS 100% 177 in → 381 out (159 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
moonshotai/kimi-k2.6:low PASS 100% 178 in → 2,147 out (2,141 reasoning)
git worktree list
moonshotai/kimi-k2.6:low__json_schema PASS 100% 171 in → 161 out (151 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
moonshotai/kimi-k2.6:medium PASS 100% 179 in → 161 out (155 reasoning)
git worktree list
moonshotai/kimi-k2.6:xhigh PASS 100% 172 in → 146 out (174 reasoning)
git worktree list
moonshotai/kimi-k2.7-code:high PASS 100% 176 in → 92 out (104 reasoning)
git worktree list
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 260 in → 142 out (131 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
moonshotai/kimi-k2.7-code:low PASS 100% 171 in → 680 out (671 reasoning)
git worktree list --porcelain
moonshotai/kimi-k2.7-code:medium PASS 100% 172 in → 62 out (56 reasoning)
git worktree list
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 259 in → 109 out (99 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
moonshotai/kimi-k2.7-code:xhigh PASS 100% 173 in → 459 out (450 reasoning)
git worktree list --porcelain
moonshotai/kimi-k3:high PASS 100% 256 in → 65 out (46 reasoning)
git worktree list
moonshotai/kimi-k3:high__json_schema PASS 100% 244 in → 58 out (39 reasoning)
git worktree list
moonshotai/kimi-k3:low PASS 100% 249 in → 67 out (48 reasoning)
git worktree list
moonshotai/kimi-k3:low__json_schema PASS 100% 249 in → 60 out (41 reasoning)
git worktree list
moonshotai/kimi-k3:max PASS 100% 247 in → 58 out (39 reasoning)
git worktree list
moonshotai/kimi-k3:max__json_schema PASS 100% 247 in → 62 out (43 reasoning)
git worktree list
moonshotai/kimi-k3:medium PASS 100% 247 in → 351 out (332 reasoning)
git worktree list
moonshotai/kimi-k3:medium__json_schema PASS 100% 252 in → 62 out (43 reasoning)
git worktree list
moonshotai/kimi-k3:xhigh PASS 100% 254 in → 50 out (31 reasoning)
git worktree list
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 248 in → 70 out (51 reasoning)
git worktree list
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 246 in → 116 out (116 reasoning)
git worktree list
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 247 in → 97 out (91 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 250 in → 48 out (45 reasoning)
git worktree list
nvidia/nemotron-3-nano-30b-a3b:low__json_schema PASS 100% 250 in → 158 out (153 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 243 in → 86 out (94 reasoning)
git worktree list
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 247 in → 939 out (1,119 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list" }
nvidia/nemotron-3-nano-30b-a3b:none PASS 100% 248 in → 5 out (0 reasoning)
git worktree list
nvidia/nemotron-3-nano-30b-a3b:none__json_schema PASS 100% 245 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 249 in → 61 out (58 reasoning)
git worktree list
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 241 in → 104 out (106 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 243 in → 52 out (43 reasoning)
git worktree list
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 250 in → 63 out (47 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 243 in → 120 out (111 reasoning)
git worktree list
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 247 in → 78 out (63 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 243 in → 86 out (96 reasoning)
git worktree list
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 249 in → 95 out (79 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 248 in → 5 out (0 reasoning)
git worktree list
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 250 in → 13 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 249 in → 61 out (62 reasoning)
git worktree list
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 246 in → 59 out (44 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
openai/gpt-5.4-mini:high PASS 100% 187 in → 59 out (49 reasoning)
git worktree list
openai/gpt-5.4-mini:high__json_schema PASS 100% 220 in → 85 out (67 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-mini:low PASS 100% 184 in → 32 out (22 reasoning)
git worktree list
openai/gpt-5.4-mini:low__json_schema PASS 100% 216 in → 64 out (46 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-mini:medium PASS 100% 173 in → 62 out (52 reasoning)
git worktree list
openai/gpt-5.4-mini:medium__json_schema PASS 100% 219 in → 86 out (68 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-mini:none PASS 100% 178 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.4-mini:none__json_schema PASS 100% 212 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-mini:xhigh PASS 100% 181 in → 101 out (91 reasoning)
git worktree list
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 217 in → 142 out (124 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-nano:high PASS 100% 175 in → 11 out (0 reasoning)
git worktree list --porcelain
openai/gpt-5.4-nano:high__json_schema PASS 100% 213 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-nano:low PASS 100% 177 in → 11 out (0 reasoning)
git worktree list --porcelain
openai/gpt-5.4-nano:low__json_schema PASS 100% 218 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-nano:medium PASS 100% 184 in → 11 out (0 reasoning)
git worktree list --porcelain
openai/gpt-5.4-nano:medium__json_schema PASS 100% 213 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-nano:none PASS 100% 176 in → 11 out (0 reasoning)
git worktree list --porcelain
openai/gpt-5.4-nano:none__json_schema PASS 100% 221 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4-nano:xhigh PASS 100% 175 in → 243 out (230 reasoning)
git worktree list --porcelain
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 220 in → 52 out (34 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4:high PASS 100% 193 in → 101 out (91 reasoning)
git worktree list
openai/gpt-5.4:high__json_schema PASS 100% 210 in → 438 out (417 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command":"git worktree list --porcelain"}
openai/gpt-5.4:low PASS 100% 179 in → 27 out (17 reasoning)
git worktree list
openai/gpt-5.4:low__json_schema PASS 100% 213 in → 48 out (30 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4:medium PASS 100% 176 in → 77 out (67 reasoning)
git worktree list
openai/gpt-5.4:medium__json_schema PASS 100% 216 in → 76 out (58 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4:none PASS 100% 179 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.4:none__json_schema PASS 100% 217 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.4:xhigh PASS 100% 183 in → 128 out (118 reasoning)
git worktree list
openai/gpt-5.4:xhigh__json_schema PASS 100% 212 in → 2,587 out (2,566 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command":"git worktree list --porcelain"}
openai/gpt-5.5:high PASS 100% 180 in → 114 out (101 reasoning)
git worktree list --porcelain
openai/gpt-5.5:high__json_schema PASS 100% 222 in → 19 out (0 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command":"git worktree list --porcelain"}
openai/gpt-5.5:low PASS 100% 175 in → 54 out (44 reasoning)
git worktree list
openai/gpt-5.5:low__json_schema PASS 100% 211 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.5:medium PASS 100% 175 in → 60 out (50 reasoning)
git worktree list
openai/gpt-5.5:medium__json_schema PASS 100% 219 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.5:none PASS 100% 180 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.5:none__json_schema PASS 100% 216 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.5:xhigh PASS 100% 180 in → 170 out (157 reasoning)
git worktree list --porcelain
openai/gpt-5.5:xhigh__json_schema PASS 100% 213 in → 537 out (516 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) {"command":"git worktree list --porcelain"}
openai/gpt-5.6-luna:high PASS 100% 173 in → 33 out (23 reasoning)
git worktree list
openai/gpt-5.6-luna:high__json_schema PASS 100% 213 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-luna:low PASS 100% 183 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.6-luna:low__json_schema PASS 100% 219 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-luna:max PASS 100% 180 in → 40 out (30 reasoning)
git worktree list
openai/gpt-5.6-luna:max__json_schema PASS 100% 215 in → 49 out (31 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-luna:medium PASS 100% 175 in → 25 out (15 reasoning)
git worktree list
openai/gpt-5.6-luna:medium__json_schema PASS 100% 209 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-luna:none PASS 100% 178 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.6-luna:none__json_schema PASS 100% 220 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-luna:xhigh PASS 100% 173 in → 36 out (26 reasoning)
git worktree list
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 211 in → 91 out (73 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-sol:high PASS 100% 178 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.6-sol:high__json_schema PASS 100% 217 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-sol:low PASS 100% 186 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.6-sol:low__json_schema PASS 100% 216 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-sol:max PASS 100% 174 in → 103 out (90 reasoning)
git worktree list --porcelain
openai/gpt-5.6-sol:max__json_schema PASS 100% 218 in → 134 out (116 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-sol:medium PASS 100% 179 in → 11 out (0 reasoning)
git worktree list --porcelain
openai/gpt-5.6-sol:medium__json_schema PASS 100% 215 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-sol:none PASS 100% 181 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.6-sol:none__json_schema PASS 100% 221 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-sol:xhigh PASS 100% 176 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 212 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-terra:high PASS 100% 178 in → 24 out (14 reasoning)
git worktree list
openai/gpt-5.6-terra:high__json_schema PASS 100% 214 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-terra:low PASS 100% 182 in → 44 out (34 reasoning)
git worktree list
openai/gpt-5.6-terra:low__json_schema PASS 100% 215 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-terra:max PASS 100% 179 in → 68 out (58 reasoning)
git worktree list
openai/gpt-5.6-terra:max__json_schema PASS 100% 215 in → 76 out (58 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-terra:medium PASS 100% 180 in → 26 out (16 reasoning)
git worktree list
openai/gpt-5.6-terra:medium__json_schema PASS 100% 216 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-terra:none PASS 100% 178 in → 8 out (0 reasoning)
git worktree list
openai/gpt-5.6-terra:none__json_schema PASS 100% 215 in → 16 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-5.6-terra:xhigh PASS 100% 176 in → 62 out (49 reasoning)
git worktree list --porcelain
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 217 in → 132 out (114 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-oss-120b:high PASS 100% 240 in → 123 out (128 reasoning)
git worktree list
openai/gpt-oss-120b:high__json_schema PASS 100% 239 in → 176 out (190 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-oss-120b:low PASS 100% 248 in → 35 out (0 reasoning)
git worktree list
openai/gpt-oss-120b:low__json_schema PASS 100% 240 in → 43 out (26 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-oss-120b:medium PASS 100% 231 in → 71 out (67 reasoning)
git worktree list
openai/gpt-oss-120b:medium__json_schema PASS 100% 306 in → 162 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-oss-120b:xhigh PASS 100% 244 in → 109 out (119 reasoning)
git worktree list
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 241 in → 164 out (172 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-oss-20b:high PASS 100% 238 in → 257 out (285 reasoning)
git worktree list
openai/gpt-oss-20b:high__json_schema PASS 100% 248 in → 112 out (115 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command":"git worktree list"}
openai/gpt-oss-20b:low PASS 100% 228 in → 26 out (13 reasoning)
git worktree list
openai/gpt-oss-20b:low__json_schema PASS 100% 239 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-oss-20b:medium PASS 100% 249 in → 137 out (126 reasoning)
git worktree list
openai/gpt-oss-20b:medium__json_schema PASS 100% 238 in → 44 out (33 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
openai/gpt-oss-20b:xhigh PASS 100% 243 in → 181 out (169 reasoning)
git worktree list
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 236 in → 141 out (136 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
poolside/laguna-m.1:high PASS 100% 223 in → 124 out (117 reasoning)
git worktree list
poolside/laguna-m.1:high__json_schema PASS 100% 223 in → 257 out (242 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
poolside/laguna-m.1:low PASS 100% 226 in → 133 out (126 reasoning)
git worktree list
poolside/laguna-m.1:low__json_schema PASS 100% 226 in → 104 out (88 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
poolside/laguna-m.1:medium PASS 100% 217 in → 123 out (116 reasoning)
git worktree list
poolside/laguna-m.1:medium__json_schema PASS 100% 223 in → 320 out (305 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
poolside/laguna-m.1:none PASS 100% 222 in → 6 out (0 reasoning)
git worktree list
poolside/laguna-m.1:none__json_schema PASS 100% 224 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
poolside/laguna-m.1:xhigh PASS 100% 228 in → 214 out (207 reasoning)
git worktree list
poolside/laguna-m.1:xhigh__json_schema PASS 100% 224 in → 149 out (134 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
poolside/laguna-xs-2.1:high PASS 100% 229 in → 256 out (251 reasoning)
git worktree list
poolside/laguna-xs-2.1:low PASS 100% 221 in → 148 out (143 reasoning)
git worktree list
poolside/laguna-xs-2.1:low__json_schema PASS 100% 228 in → 153 out (142 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
poolside/laguna-xs-2.1:medium PASS 100% 227 in → 161 out (156 reasoning)
git worktree list
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 219 in → 241 out (230 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
poolside/laguna-xs-2.1:none__json_schema PASS 100% 225 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
poolside/laguna-xs-2.1:xhigh PASS 100% 221 in → 273 out (268 reasoning)
git worktree list
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 221 in → 183 out (172 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
poolside/laguna-xs.2:high PASS 100% 257 in → 89 out (82 reasoning)
git worktree list
poolside/laguna-xs.2:high__json_schema PASS 100% 258 in → 174 out (163 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
poolside/laguna-xs.2:low PASS 100% 258 in → 59 out (52 reasoning)
git worktree list
poolside/laguna-xs.2:low__json_schema PASS 100% 263 in → 56 out (45 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
poolside/laguna-xs.2:medium PASS 100% 261 in → 65 out (58 reasoning)
git worktree list
poolside/laguna-xs.2:medium__json_schema PASS 100% 256 in → 49 out (33 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
poolside/laguna-xs.2:none PASS 100% 266 in → 6 out (0 reasoning)
git worktree list
poolside/laguna-xs.2:none__json_schema PASS 100% 266 in → 15 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
poolside/laguna-xs.2:xhigh PASS 100% 260 in → 108 out (101 reasoning)
git worktree list
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 250 in → 249 out (238 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
qwen/qwen3.6-27b:high PASS 100% 233 in → 573 out (584 reasoning)
git worktree list
qwen/qwen3.6-27b:low PASS 100% 231 in → 267 out (265 reasoning)
git worktree list
qwen/qwen3.6-27b:low__json_schema PASS 100% 234 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
qwen/qwen3.6-27b:medium PASS 100% 238 in → 975 out (966 reasoning)
git worktree list
qwen/qwen3.6-27b:none PASS 100% 227 in → 5 out (0 reasoning)
git worktree list
qwen/qwen3.6-27b:none__json_schema PASS 100% 231 in → 15 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
qwen/qwen3.6-27b:xhigh PASS 100% 232 in → 465 out (478 reasoning)
git worktree list
qwen/qwen3.6-35b-a3b:high PASS 100% 226 in → 313 out (304 reasoning)
git worktree list
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 233 in → 274 out (279 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
qwen/qwen3.6-35b-a3b:low PASS 100% 231 in → 690 out (705 reasoning)
git worktree list
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 229 in → 794 out (776 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 224 in → 261 out (252 reasoning)
git worktree list
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 228 in → 208 out (199 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
qwen/qwen3.6-35b-a3b:none PASS 100% 229 in → 5 out (0 reasoning)
git worktree list
qwen/qwen3.6-35b-a3b:none__json_schema PASS 100% 227 in → 15 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 226 in → 1,458 out (1,433 reasoning)
git worktree list
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 230 in → 796 out (701 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
qwen/qwen3.6-flash:high PASS 100% 230 in → 630 out (621 reasoning)
git worktree list
qwen/qwen3.6-flash:low PASS 100% 231 in → 444 out (435 reasoning)
git worktree list
qwen/qwen3.6-flash:medium PASS 100% 229 in → 312 out (303 reasoning)
git worktree list
qwen/qwen3.6-flash:none PASS 100% 235 in → 4 out (0 reasoning)
git worktree list
qwen/qwen3.6-flash:xhigh PASS 100% 232 in → 658 out (649 reasoning)
git worktree list
qwen/qwen3.7-flash:high PASS 100% 235 in → 226 out (217 reasoning)
git worktree list
qwen/qwen3.7-flash:low PASS 100% 229 in → 935 out (926 reasoning)
git worktree list
qwen/qwen3.7-flash:max PASS 100% 227 in → 300 out (291 reasoning)
git worktree list
qwen/qwen3.7-flash:medium PASS 100% 235 in → 575 out (566 reasoning)
git worktree list
qwen/qwen3.7-flash:none PASS 100% 232 in → 4 out (0 reasoning)
git worktree list
qwen/qwen3.7-flash:xhigh PASS 100% 233 in → 524 out (515 reasoning)
git worktree list
qwen/qwen3.7-max:high PASS 100% 227 in → 104 out (95 reasoning)
git worktree list
qwen/qwen3.7-max:low PASS 100% 231 in → 45 out (36 reasoning)
git worktree list
qwen/qwen3.7-max:medium PASS 100% 229 in → 411 out (402 reasoning)
git worktree list
qwen/qwen3.7-max:none PASS 100% 226 in → 4 out (0 reasoning)
git worktree list
qwen/qwen3.7-max:xhigh PASS 100% 234 in → 59 out (50 reasoning)
git worktree list
qwen/qwen3.7-plus:high PASS 100% 236 in → 182 out (173 reasoning)
git worktree list
qwen/qwen3.7-plus:low PASS 100% 229 in → 477 out (468 reasoning)
git worktree list
qwen/qwen3.7-plus:medium PASS 100% 230 in → 379 out (370 reasoning)
git worktree list
qwen/qwen3.7-plus:none PASS 100% 226 in → 4 out (0 reasoning)
git worktree list
qwen/qwen3.7-plus:xhigh PASS 100% 237 in → 194 out (185 reasoning)
git worktree list
tencent/hy3:high PASS 100% 194 in → 290 out (284 reasoning)
git worktree list
tencent/hy3:high__json_schema PASS 100% 196 in → 82 out (73 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
tencent/hy3:low PASS 100% 191 in → 674 out (668 reasoning)
git worktree list
tencent/hy3:low__json_schema PASS 100% 190 in → 724 out (743 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
tencent/hy3:medium PASS 100% 187 in → 949 out (943 reasoning)
git worktree list
tencent/hy3:medium__json_schema PASS 100% 194 in → 285 out (290 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
tencent/hy3:none PASS 100% 198 in → 5 out (0 reasoning)
git worktree list
tencent/hy3:none__json_schema PASS 100% 195 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
tencent/hy3:xhigh PASS 100% 194 in → 264 out (258 reasoning)
git worktree list
tencent/hy3:xhigh__json_schema PASS 100% 188 in → 71 out (64 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
thinkingmachines/inkling-small:high PASS 100% 182 in → 99 out (89 reasoning)
git worktree list
thinkingmachines/inkling-small:high__json_schema PASS 100% 188 in → 55 out (39 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
thinkingmachines/inkling-small:low PASS 100% 194 in → 26 out (16 reasoning)
git worktree list
thinkingmachines/inkling-small:low__json_schema PASS 100% 190 in → 32 out (15 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
thinkingmachines/inkling-small:max PASS 100% 190 in → 43 out (38 reasoning)
git worktree list
thinkingmachines/inkling-small:max__json_schema PASS 100% 190 in → 84 out (70 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
thinkingmachines/inkling-small:medium PASS 100% 187 in → 43 out (33 reasoning)
git worktree list
thinkingmachines/inkling-small:medium__json_schema PASS 100% 185 in → 21 out (7 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
thinkingmachines/inkling-small:xhigh PASS 100% 188 in → 131 out (121 reasoning)
git worktree list
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 192 in → 106 out (90 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
thinkingmachines/inkling:high PASS 100% 191 in → 70 out (68 reasoning)
git worktree list
thinkingmachines/inkling:high__json_schema PASS 100% 183 in → 62 out (46 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
thinkingmachines/inkling:low PASS 100% 185 in → 27 out (19 reasoning)
git worktree list
thinkingmachines/inkling:max PASS 100% 185 in → 58 out (47 reasoning)
git worktree list
thinkingmachines/inkling:medium PASS 100% 188 in → 45 out (35 reasoning)
git worktree list
thinkingmachines/inkling:medium__json_schema PASS 100% 193 in → 46 out (32 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
thinkingmachines/inkling:none PASS 100% 188 in → 7 out (0 reasoning)
git worktree list
thinkingmachines/inkling:none__json_schema PASS 100% 181 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
thinkingmachines/inkling:xhigh PASS 100% 191 in → 216 out (241 reasoning)
git worktree list
thinkingmachines/inkling:xhigh__json_schema PASS 100% 187 in → 208 out (192 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
x-ai/grok-4.3:high PASS 100% 346 in → 79 out (75 reasoning)
git worktree list
x-ai/grok-4.3:high__json_schema PASS 100% 401 in → 179 out (171 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.3:low PASS 100% 347 in → 88 out (84 reasoning)
git worktree list
x-ai/grok-4.3:low__json_schema PASS 100% 414 in → 201 out (193 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.3:max PASS 100% 349 in → 98 out (94 reasoning)
git worktree list
x-ai/grok-4.3:max__json_schema PASS 100% 403 in → 327 out (319 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.3:medium PASS 100% 348 in → 76 out (72 reasoning)
git worktree list
x-ai/grok-4.3:medium__json_schema PASS 100% 412 in → 246 out (238 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.3:none PASS 100% 345 in → 4 out (0 reasoning)
git worktree list
x-ai/grok-4.3:none__json_schema PASS 100% 399 in → 8 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.3:xhigh PASS 100% 349 in → 87 out (83 reasoning)
git worktree list
x-ai/grok-4.3:xhigh__json_schema PASS 100% 407 in → 217 out (209 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.5:high PASS 100% 391 in → 147 out (143 reasoning)
git worktree list
x-ai/grok-4.5:high__json_schema PASS 100% 458 in → 198 out (189 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
x-ai/grok-4.5:low PASS 100% 403 in → 86 out (82 reasoning)
git worktree list
x-ai/grok-4.5:low__json_schema PASS 100% 458 in → 99 out (90 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.5:max PASS 100% 390 in → 91 out (87 reasoning)
git worktree list
x-ai/grok-4.5:max__json_schema PASS 100% 458 in → 224 out (215 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.5:medium PASS 100% 391 in → 436 out (430 reasoning)
git worktree list --porcelain
x-ai/grok-4.5:medium__json_schema PASS 100% 457 in → 202 out (193 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command":"git worktree list"}
x-ai/grok-4.5:xhigh PASS 100% 391 in → 304 out (300 reasoning)
git worktree list
x-ai/grok-4.5:xhigh__json_schema PASS 100% 456 in → 267 out (258 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
z-ai/glm-4.7-flash:high PASS 100% 194 in → 1,056 out (1,156 reasoning)
git worktree list
z-ai/glm-4.7-flash:low PASS 100% 195 in → 360 out (374 reasoning)
git worktree list
z-ai/glm-4.7-flash:low__json_schema PASS 100% 199 in → 425 out (447 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
z-ai/glm-4.7-flash:medium PASS 100% 189 in → 269 out (267 reasoning)
git worktree list
z-ai/glm-4.7-flash:medium__json_schema PASS 100% 197 in → 273 out (268 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
z-ai/glm-4.7-flash:none PASS 100% 190 in → 4 out (0 reasoning)
git worktree list
z-ai/glm-4.7-flash:none__json_schema PASS 100% 194 in → 10 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) {"command": "git worktree list"}
z-ai/glm-4.7-flash:xhigh PASS 100% 191 in → 178 out (192 reasoning)
git worktree list
z-ai/glm-5.2:high PASS 100% 199 in → 166 out (160 reasoning)
git worktree list
z-ai/glm-5.2:high__json_schema PASS 100% 193 in → 56 out (43 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
z-ai/glm-5.2:low PASS 100% 205 in → 165 out (161 reasoning)
git worktree list
z-ai/glm-5.2:low__json_schema PASS 100% 381 in → 104 out (90 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
z-ai/glm-5.2:medium PASS 100% 200 in → 173 out (167 reasoning)
git worktree list
z-ai/glm-5.2:medium__json_schema PASS 100% 193 in → 345 out (354 reasoning)
git worktree list --porcelain
JSON Schema Structured Output
(raw) { "command": "git worktree list --porcelain" }
z-ai/glm-5.2:none PASS 100% 190 in → 5 out (0 reasoning)
git worktree list
z-ai/glm-5.2:none__json_schema PASS 100% 200 in → 12 out (0 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
z-ai/glm-5.2:xhigh PASS 100% 195 in → 161 out (155 reasoning)
git worktree list
z-ai/glm-5.2:xhigh__json_schema PASS 100% 204 in → 166 out (161 reasoning)
git worktree list
JSON Schema Structured Output
(raw) { "command": "git worktree list" }
anthropic/claude-opus-4.7:max FAIL 0% 252 in → 11 out (0 reasoning)
`git worktree list`
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
anthropic/claude-sonnet-4.6:high FAIL 0% 215 in → 10 out (0 reasoning)
`git worktree list`
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
anthropic/claude-sonnet-4.6:low FAIL 0% 204 in → 10 out (0 reasoning)
`git worktree list`
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
anthropic/claude-sonnet-4.6:max FAIL 0% 206 in → 43 out (19 reasoning)
`git worktree list`
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
anthropic/claude-sonnet-4.6:medium FAIL 0% 213 in → 10 out (0 reasoning)
`git worktree list`
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
anthropic/claude-sonnet-4.6:none FAIL 0% 222 in → 10 out (0 reasoning)
`git worktree list`
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
anthropic/claude-sonnet-4.6:xhigh FAIL 0% 212 in → 10 out (0 reasoning)
`git worktree list`
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
arcee-ai/trinity-mini:xhigh__json_schema FAIL 0% 172 in → 275 out (320 reasoning)
git worktreelist
JSON Schema Structured Output
(raw) { "command": "git worktreelist" }
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
Invalid JSON. Output: gitworktree list
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree list
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
liquid/lfm-2-24b-a2b FAIL 0% 204 in → 6 out
git worktree -l
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
Invalid JSON. Output: git worktree -l
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree list
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
poolside/laguna-xs-2.1:high__json_schema FAIL 0% 225 in → 364 out (351 reasoning)
git worktree list --long
JSON Schema Structured Output
(raw) {"command": "git worktree list --long"}
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
poolside/laguna-xs-2.1:none FAIL 0% 222 in → 10 out (0 reasoning)
git worktree list </think>git worktree list
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
Invalid JSON. Output: git worktree list
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8620c4c8-9f07-91f5-9ecf-07b6d3759145","request_id":"8620c4c8-9f07-91f5-9ecf-07b6d3759145"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8c1cd0db-b480-9baf-9b06-26839d037c30","request_id":"8c1cd0db-b480-9baf-9b06-26839d037c30"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f0065295-0763-97b1-9e07-bdcc6b50cbea","request_id":"f0065295-0763-97b1-9e07-bdcc6b50cbea"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-960ff5b1-5cd0-9a86-9f49-77e2fb700f5c","request_id":"960ff5b1-5cd0-9a86-9f49-77e2fb700f5c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a83c2569-cd58-9a95-801a-c124987d9508","request_id":"a83c2569-cd58-9a95-801a-c124987d9508"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-462a97fc-8ed2-92db-8a13-5e00f8e90910"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-74773d0c-100a-9931-9a88-d26ca6fa52e9"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-b26a014a-25f0-9d2a-b8d9-8bd65ae4aae1"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-0e9c27b1-bfa4-9a7e-8c2b-937bf4e892ba"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-10c21207-92dd-9145-9256-23e3f97eac2c"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-08368b22-9df0-95fd-a2b4-b8bdc74ac51a"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-68ab99b2-9746-9ddc-b5c1-18a91f35f0c9","request_id":"68ab99b2-9746-9ddc-b5c1-18a91f35f0c9"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-b78db79f-b776-9a34-8f16-65caaea23078","request_id":"b78db79f-b776-9a34-8f16-65caaea23078"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8404f491-1094-9aec-8db0-dbc0a2d2ed03","request_id":"8404f491-1094-9aec-8db0-dbc0a2d2ed03"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-625f489a-b9c0-9b26-b77a-96b9810bc263","request_id":"625f489a-b9c0-9b26-b77a-96b9810bc263"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-58a98308-b5e4-9c19-99e4-0c0cb018225b","request_id":"58a98308-b5e4-9c19-99e4-0c0cb018225b"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f17e0205-4753-9d18-9be0-1a367d2609fc","request_id":"f17e0205-4753-9d18-9be0-1a367d2609fc"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d51621b5-e5f4-9ffd-83a4-01c883f2d6e1","request_id":"d51621b5-e5f4-9ffd-83a4-01c883f2d6e1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a58fbe3d-310f-95e7-9371-680c7c4b9f2a","request_id":"a58fbe3d-310f-95e7-9371-680c7c4b9f2a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-333d010d-30a1-9516-8f7c-c51bf8f1ac87","request_id":"333d010d-30a1-9516-8f7c-c51bf8f1ac87"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-64ca28eb-94ce-9038-957f-ee3fcf7e174b","request_id":"64ca28eb-94ce-9038-957f-ee3fcf7e174b"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
thinkingmachines/inkling-small:none FAIL 0% 188 in → 7 out (0 reasoning)
git worktree list<|end_message|>
Failure: Command did not match accepted alternatives: ['git worktree list', 'git worktree list --porcelain']
Invalid JSON. Output: git worktree list{ "command": "git worktree list" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree list
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree list
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)