Delete worktree after use
Tests ability to delete a worktree after use. Evaluates worktree-cleanup lifecycle.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo 'Hello' > hello.txt
  5. 05 git add hello.txt
  6. 06 git commit -m 'Initial commit'
  7. 07 git checkout -b feature
  8. 08 echo 'Feature' > feature.txt
  9. 09 git add feature.txt
  10. 10 git commit -m 'Add feature'
  11. 11 git checkout main
  12. 12 git worktree add ../feature-wt feature
Prompt
Delete the worktree at '../feature-wt'. Output ONLY the git command to run, nothing else.
Expected
git worktree remove ../feature-wt

Scoped model quality, cost, API time, and token usage for worktree_usage/f003.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 256 in → 15 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-fable-5:high__json_schema PASS 100% 462 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-fable-5:low PASS 100% 246 in → 15 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-fable-5:low__json_schema PASS 100% 467 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-fable-5:max PASS 100% 245 in → 63 out (24 reasoning)
git worktree remove ../feature-wt
anthropic/claude-fable-5:max__json_schema PASS 100% 459 in → 91 out (39 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-fable-5:medium PASS 100% 263 in → 15 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-fable-5:medium__json_schema PASS 100% 463 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-fable-5:xhigh PASS 100% 260 in → 19 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 471 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-haiku-4.5:high PASS 100% 239 in → 128 out (100 reasoning)
git worktree remove ../feature-wt
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 402 in → 137 out (109 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-haiku-4.5:low PASS 100% 242 in → 135 out (109 reasoning)
git worktree remove ../feature-wt
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 399 in → 264 out (212 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-haiku-4.5:medium PASS 100% 242 in → 126 out (100 reasoning)
git worktree remove ../feature-wt
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 404 in → 325 out (233 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-haiku-4.5:none PASS 100% 214 in → 17 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 376 in → 18 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 236 in → 291 out (202 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 400 in → 264 out (200 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-opus-4.6:high PASS 100% 215 in → 17 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 381 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.6:low PASS 100% 217 in → 17 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 381 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.6:max PASS 100% 214 in → 18 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 376 in → 66 out (30 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.6:medium PASS 100% 220 in → 17 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 369 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.6:none PASS 100% 208 in → 17 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 378 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.6:xhigh PASS 100% 222 in → 17 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 375 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.7:high PASS 100% 253 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-opus-4.7:high__json_schema PASS 100% 470 in → 24 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.7:low PASS 100% 257 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-opus-4.7:low__json_schema PASS 100% 470 in → 24 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.7:max PASS 100% 260 in → 22 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 473 in → 24 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.7:medium PASS 100% 260 in → 19 out (0 reasoning)
`git worktree remove ../feature-wt`
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 461 in → 24 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.7:none PASS 100% 258 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-opus-4.7:none__json_schema PASS 100% 482 in → 24 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.7:xhigh PASS 100% 253 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 471 in → 24 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.8:high PASS 100% 259 in → 19 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.8:high__json_schema PASS 100% 468 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.8:low PASS 100% 262 in → 15 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-opus-4.8:low__json_schema PASS 100% 459 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.8:max PASS 100% 257 in → 72 out (21 reasoning)
`git worktree remove ../feature-wt`
anthropic/claude-opus-4.8:max__json_schema PASS 100% 465 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.8:medium PASS 100% 253 in → 19 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 461 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-opus-4.8:none PASS 100% 256 in → 19 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 462 in → 21 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-opus-4.8:xhigh PASS 100% 262 in → 19 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 464 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-sonnet-4.6:high PASS 100% 221 in → 15 out (0 reasoning)
`git worktree remove ../feature-wt`
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 380 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-sonnet-4.6:low PASS 100% 216 in → 15 out (0 reasoning)
`git worktree remove ../feature-wt`
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 375 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-sonnet-4.6:max PASS 100% 218 in → 150 out (87 reasoning)
git worktree remove ../feature-wt
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 381 in → 98 out (59 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-sonnet-4.6:medium PASS 100% 215 in → 15 out (0 reasoning)
`git worktree remove ../feature-wt`
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 376 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-sonnet-4.6:none PASS 100% 210 in → 15 out (0 reasoning)
`git worktree remove ../feature-wt`
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 374 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 216 in → 15 out (0 reasoning)
`git worktree remove ../feature-wt`
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 376 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
anthropic/claude-sonnet-5:high PASS 100% 258 in → 19 out (0 reasoning)
``` git worktree remove ../feature-wt ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 466 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-sonnet-5:low PASS 100% 257 in → 15 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-sonnet-5:low__json_schema PASS 100% 460 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-sonnet-5:medium PASS 100% 255 in → 15 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 472 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-sonnet-5:none PASS 100% 263 in → 15 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-sonnet-5:none__json_schema PASS 100% 457 in → 21 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
anthropic/claude-sonnet-5:xhigh PASS 100% 249 in → 15 out (0 reasoning)
git worktree remove ../feature-wt
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 467 in → 22 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
arcee-ai/trinity-large-thinking:high PASS 100% 179 in → 3,068 out (3,146 reasoning)
git worktree remove /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f003_j25jt8_8/feature-wt
arcee-ai/trinity-large-thinking:low PASS 100% 181 in → 1,126 out (1,148 reasoning)
git worktree remove ../feature-wt
arcee-ai/trinity-large-thinking:medium PASS 100% 179 in → 2,211 out (2,271 reasoning)
git worktree remove '../feature-wt'
arcee-ai/trinity-large-thinking:xhigh PASS 100% 182 in → 1,903 out (1,961 reasoning)
git worktree remove ../feature-wt
arcee-ai/trinity-mini:high__json_schema PASS 100% 181 in → 332 out (349 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
arcee-ai/trinity-mini:medium PASS 100% 180 in → 321 out (311 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash-0731:high PASS 100% 274 in → 94 out (94 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 262 in → 137 out (128 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
deepseek/deepseek-v4-flash-0731:low PASS 100% 193 in → 77 out (94 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 195 in → 99 out (114 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
deepseek/deepseek-v4-flash-0731:max PASS 100% 272 in → 1,894 out (1,915 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 268 in → 154 out (150 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 188 in → 489 out (515 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 187 in → 333 out (336 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
deepseek/deepseek-v4-flash-0731:none PASS 100% 187 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 193 in → 13 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 270 in → 142 out (133 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 185 in → 143 out (130 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
deepseek/deepseek-v4-flash:high PASS 100% 187 in → 261 out (258 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash:high__json_schema PASS 100% 189 in → 87 out (69 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
deepseek/deepseek-v4-flash:low PASS 100% 190 in → 80 out (72 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash:medium PASS 100% 202 in → 236 out (226 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash:medium__json_schema PASS 100% 188 in → 184 out (181 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
deepseek/deepseek-v4-flash:none PASS 100% 189 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 191 in → 16 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
deepseek/deepseek-v4-flash:xhigh PASS 100% 263 in → 149 out (138 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 266 in → 244 out (244 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
deepseek/deepseek-v4-pro:high PASS 100% 192 in → 295 out (285 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 369 in → 245 out (230 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
deepseek/deepseek-v4-pro:low PASS 100% 179 in → 131 out (122 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 181 in → 14 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
deepseek/deepseek-v4-pro:medium PASS 100% 188 in → 357 out (343 reasoning)
```bash git worktree remove ../feature-wt ```
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 187 in → 163 out (145 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
deepseek/deepseek-v4-pro:none PASS 100% 188 in → 8 out (0 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 186 in → 16 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
deepseek/deepseek-v4-pro:xhigh PASS 100% 266 in → 588 out (578 reasoning)
git worktree remove ../feature-wt
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 183 in → 236 out (221 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3-flash-preview:high PASS 100% 236 in → 330 out (322 reasoning)
git worktree remove ../feature-wt
google/gemini-3-flash-preview:high__json_schema PASS 100% 294 in → 219 out (206 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3-flash-preview:low PASS 100% 235 in → 152 out (144 reasoning)
git worktree remove ../feature-wt
google/gemini-3-flash-preview:low__json_schema PASS 100% 292 in → 107 out (94 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3-flash-preview:medium PASS 100% 226 in → 189 out (181 reasoning)
git worktree remove ../feature-wt
google/gemini-3-flash-preview:medium__json_schema PASS 100% 290 in → 223 out (210 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3-flash-preview:xhigh PASS 100% 237 in → 174 out (166 reasoning)
git worktree remove ../feature-wt
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 292 in → 227 out (215 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 231 in → 194 out (186 reasoning)
git worktree remove ../feature-wt
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 237 in → 131 out (118 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.1-flash-lite-preview:low PASS 100% 231 in → 252 out (244 reasoning)
git worktree remove ../feature-wt
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 228 in → 117 out (104 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.1-flash-lite-preview:medium PASS 100% 241 in → 151 out (143 reasoning)
git worktree remove ../feature-wt
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 235 in → 164 out (151 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 236 in → 216 out (208 reasoning)
git worktree remove ../feature-wt
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 296 in → 140 out (127 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.1-pro-preview:high PASS 100% 232 in → 128 out (120 reasoning)
git worktree remove ../feature-wt
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 295 in → 247 out (234 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.1-pro-preview:low PASS 100% 241 in → 156 out (148 reasoning)
git worktree remove ../feature-wt
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 298 in → 71 out (53 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
google/gemini-3.1-pro-preview:medium PASS 100% 237 in → 194 out (186 reasoning)
git worktree remove ../feature-wt
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 293 in → 72 out (59 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 230 in → 269 out (261 reasoning)
git worktree remove ../feature-wt
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 290 in → 236 out (224 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemini-3.5-flash-lite:high PASS 100% 232 in → 254 out (246 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 291 in → 261 out (248 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.5-flash-lite:low PASS 100% 237 in → 8 out (0 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 233 in → 13 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.5-flash-lite:max PASS 100% 235 in → 237 out (229 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 240 in → 254 out (236 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
google/gemini-3.5-flash-lite:medium PASS 100% 236 in → 320 out (312 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 235 in → 246 out (233 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 237 in → 361 out (353 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 234 in → 416 out (403 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.5-flash:high PASS 100% 238 in → 382 out (374 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash:high__json_schema PASS 100% 291 in → 108 out (95 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.5-flash:low PASS 100% 236 in → 155 out (147 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash:low__json_schema PASS 100% 296 in → 44 out (31 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.5-flash:medium PASS 100% 230 in → 247 out (239 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash:medium__json_schema PASS 100% 291 in → 105 out (92 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemini-3.5-flash:xhigh PASS 100% 234 in → 330 out (322 reasoning)
git worktree remove ../feature-wt
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 237 in → 357 out (339 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
google/gemini-3.6-flash:high PASS 100% 232 in → 202 out (194 reasoning)
git worktree remove ../feature-wt
google/gemini-3.6-flash:high__json_schema PASS 100% 292 in → 230 out (218 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemini-3.6-flash:low PASS 100% 238 in → 49 out (41 reasoning)
git worktree remove ../feature-wt
google/gemini-3.6-flash:low__json_schema PASS 100% 292 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemini-3.6-flash:max PASS 100% 240 in → 254 out (246 reasoning)
git worktree remove ../feature-wt
google/gemini-3.6-flash:max__json_schema PASS 100% 230 in → 187 out (175 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemini-3.6-flash:medium PASS 100% 234 in → 182 out (174 reasoning)
git worktree remove ../feature-wt
google/gemini-3.6-flash:medium__json_schema PASS 100% 293 in → 88 out (76 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemini-3.6-flash:xhigh PASS 100% 235 in → 338 out (330 reasoning)
git worktree remove ../feature-wt
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 235 in → 146 out (134 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemma-4-26b-a4b-it:high PASS 100% 254 in → 173 out (140 reasoning)
git worktree remove ../feature-wt
google/gemma-4-26b-a4b-it:high__json_schema PASS 100% 255 in → 359 out (240 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
google/gemma-4-26b-a4b-it:low PASS 100% 248 in → 289 out (243 reasoning)
git worktree remove ../feature-wt
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 250 in → 410 out (345 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
google/gemma-4-26b-a4b-it:medium PASS 100% 251 in → 390 out (336 reasoning)
git worktree remove ../feature-wt
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 252 in → 1,148 out (851 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemma-4-26b-a4b-it:none PASS 100% 245 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
google/gemma-4-26b-a4b-it:none__json_schema PASS 100% 246 in → 19 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
google/gemma-4-26b-a4b-it:xhigh PASS 100% 253 in → 346 out (245 reasoning)
git worktree remove ../feature-wt
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 246 in → 582 out (410 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemma-4-31b-it:high PASS 100% 246 in → 134 out (117 reasoning)
git worktree remove ../feature-wt
google/gemma-4-31b-it:low PASS 100% 246 in → 149 out (130 reasoning)
git worktree remove ../feature-wt
google/gemma-4-31b-it:low__json_schema PASS 100% 250 in → 165 out (134 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
google/gemma-4-31b-it:medium PASS 100% 253 in → 156 out (124 reasoning)
git worktree remove ../feature-wt
google/gemma-4-31b-it:medium__json_schema PASS 100% 258 in → 290 out (276 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemma-4-31b-it:none PASS 100% 248 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
google/gemma-4-31b-it:none__json_schema PASS 100% 250 in → 14 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
google/gemma-4-31b-it:xhigh PASS 100% 252 in → 255 out (165 reasoning)
git worktree remove ../feature-wt
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 256 in → 90 out (69 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
ibm-granite/granite-4.1-8b__json_schema PASS 100% 201 in → 17 out
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
inclusionai/ling-2.6-flash PASS 100% 240 in → 14 out
```sh git worktree remove ../feature-wt ```
inclusionai/ling-2.6-flash__json_schema PASS 100% 237 in → 16 out
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
minimax/minimax-m2.5:high PASS 100% 206 in → 183 out (202 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m2.5:high__json_schema PASS 100% 206 in → 149 out (147 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
minimax/minimax-m2.5:low PASS 100% 207 in → 231 out (221 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m2.5:low__json_schema PASS 100% 212 in → 97 out (90 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
minimax/minimax-m2.5:medium__json_schema PASS 100% 210 in → 139 out (124 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
minimax/minimax-m2.5:xhigh PASS 100% 210 in → 148 out (157 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 207 in → 347 out (338 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
minimax/minimax-m2.7:high PASS 100% 213 in → 284 out (295 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m2.7:high__json_schema PASS 100% 214 in → 265 out (281 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
minimax/minimax-m2.7:low PASS 100% 216 in → 338 out (329 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m2.7:low__json_schema PASS 100% 336 in → 355 out (337 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
minimax/minimax-m2.7:medium PASS 100% 211 in → 381 out (370 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m2.7:medium__json_schema PASS 100% 347 in → 339 out (325 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
minimax/minimax-m2.7:xhigh PASS 100% 217 in → 196 out (187 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 345 in → 584 out (566 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
minimax/minimax-m3:high PASS 100% 350 in → 179 out (165 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m3:high__json_schema PASS 100% 297 in → 20 out (19 reasoning)
git worktree remove '../feature-wt' --force
JSON Schema Structured Output
(raw) { "command": "git worktree remove '../feature-wt' --force" }
minimax/minimax-m3:low PASS 100% 295 in → 61 out (51 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m3:low__json_schema PASS 100% 338 in → 15 out (0 reasoning)
git worktree remove '../feature-wt'
JSON Schema Structured Output
(raw) {"command": "git worktree remove '../feature-wt'"}
minimax/minimax-m3:medium PASS 100% 348 in → 45 out (38 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m3:medium__json_schema PASS 100% 334 in → 20 out (0 reasoning)
git worktree remove '../feature-wt' --force
JSON Schema Structured Output
(raw) { "command": "git worktree remove '../feature-wt' --force" }
minimax/minimax-m3:xhigh PASS 100% 352 in → 36 out (29 reasoning)
git worktree remove ../feature-wt
minimax/minimax-m3:xhigh__json_schema PASS 100% 337 in → 16 out (0 reasoning)
git worktree remove '../feature-wt'
JSON Schema Structured Output
(raw) { "command": "git worktree remove '../feature-wt'" }
mistralai/devstral-2512 PASS 100% 236 in → 14 out
```bash git worktree remove ../feature-wt ```
mistralai/devstral-2512__json_schema PASS 100% 233 in → 14 out
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
mistralai/mistral-medium-3-5:high PASS 100% 247 in → 485 out (493 reasoning)
git worktree remove ../feature-wt
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 230 in → 390 out (368 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
mistralai/mistral-medium-3-5:low PASS 100% 248 in → 470 out (498 reasoning)
git worktree remove ../feature-wt
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 233 in → 550 out (584 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
mistralai/mistral-medium-3-5:medium PASS 100% 248 in → 977 out (843 reasoning)
git worktree remove ../feature-wt
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 233 in → 768 out (772 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
mistralai/mistral-medium-3-5:none PASS 100% 250 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 235 in → 14 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 242 in → 507 out (536 reasoning)
git worktree remove ../feature-wt
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 230 in → 260 out (274 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
moonshotai/kimi-k2.6:high PASS 100% 183 in → 1,204 out (1,194 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k2.6:high__json_schema PASS 100% 173 in → 466 out (419 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt"}
moonshotai/kimi-k2.6:low PASS 100% 173 in → 275 out (299 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k2.6:low__json_schema PASS 100% 177 in → 581 out (562 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
moonshotai/kimi-k2.6:medium PASS 100% 179 in → 337 out (327 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 359 in → 795 out (781 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
moonshotai/kimi-k2.6:xhigh PASS 100% 180 in → 208 out (212 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k2.7-code:high PASS 100% 176 in → 95 out (85 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 181 in → 92 out (77 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
moonshotai/kimi-k2.7-code:low PASS 100% 172 in → 89 out (79 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 176 in → 153 out (135 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
moonshotai/kimi-k2.7-code:medium PASS 100% 174 in → 190 out (180 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 172 in → 147 out (130 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
moonshotai/kimi-k2.7-code:xhigh PASS 100% 178 in → 70 out (60 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 179 in → 139 out (136 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
moonshotai/kimi-k3:high PASS 100% 258 in → 117 out (94 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:high__json_schema PASS 100% 251 in → 156 out (133 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:low PASS 100% 254 in → 79 out (56 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:low__json_schema PASS 100% 253 in → 84 out (61 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:max PASS 100% 250 in → 113 out (90 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:max__json_schema PASS 100% 245 in → 86 out (63 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:medium PASS 100% 252 in → 148 out (125 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:medium__json_schema PASS 100% 249 in → 72 out (49 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:xhigh PASS 100% 250 in → 92 out (69 reasoning)
git worktree remove ../feature-wt
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 254 in → 141 out (118 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 249 in → 214 out (220 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 244 in → 175 out (169 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 249 in → 105 out (107 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-nano-30b-a3b:low__json_schema PASS 100% 243 in → 217 out (217 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 247 in → 190 out (207 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 253 in → 68 out (62 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
nvidia/nemotron-3-nano-30b-a3b:none PASS 100% 247 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-nano-30b-a3b:none__json_schema PASS 100% 255 in → 16 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 248 in → 215 out (208 reasoning)
git worktree remove '../feature-wt'
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 246 in → 145 out (139 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 248 in → 154 out (156 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 243 in → 92 out (73 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 244 in → 170 out (151 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 249 in → 167 out (149 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 246 in → 279 out (213 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 254 in → 134 out (113 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 245 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 241 in → 17 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 246 in → 277 out (228 reasoning)
git worktree remove ../feature-wt
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 245 in → 606 out (542 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
openai/gpt-5.4-mini:high PASS 100% 177 in → 152 out (138 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4-mini:high__json_schema PASS 100% 220 in → 206 out (184 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-mini:low PASS 100% 177 in → 70 out (56 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4-mini:low__json_schema PASS 100% 221 in → 91 out (69 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-mini:medium PASS 100% 179 in → 203 out (189 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4-mini:medium__json_schema PASS 100% 220 in → 127 out (105 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-mini:none PASS 100% 183 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4-mini:none__json_schema PASS 100% 220 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-mini:xhigh PASS 100% 180 in → 787 out (773 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 222 in → 538 out (516 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-nano:high PASS 100% 180 in → 96 out (82 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4-nano:high__json_schema PASS 100% 216 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-nano:low PASS 100% 186 in → 14 out (0 reasoning)
git worktree remove --force ../feature-wt
openai/gpt-5.4-nano:low__json_schema PASS 100% 213 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-nano:medium PASS 100% 181 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4-nano:medium__json_schema PASS 100% 216 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-nano:none PASS 100% 182 in → 14 out (0 reasoning)
git worktree remove ../feature-wt --force
openai/gpt-5.4-nano:none__json_schema PASS 100% 216 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4-nano:xhigh PASS 100% 183 in → 128 out (114 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 221 in → 623 out (601 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4:high PASS 100% 179 in → 115 out (101 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4:high__json_schema PASS 100% 213 in → 131 out (109 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4:low PASS 100% 175 in → 33 out (19 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4:low__json_schema PASS 100% 221 in → 55 out (33 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4:medium PASS 100% 191 in → 66 out (52 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4:medium__json_schema PASS 100% 213 in → 80 out (58 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4:none PASS 100% 185 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4:none__json_schema PASS 100% 215 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.4:xhigh PASS 100% 188 in → 183 out (169 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.4:xhigh__json_schema PASS 100% 216 in → 2,680 out (2,658 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.5:high PASS 100% 188 in → 103 out (89 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.5:high__json_schema PASS 100% 218 in → 134 out (112 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.5:low PASS 100% 176 in → 46 out (32 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.5:low__json_schema PASS 100% 218 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.5:medium PASS 100% 180 in → 50 out (36 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.5:medium__json_schema PASS 100% 216 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.5:none PASS 100% 180 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.5:none__json_schema PASS 100% 217 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.5:xhigh PASS 100% 184 in → 142 out (128 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.5:xhigh__json_schema PASS 100% 225 in → 322 out (300 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-luna:high PASS 100% 181 in → 123 out (109 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-luna:high__json_schema PASS 100% 222 in → 107 out (85 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-luna:low PASS 100% 178 in → 46 out (32 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-luna:low__json_schema PASS 100% 212 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-luna:max PASS 100% 179 in → 118 out (104 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-luna:max__json_schema PASS 100% 217 in → 119 out (97 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-luna:medium PASS 100% 176 in → 71 out (57 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-luna:medium__json_schema PASS 100% 215 in → 80 out (58 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-luna:none PASS 100% 173 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-luna:none__json_schema PASS 100% 214 in → 21 out (0 reasoning)
git worktree remove '../feature-wt'
JSON Schema Structured Output
(raw) {"command":"git worktree remove '../feature-wt'"}
openai/gpt-5.6-luna:xhigh PASS 100% 180 in → 106 out (92 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 217 in → 92 out (70 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-sol:high PASS 100% 190 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-sol:high__json_schema PASS 100% 217 in → 73 out (51 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-sol:low PASS 100% 184 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-sol:low__json_schema PASS 100% 216 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-sol:max PASS 100% 181 in → 56 out (42 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-sol:max__json_schema PASS 100% 216 in → 164 out (142 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-sol:medium PASS 100% 183 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-sol:medium__json_schema PASS 100% 220 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-sol:none PASS 100% 188 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-sol:none__json_schema PASS 100% 222 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-sol:xhigh PASS 100% 180 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 221 in → 131 out (109 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-terra:high PASS 100% 185 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-terra:high__json_schema PASS 100% 214 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-terra:low PASS 100% 180 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-terra:low__json_schema PASS 100% 217 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-terra:max PASS 100% 182 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-terra:max__json_schema PASS 100% 212 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-terra:medium PASS 100% 186 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-terra:medium__json_schema PASS 100% 220 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-terra:none PASS 100% 183 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-terra:none__json_schema PASS 100% 225 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-5.6-terra:xhigh PASS 100% 179 in → 66 out (52 reasoning)
git worktree remove ../feature-wt
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 218 in → 20 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-oss-120b:high PASS 100% 227 in → 190 out (182 reasoning)
git worktree remove ../feature-wt
openai/gpt-oss-120b:high__json_schema PASS 100% 242 in → 392 out (354 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-oss-120b:low PASS 100% 244 in → 30 out (12 reasoning)
git worktree remove ../feature-wt
openai/gpt-oss-120b:low__json_schema PASS 100% 237 in → 67 out (47 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-oss-120b:medium PASS 100% 248 in → 114 out (101 reasoning)
git worktree remove ../feature-wt
openai/gpt-oss-120b:medium__json_schema PASS 100% 237 in → 16 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
openai/gpt-oss-120b:xhigh PASS 100% 232 in → 253 out (266 reasoning)
git worktree remove ../feature-wt
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 251 in → 279 out (256 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-oss-20b:high PASS 100% 244 in → 590 out (623 reasoning)
git worktree remove ../feature-wt
openai/gpt-oss-20b:high__json_schema PASS 100% 244 in → 665 out (672 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
openai/gpt-oss-20b:low PASS 100% 244 in → 35 out (17 reasoning)
git worktree remove ../feature-wt
openai/gpt-oss-20b:low__json_schema PASS 100% 241 in → 14 out (0 reasoning)
git worktree remove --force ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove --force ../feature-wt"}
openai/gpt-oss-20b:medium PASS 100% 239 in → 139 out (122 reasoning)
git worktree remove ../feature-wt
openai/gpt-oss-20b:medium__json_schema PASS 100% 241 in → 106 out (85 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
openai/gpt-oss-20b:xhigh PASS 100% 235 in → 343 out (352 reasoning)
git worktree remove ../feature-wt
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 240 in → 590 out (582 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
poolside/laguna-m.1:high PASS 100% 226 in → 295 out (284 reasoning)
git worktree remove ../feature-wt
poolside/laguna-m.1:high__json_schema PASS 100% 224 in → 320 out (305 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-m.1:low PASS 100% 226 in → 403 out (392 reasoning)
git worktree remove ../feature-wt
poolside/laguna-m.1:low__json_schema PASS 100% 224 in → 294 out (279 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-m.1:medium PASS 100% 220 in → 290 out (279 reasoning)
git worktree remove ../feature-wt
poolside/laguna-m.1:medium__json_schema PASS 100% 222 in → 544 out (529 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-m.1:none PASS 100% 222 in → 10 out (0 reasoning)
git worktree remove ../feature-wt
poolside/laguna-m.1:none__json_schema PASS 100% 225 in → 14 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-m.1:xhigh PASS 100% 229 in → 532 out (521 reasoning)
git worktree remove ../feature-wt
poolside/laguna-m.1:xhigh__json_schema PASS 100% 219 in → 413 out (398 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-xs-2.1:high PASS 100% 226 in → 157 out (148 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs-2.1:high__json_schema PASS 100% 217 in → 407 out (392 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-xs-2.1:low PASS 100% 222 in → 205 out (196 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs-2.1:low__json_schema PASS 100% 216 in → 325 out (310 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-xs-2.1:medium PASS 100% 226 in → 269 out (260 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 228 in → 264 out (249 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-xs-2.1:none PASS 100% 226 in → 8 out (0 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs-2.1:none__json_schema PASS 100% 218 in → 19 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
poolside/laguna-xs-2.1:xhigh PASS 100% 219 in → 449 out (440 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 227 in → 233 out (218 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-xs.2:high PASS 100% 261 in → 126 out (115 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs.2:high__json_schema PASS 100% 264 in → 155 out (140 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-xs.2:low PASS 100% 265 in → 155 out (144 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs.2:low__json_schema PASS 100% 265 in → 178 out (163 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-xs.2:medium PASS 100% 266 in → 132 out (121 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs.2:medium__json_schema PASS 100% 262 in → 447 out (389 reasoning)
git worktree remove /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f003__a9gcyeo/feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f003__a9gcyeo/feature-wt"}
poolside/laguna-xs.2:none PASS 100% 261 in → 15 out (0 reasoning)
```bash git worktree remove ../feature-wt ```
poolside/laguna-xs.2:none__json_schema PASS 100% 266 in → 14 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
poolside/laguna-xs.2:xhigh PASS 100% 260 in → 106 out (95 reasoning)
git worktree remove ../feature-wt
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 265 in → 109 out (89 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-27b:high PASS 100% 235 in → 925 out (894 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-27b:high__json_schema PASS 100% 235 in → 19 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-27b:low PASS 100% 228 in → 347 out (343 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-27b:low__json_schema PASS 100% 231 in → 14 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
qwen/qwen3.6-27b:medium PASS 100% 232 in → 1,108 out (1,007 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-27b:medium__json_schema PASS 100% 233 in → 179 out (182 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-27b:none PASS 100% 232 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-27b:none__json_schema PASS 100% 229 in → 19 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-27b:xhigh PASS 100% 229 in → 430 out (412 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 237 in → 1,374 out (1,369 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-35b-a3b:high PASS 100% 231 in → 1,133 out (1,101 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 228 in → 900 out (896 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-35b-a3b:low PASS 100% 229 in → 1,034 out (1,003 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 235 in → 1,019 out (966 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 235 in → 919 out (839 reasoning)
git worktree remove '../feature-wt'
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 230 in → 975 out (933 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-35b-a3b:none PASS 100% 232 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-35b-a3b:none__json_schema PASS 100% 231 in → 19 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 230 in → 895 out (867 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 226 in → 953 out (932 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
qwen/qwen3.6-flash:high PASS 100% 232 in → 272 out (259 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-flash:low PASS 100% 224 in → 581 out (568 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-flash:medium PASS 100% 228 in → 752 out (739 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-flash:none PASS 100% 234 in → 8 out (0 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.6-flash:xhigh PASS 100% 228 in → 573 out (560 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-flash:high PASS 100% 232 in → 925 out (912 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-flash:low PASS 100% 231 in → 827 out (814 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-flash:low__json_schema PASS 100% 230 in → 1,409 out (1,396 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-flash:max PASS 100% 232 in → 983 out (970 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-flash:medium PASS 100% 236 in → 1,218 out (1,204 reasoning)
git worktree remove '../feature-wt'
qwen/qwen3.7-flash:none PASS 100% 231 in → 8 out (0 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-flash:xhigh PASS 100% 232 in → 420 out (407 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-max:high PASS 100% 222 in → 204 out (191 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-max:low PASS 100% 234 in → 743 out (730 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-max:medium PASS 100% 228 in → 176 out (163 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-max:none PASS 100% 236 in → 8 out (0 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-max:xhigh PASS 100% 230 in → 659 out (646 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-plus:high PASS 100% 231 in → 200 out (187 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-plus:low PASS 100% 232 in → 200 out (187 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-plus:medium PASS 100% 235 in → 516 out (503 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-plus:none PASS 100% 229 in → 8 out (0 reasoning)
git worktree remove ../feature-wt
qwen/qwen3.7-plus:xhigh PASS 100% 235 in → 277 out (264 reasoning)
git worktree remove ../feature-wt
tencent/hy3:high PASS 100% 193 in → 1,449 out (1,439 reasoning)
git worktree remove ../feature-wt
tencent/hy3:high__json_schema PASS 100% 191 in → 538 out (542 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
tencent/hy3:low PASS 100% 194 in → 384 out (374 reasoning)
git worktree remove ../feature-wt
tencent/hy3:low__json_schema PASS 100% 197 in → 450 out (417 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
tencent/hy3:medium PASS 100% 195 in → 368 out (353 reasoning)
git worktree remove ../feature-wt
tencent/hy3:medium__json_schema PASS 100% 187 in → 354 out (338 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
tencent/hy3:none PASS 100% 192 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
tencent/hy3:none__json_schema PASS 100% 199 in → 16 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
tencent/hy3:xhigh PASS 100% 193 in → 709 out (699 reasoning)
git worktree remove ../feature-wt
tencent/hy3:xhigh__json_schema PASS 100% 194 in → 431 out (419 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
thinkingmachines/inkling-small:high PASS 100% 190 in → 118 out (110 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling-small:high__json_schema PASS 100% 194 in → 158 out (140 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
thinkingmachines/inkling-small:low PASS 100% 192 in → 56 out (43 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling-small:low__json_schema PASS 100% 192 in → 63 out (42 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
thinkingmachines/inkling-small:max PASS 100% 186 in → 93 out (84 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling-small:max__json_schema PASS 100% 188 in → 178 out (157 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
thinkingmachines/inkling-small:medium PASS 100% 184 in → 145 out (138 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling-small:medium__json_schema PASS 100% 190 in → 125 out (104 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
thinkingmachines/inkling-small:none PASS 100% 196 in → 11 out (0 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling-small:xhigh PASS 100% 197 in → 160 out (146 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 193 in → 155 out (136 reasoning)
git worktree remove '../feature-wt'
JSON Schema Structured Output
(raw) {"command": "git worktree remove '../feature-wt'"}
thinkingmachines/inkling:high PASS 100% 196 in → 184 out (177 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling:low PASS 100% 186 in → 48 out (35 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling:low__json_schema PASS 100% 195 in → 34 out (14 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
thinkingmachines/inkling:max PASS 100% 191 in → 146 out (147 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling:medium PASS 100% 188 in → 100 out (85 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling:medium__json_schema PASS 100% 187 in → 122 out (99 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
thinkingmachines/inkling:none PASS 100% 189 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling:xhigh PASS 100% 195 in → 122 out (117 reasoning)
git worktree remove ../feature-wt
thinkingmachines/inkling:xhigh__json_schema PASS 100% 188 in → 101 out (81 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
x-ai/grok-4.3:high PASS 100% 351 in → 311 out (303 reasoning)
git worktree remove ../feature-wt
x-ai/grok-4.3:high__json_schema PASS 100% 397 in → 368 out (356 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
x-ai/grok-4.3:low PASS 100% 355 in → 273 out (265 reasoning)
git worktree remove ../feature-wt
x-ai/grok-4.3:low__json_schema PASS 100% 409 in → 393 out (381 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
x-ai/grok-4.3:max PASS 100% 350 in → 376 out (368 reasoning)
git worktree remove ../feature-wt
x-ai/grok-4.3:max__json_schema PASS 100% 408 in → 310 out (298 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
x-ai/grok-4.3:medium PASS 100% 355 in → 692 out (684 reasoning)
git worktree remove ../feature-wt
x-ai/grok-4.3:medium__json_schema PASS 100% 416 in → 535 out (523 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
x-ai/grok-4.3:none PASS 100% 348 in → 8 out (0 reasoning)
git worktree remove ../feature-wt
x-ai/grok-4.3:none__json_schema PASS 100% 406 in → 12 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
x-ai/grok-4.3:xhigh PASS 100% 356 in → 346 out (338 reasoning)
git worktree remove ../feature-wt
x-ai/grok-4.3:xhigh__json_schema PASS 100% 406 in → 262 out (246 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
x-ai/grok-4.5:high PASS 100% 391 in → 305 out (293 reasoning)
``` git worktree remove ../feature-wt ```
x-ai/grok-4.5:high__json_schema PASS 100% 456 in → 266 out (253 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
x-ai/grok-4.5:low PASS 100% 398 in → 238 out (226 reasoning)
``` git worktree remove ../feature-wt ```
x-ai/grok-4.5:low__json_schema PASS 100% 462 in → 243 out (230 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
x-ai/grok-4.5:max PASS 100% 397 in → 235 out (227 reasoning)
git worktree remove ../feature-wt
x-ai/grok-4.5:max__json_schema PASS 100% 462 in → 327 out (314 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree remove ../feature-wt"}
x-ai/grok-4.5:medium PASS 100% 393 in → 310 out (298 reasoning)
``` git worktree remove ../feature-wt ```
x-ai/grok-4.5:medium__json_schema PASS 100% 464 in → 251 out (238 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
x-ai/grok-4.5:xhigh PASS 100% 397 in → 379 out (367 reasoning)
``` git worktree remove ../feature-wt ```
x-ai/grok-4.5:xhigh__json_schema PASS 100% 458 in → 288 out (275 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
z-ai/glm-4.7-flash:high PASS 100% 189 in → 369 out (342 reasoning)
git worktree remove ../feature-wt
z-ai/glm-4.7-flash:low PASS 100% 191 in → 711 out (674 reasoning)
git worktree remove ../feature-wt
z-ai/glm-4.7-flash:low__json_schema PASS 100% 192 in → 292 out (272 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
z-ai/glm-4.7-flash:medium PASS 100% 195 in → 399 out (394 reasoning)
git worktree remove ../feature-wt
z-ai/glm-4.7-flash:medium__json_schema PASS 100% 193 in → 556 out (508 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
z-ai/glm-4.7-flash:none PASS 100% 190 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
z-ai/glm-4.7-flash:none__json_schema PASS 100% 193 in → 14 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
z-ai/glm-4.7-flash:xhigh PASS 100% 194 in → 321 out (285 reasoning)
git worktree remove ../feature-wt
z-ai/glm-4.7-flash:xhigh__json_schema PASS 100% 190 in → 301 out (289 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
z-ai/glm-5.2:high PASS 100% 200 in → 211 out (194 reasoning)
git worktree remove ../feature-wt
z-ai/glm-5.2:low PASS 100% 197 in → 76 out (66 reasoning)
git worktree remove ../feature-wt
z-ai/glm-5.2:low__json_schema PASS 100% 203 in → 259 out (243 reasoning)
git worktree remove '../feature-wt'
JSON Schema Structured Output
(raw) {"command": "git worktree remove '../feature-wt'"}
z-ai/glm-5.2:medium PASS 100% 203 in → 149 out (139 reasoning)
git worktree remove ../feature-wt
z-ai/glm-5.2:medium__json_schema PASS 100% 379 in → 141 out (122 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
z-ai/glm-5.2:none PASS 100% 194 in → 9 out (0 reasoning)
git worktree remove ../feature-wt
z-ai/glm-5.2:none__json_schema PASS 100% 189 in → 16 out (0 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree remove ../feature-wt" }
z-ai/glm-5.2:xhigh PASS 100% 204 in → 323 out (311 reasoning)
git worktree remove ../feature-wt
z-ai/glm-5.2:xhigh__json_schema PASS 100% 203 in → 234 out (212 reasoning)
git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree remove ../feature-wt"}
liquid/lfm-2-24b-a2b FAIL 50% 203 in → 51 out
rm -rf /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f003_s347pa8_/feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
arcee-ai/trinity-mini:high FAIL 0% 179 in → 377 out (411 reasoning)
git worktreeremove ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
arcee-ai/trinity-mini:low FAIL 0% 178 in → 293 out (325 reasoning)
git worktree delete ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
arcee-ai/trinity-mini:low__json_schema FAIL 0% 171 in → 355 out (401 reasoning)
git worktree delete ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree delete ../feature-wt" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
arcee-ai/trinity-mini:medium__json_schema FAIL 0% 178 in → 491 out (531 reasoning)
gitworktree remove ../feature-wt
JSON Schema Structured Output
(raw) { "command": "gitworktree remove ../feature-wt" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
arcee-ai/trinity-mini:xhigh FAIL 0% 175 in → 317 out (346 reasoning)
git worktreedelete ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
arcee-ai/trinity-mini:xhigh__json_schema FAIL 0% 174 in → 479 out (543 reasoning)
git worktreedelete ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktreedelete ../feature-wt" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree{ "command": "git worktree remove ../feature-wt" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
ibm-granite/granite-4.1-8b FAIL 0% 206 in → 9 out
git worktree prune ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
Invalid JSON. Output: rm -rf /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f003_8qermexf/feature-wt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
minimax/minimax-m2.5:medium FAIL 0% 220 in → 295 out (302 reasoning)
worktree remove ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
moonshotai/kimi-k2.6:xhigh__json_schema FAIL 0% 175 in → 605 out (591 reasoning)
>git worktree remove ../feature-wt
JSON Schema Structured Output
(raw) {"command":">git worktree remove ../feature-wt"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list', 'not_contains': 'feature-wt'}, {'type': 'dir_not_exists', 'path': '../feature-wt'}]
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-77b9f5ec-25c7-98b1-9fa9-fca83c44fad2","request_id":"77b9f5ec-25c7-98b1-9fa9-fca83c44fad2"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-9cdc7ce6-9276-9e5c-83d2-7c7254a37299","request_id":"9cdc7ce6-9276-9e5c-83d2-7c7254a37299"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d5181b89-eea8-91b0-aef1-02ce65e89268","request_id":"d5181b89-eea8-91b0-aef1-02ce65e89268"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-fca8a9a8-0eac-9621-9d96-17499fc9f8b3","request_id":"fca8a9a8-0eac-9621-9d96-17499fc9f8b3"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-56cc69d3-9984-93b9-8f67-e75dc94e29f1","request_id":"56cc69d3-9984-93b9-8f67-e75dc94e29f1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-a4871df3-c8a5-97b9-a3c6-c1d0e7e9c3d6"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-0e00746c-5708-9050-888e-98fd751d57c9"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-ef151d99-4f85-9b3e-9d6a-b59bd9ff4c83"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-c888780d-a274-98ae-b93a-7db1192faebc"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-b0f0e883-59ae-9521-a5f8-f2cf9280378b"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-02b7711c-f0eb-9076-936b-816fff724515","request_id":"02b7711c-f0eb-9076-936b-816fff724515"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-7ffefbc3-b9d8-9611-9fee-ff120e274708","request_id":"7ffefbc3-b9d8-9611-9fee-ff120e274708"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-153d2823-09d8-93aa-8ce3-64247f312b8e","request_id":"153d2823-09d8-93aa-8ce3-64247f312b8e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-0101a3f2-ae75-979c-8dc4-875ff3a81645","request_id":"0101a3f2-ae75-979c-8dc4-875ff3a81645"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-4dd94af3-f7ac-9a20-95e0-4977cc414a5c","request_id":"4dd94af3-f7ac-9a20-95e0-4977cc414a5c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-813c06ab-05a5-9a9b-a7d8-d84d713c53bc","request_id":"813c06ab-05a5-9a9b-a7d8-d84d713c53bc"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-01e529da-23f3-9cd3-9421-8f3963aee2e9","request_id":"01e529da-23f3-9cd3-9421-8f3963aee2e9"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d3d0f76e-a723-9c5b-bcb3-0b08a24354d5","request_id":"d3d0f76e-a723-9c5b-bcb3-0b08a24354d5"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6f820f77-f032-9af6-91a0-18df4de5cbbe","request_id":"6f820f77-f032-9af6-91a0-18df4de5cbbe"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-edc49814-403c-9776-988b-504d7e645018","request_id":"edc49814-403c-9776-988b-504d7e645018"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: git worktree remove ../feature-wt{ "command": "git worktree remove ../feature-wt" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree remove ../feature-wt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree remove ../feature-wt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree remove ../feature-wt{ "command": "git worktree remove ../feature-wt" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree remove ../feature-wt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)