Create worktree for a different branch
Tests ability to create a git worktree for an existing branch. Evaluates basic worktree-creation command knowledge.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo 'Hello' > hello.txt
  5. 05 git add hello.txt
  6. 06 git commit -m 'Initial commit'
  7. 07 git checkout -b feature
  8. 08 echo 'Feature code' > feature.txt
  9. 09 git add feature.txt
  10. 10 git commit -m 'Add feature'
  11. 11 git checkout main
Prompt
Run the command to create a git worktree for the 'feature' branch at path '../feature-wt' (relative to the repo). Output ONLY the git worktree command, nothing else.
Expected
git worktree add ../feature-wt feature

Scoped model quality, cost, API time, and token usage for worktree_usage/f001.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 173 in → 39 out (21 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-fable-5:high__json_schema PASS 100% 381 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-fable-5:low PASS 100% 169 in → 27 out (11 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-fable-5:low__json_schema PASS 100% 384 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-fable-5:max PASS 100% 169 in → 96 out (28 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-fable-5:max__json_schema PASS 100% 380 in → 97 out (42 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-fable-5:medium PASS 100% 171 in → 55 out (37 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-fable-5:medium__json_schema PASS 100% 377 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-fable-5:xhigh PASS 100% 170 in → 57 out (41 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 380 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-haiku-4.5:high PASS 100% 176 in → 143 out (110 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 336 in → 182 out (158 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-haiku-4.5:low PASS 100% 174 in → 144 out (112 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 334 in → 238 out (215 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-haiku-4.5:medium PASS 100% 173 in → 155 out (122 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 333 in → 179 out (156 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-haiku-4.5:none PASS 100% 142 in → 18 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 305 in → 19 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 173 in → 147 out (115 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 333 in → 194 out (154 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.6:high PASS 100% 144 in → 19 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 307 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.6:low PASS 100% 142 in → 18 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 310 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.6:max PASS 100% 145 in → 91 out (55 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 310 in → 60 out (23 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.6:medium PASS 100% 147 in → 18 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 307 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.6:none PASS 100% 147 in → 18 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 306 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.6:xhigh PASS 100% 144 in → 19 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 308 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.7:high PASS 100% 177 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-opus-4.7:high__json_schema PASS 100% 384 in → 25 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.7:low PASS 100% 175 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-opus-4.7:low__json_schema PASS 100% 390 in → 25 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.7:max PASS 100% 178 in → 23 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 385 in → 25 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.7:medium PASS 100% 179 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 385 in → 25 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.7:none PASS 100% 179 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-opus-4.7:none__json_schema PASS 100% 383 in → 25 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.7:xhigh PASS 100% 177 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 383 in → 25 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.8:high PASS 100% 171 in → 20 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.8:high__json_schema PASS 100% 385 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.8:low PASS 100% 168 in → 20 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.8:low__json_schema PASS 100% 377 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.8:max PASS 100% 174 in → 20 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.8:max__json_schema PASS 100% 380 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.8:medium PASS 100% 173 in → 20 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 384 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.8:none PASS 100% 174 in → 20 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 378 in → 22 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-opus-4.8:xhigh PASS 100% 167 in → 16 out (0 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 381 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-4.6:high PASS 100% 147 in → 105 out (67 reasoning)
`git worktree add ../feature-wt feature`
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 306 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-4.6:low PASS 100% 141 in → 16 out (0 reasoning)
`git worktree add ../feature-wt feature`
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 306 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-4.6:max PASS 100% 148 in → 108 out (74 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 305 in → 82 out (46 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-4.6:medium PASS 100% 144 in → 16 out (0 reasoning)
`git worktree add ../feature-wt feature`
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 305 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-4.6:none PASS 100% 144 in → 18 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 311 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 147 in → 107 out (67 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 310 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-5:high PASS 100% 171 in → 20 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 383 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-5:low PASS 100% 172 in → 16 out (0 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-sonnet-5:low__json_schema PASS 100% 381 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-5:medium PASS 100% 170 in → 16 out (0 reasoning)
git worktree add ../feature-wt feature
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 378 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-5:none PASS 100% 168 in → 20 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-sonnet-5:none__json_schema PASS 100% 381 in → 22 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
anthropic/claude-sonnet-5:xhigh PASS 100% 179 in → 20 out (0 reasoning)
``` git worktree add ../feature-wt feature ```
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 378 in → 23 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
arcee-ai/trinity-large-thinking:high PASS 100% 124 in → 425 out (419 reasoning)
git worktree add ../feature-wt feature
arcee-ai/trinity-large-thinking:low PASS 100% 124 in → 448 out (438 reasoning)
git worktree add ../feature-wt feature
arcee-ai/trinity-large-thinking:medium PASS 100% 128 in → 588 out (583 reasoning)
git worktree add ../feature-wt feature
arcee-ai/trinity-large-thinking:xhigh PASS 100% 121 in → 356 out (348 reasoning)
git worktree add ../feature-wt feature
arcee-ai/trinity-mini:high__json_schema PASS 100% 121 in → 484 out (511 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command":"git worktree add ../feature-wt feature" }
arcee-ai/trinity-mini:low__json_schema PASS 100% 121 in → 414 out (437 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command":"git worktree add ../feature-wt feature" }
arcee-ai/trinity-mini:medium PASS 100% 127 in → 392 out (427 reasoning)
git worktree add ../feature-wt feature
arcee-ai/trinity-mini:medium__json_schema PASS 100% 123 in → 474 out (514 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command":"git worktree add ../feature-wt feature" }
arcee-ai/trinity-mini:xhigh PASS 100% 122 in → 342 out (359 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash-0731:high PASS 100% 125 in → 170 out (167 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 126 in → 143 out (132 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
deepseek/deepseek-v4-flash-0731:low PASS 100% 127 in → 236 out (225 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 130 in → 252 out (251 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
deepseek/deepseek-v4-flash-0731:max PASS 100% 205 in → 177 out (178 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 203 in → 175 out (171 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 128 in → 129 out (126 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 123 in → 137 out (123 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
deepseek/deepseek-v4-flash-0731:none PASS 100% 122 in → 9 out (0 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 122 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 122 in → 194 out (194 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 205 in → 1,700 out (1,777 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
deepseek/deepseek-v4-flash:high PASS 100% 119 in → 247 out (237 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash:high__json_schema PASS 100% 128 in → 89 out (70 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
deepseek/deepseek-v4-flash:low PASS 100% 127 in → 109 out (98 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash:low__json_schema PASS 100% 119 in → 111 out (95 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
deepseek/deepseek-v4-flash:medium PASS 100% 126 in → 147 out (138 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash:medium__json_schema PASS 100% 127 in → 136 out (125 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
deepseek/deepseek-v4-flash:none PASS 100% 128 in → 11 out (0 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 127 in → 17 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
deepseek/deepseek-v4-flash:xhigh PASS 100% 201 in → 284 out (277 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 215 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
deepseek/deepseek-v4-pro:high PASS 100% 128 in → 118 out (107 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-pro:low PASS 100% 124 in → 364 out (353 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-pro:medium PASS 100% 127 in → 332 out (322 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 316 in → 74 out (58 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
deepseek/deepseek-v4-pro:none PASS 100% 128 in → 10 out (0 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 310 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 199 in → 115 out (104 reasoning)
git worktree add ../feature-wt feature
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 122 in → 18 out (17 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemini-3-flash-preview:high PASS 100% 143 in → 132 out (123 reasoning)
git worktree add ../feature-wt feature
google/gemini-3-flash-preview:high__json_schema PASS 100% 204 in → 217 out (203 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3-flash-preview:low PASS 100% 147 in → 147 out (138 reasoning)
git worktree add ../feature-wt feature
google/gemini-3-flash-preview:low__json_schema PASS 100% 207 in → 107 out (94 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3-flash-preview:medium PASS 100% 151 in → 155 out (146 reasoning)
git worktree add ../feature-wt feature
google/gemini-3-flash-preview:medium__json_schema PASS 100% 206 in → 180 out (167 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3-flash-preview:xhigh PASS 100% 149 in → 156 out (147 reasoning)
git worktree add ../feature-wt feature
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 205 in → 304 out (290 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 153 in → 243 out (234 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 147 in → 292 out (278 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.1-flash-lite-preview:low PASS 100% 146 in → 160 out (151 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 150 in → 127 out (113 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.1-flash-lite-preview:medium PASS 100% 149 in → 143 out (134 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 207 in → 164 out (145 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 152 in → 229 out (220 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 203 in → 357 out (343 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.1-pro-preview:high PASS 100% 153 in → 507 out (498 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 209 in → 342 out (329 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3.1-pro-preview:low PASS 100% 149 in → 225 out (216 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 209 in → 260 out (247 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3.1-pro-preview:medium PASS 100% 146 in → 284 out (275 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 150 in → 318 out (304 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 150 in → 246 out (237 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 206 in → 563 out (550 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3.5-flash-lite:high PASS 100% 153 in → 239 out (230 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 202 in → 382 out (369 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3.5-flash-lite:low PASS 100% 150 in → 9 out (0 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 149 in → 14 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.5-flash-lite:max PASS 100% 148 in → 423 out (414 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 152 in → 274 out (261 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3.5-flash-lite:medium PASS 100% 150 in → 177 out (168 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 209 in → 206 out (192 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 148 in → 369 out (360 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 154 in → 323 out (309 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.5-flash:high PASS 100% 151 in → 424 out (415 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash:high__json_schema PASS 100% 209 in → 342 out (328 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.5-flash:low PASS 100% 149 in → 215 out (206 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash:low__json_schema PASS 100% 206 in → 56 out (42 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.5-flash:medium PASS 100% 148 in → 245 out (236 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash:medium__json_schema PASS 100% 205 in → 122 out (108 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.5-flash:xhigh PASS 100% 151 in → 378 out (369 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 209 in → 350 out (336 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
google/gemini-3.6-flash:high PASS 100% 149 in → 340 out (331 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.6-flash:high__json_schema PASS 100% 206 in → 308 out (295 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3.6-flash:low PASS 100% 150 in → 162 out (153 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.6-flash:low__json_schema PASS 100% 151 in → 19 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemini-3.6-flash:max PASS 100% 150 in → 279 out (270 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.6-flash:max__json_schema PASS 100% 152 in → 226 out (213 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3.6-flash:medium PASS 100% 149 in → 235 out (226 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.6-flash:medium__json_schema PASS 100% 207 in → 152 out (139 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemini-3.6-flash:xhigh PASS 100% 152 in → 215 out (206 reasoning)
git worktree add ../feature-wt feature
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 205 in → 239 out (226 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemma-4-26b-a4b-it:high PASS 100% 167 in → 242 out (190 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-26b-a4b-it:high__json_schema PASS 100% 163 in → 289 out (212 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemma-4-26b-a4b-it:low PASS 100% 162 in → 172 out (156 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 161 in → 191 out (153 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemma-4-26b-a4b-it:medium PASS 100% 168 in → 180 out (170 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 167 in → 308 out (202 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemma-4-26b-a4b-it:none PASS 100% 163 in → 10 out (0 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-26b-a4b-it:none__json_schema PASS 100% 162 in → 20 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemma-4-26b-a4b-it:xhigh PASS 100% 162 in → 284 out (198 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 170 in → 151 out (118 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemma-4-31b-it:high PASS 100% 164 in → 120 out (92 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-31b-it:high__json_schema PASS 100% 168 in → 202 out (187 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemma-4-31b-it:low__json_schema PASS 100% 160 in → 126 out (90 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemma-4-31b-it:medium PASS 100% 165 in → 255 out (171 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-31b-it:medium__json_schema PASS 100% 171 in → 120 out (105 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
google/gemma-4-31b-it:none PASS 100% 157 in → 10 out (0 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-31b-it:none__json_schema PASS 100% 163 in → 20 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
google/gemma-4-31b-it:xhigh PASS 100% 163 in → 249 out (161 reasoning)
git worktree add ../feature-wt feature
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 167 in → 124 out (93 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
ibm-granite/granite-4.1-8b PASS 100% 139 in → 10 out
git worktree add ../feature-wt feature
ibm-granite/granite-4.1-8b__json_schema PASS 100% 142 in → 17 out
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
inclusionai/ling-2.6-flash PASS 100% 160 in → 10 out
git worktree add ../feature-wt feature
inclusionai/ling-2.6-flash__json_schema PASS 100% 161 in → 14 out
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
minimax/minimax-m2.5:high PASS 100% 154 in → 82 out (81 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m2.5:high__json_schema PASS 100% 155 in → 611 out (543 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
minimax/minimax-m2.5:low PASS 100% 149 in → 534 out (588 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m2.5:low__json_schema PASS 100% 171 in → 135 out (125 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
minimax/minimax-m2.5:medium PASS 100% 152 in → 304 out (294 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m2.5:medium__json_schema PASS 100% 155 in → 174 out (150 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
minimax/minimax-m2.5:xhigh PASS 100% 151 in → 209 out (198 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 149 in → 279 out (273 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
minimax/minimax-m2.7:high PASS 100% 153 in → 986 out (972 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m2.7:high__json_schema PASS 100% 282 in → 724 out (705 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
minimax/minimax-m2.7:low PASS 100% 154 in → 291 out (281 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m2.7:low__json_schema PASS 100% 283 in → 392 out (377 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
minimax/minimax-m2.7:medium PASS 100% 152 in → 349 out (371 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m2.7:medium__json_schema PASS 100% 282 in → 418 out (403 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
minimax/minimax-m2.7:xhigh PASS 100% 158 in → 252 out (242 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 281 in → 451 out (436 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
minimax/minimax-m3:high PASS 100% 287 in → 63 out (57 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m3:low PASS 100% 288 in → 87 out (83 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m3:medium PASS 100% 292 in → 46 out (38 reasoning)
git worktree add ../feature-wt feature
minimax/minimax-m3:medium__json_schema PASS 100% 281 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
minimax/minimax-m3:xhigh PASS 100% 293 in → 129 out (119 reasoning)
git worktree add ../feature-wt feature
mistralai/devstral-2512 PASS 100% 147 in → 15 out
```sh git worktree add ../feature-wt feature ```
mistralai/devstral-2512__json_schema PASS 100% 152 in → 15 out
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
mistralai/mistral-medium-3-5:high PASS 100% 157 in → 420 out (446 reasoning)
git worktree add ../feature-wt feature
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 150 in → 192 out (174 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
mistralai/mistral-medium-3-5:low PASS 100% 160 in → 396 out (420 reasoning)
git worktree add ../feature-wt feature
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 151 in → 200 out (202 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
mistralai/mistral-medium-3-5:medium PASS 100% 163 in → 246 out (224 reasoning)
git worktree add ../feature-wt feature
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 146 in → 237 out (246 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
mistralai/mistral-medium-3-5:none PASS 100% 161 in → 15 out (0 reasoning)
```bash git worktree add ../feature-wt feature ```
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 150 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 163 in → 736 out (770 reasoning)
git worktree add ../feature-wt feature
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 148 in → 559 out (526 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
moonshotai/kimi-k2.6:high PASS 100% 120 in → 366 out (360 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k2.6:high__json_schema PASS 100% 119 in → 950 out (888 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
moonshotai/kimi-k2.6:low PASS 100% 122 in → 812 out (801 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k2.6:low__json_schema PASS 100% 121 in → 1,115 out (1,077 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
moonshotai/kimi-k2.6:medium PASS 100% 119 in → 239 out (230 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 119 in → 652 out (428 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
moonshotai/kimi-k2.6:xhigh PASS 100% 120 in → 995 out (984 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k2.6:xhigh__json_schema PASS 100% 121 in → 1,280 out (1,398 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
moonshotai/kimi-k2.7-code:high PASS 100% 123 in → 136 out (127 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 211 in → 113 out (98 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
moonshotai/kimi-k2.7-code:low PASS 100% 124 in → 219 out (208 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 119 in → 95 out (86 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
moonshotai/kimi-k2.7-code:medium PASS 100% 119 in → 152 out (155 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 198 in → 100 out (85 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
moonshotai/kimi-k2.7-code:xhigh PASS 100% 117 in → 127 out (118 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 117 in → 174 out (156 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
moonshotai/kimi-k3:high PASS 100% 197 in → 79 out (55 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:high__json_schema PASS 100% 197 in → 80 out (56 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:low PASS 100% 201 in → 55 out (31 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:low__json_schema PASS 100% 200 in → 79 out (55 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:max PASS 100% 197 in → 80 out (56 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:max__json_schema PASS 100% 198 in → 94 out (70 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:medium PASS 100% 199 in → 80 out (56 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:medium__json_schema PASS 100% 201 in → 83 out (59 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:xhigh PASS 100% 200 in → 79 out (55 reasoning)
git worktree add ../feature-wt feature
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 201 in → 91 out (67 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 163 in → 251 out (268 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 157 in → 236 out (236 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 164 in → 187 out (183 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-nano-30b-a3b:low__json_schema PASS 100% 162 in → 206 out (212 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 168 in → 144 out (143 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 165 in → 149 out (155 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature" }
nvidia/nemotron-3-nano-30b-a3b:none__json_schema PASS 100% 164 in → 19 out (0 reasoning)
git worktree add --force ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add --force ../feature-wt feature" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 157 in → 237 out (255 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 158 in → 187 out (195 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 165 in → 199 out (187 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 161 in → 100 out (81 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 160 in → 62 out (50 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 165 in → 89 out (70 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 158 in → 189 out (177 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 166 in → 90 out (71 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 163 in → 10 out (0 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 156 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 161 in → 147 out (147 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 163 in → 100 out (82 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
openai/gpt-5.4-mini:high PASS 100% 124 in → 134 out (119 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-mini:high__json_schema PASS 100% 157 in → 199 out (176 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-mini:low PASS 100% 124 in → 84 out (69 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-mini:low__json_schema PASS 100% 156 in → 59 out (36 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-mini:medium PASS 100% 120 in → 140 out (125 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-mini:medium__json_schema PASS 100% 155 in → 163 out (140 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-mini:none PASS 100% 123 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-mini:none__json_schema PASS 100% 158 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-mini:xhigh PASS 100% 121 in → 1,160 out (1,145 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 156 in → 539 out (516 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-nano:high PASS 100% 122 in → 53 out (38 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-nano:high__json_schema PASS 100% 158 in → 80 out (57 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-nano:low PASS 100% 124 in → 40 out (25 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-nano:low__json_schema PASS 100% 156 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-nano:medium PASS 100% 124 in → 97 out (82 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-nano:medium__json_schema PASS 100% 158 in → 71 out (48 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-nano:none PASS 100% 122 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-nano:none__json_schema PASS 100% 156 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4-nano:xhigh PASS 100% 123 in → 175 out (160 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 155 in → 494 out (471 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4:high__json_schema PASS 100% 154 in → 171 out (148 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.4:low PASS 100% 124 in → 70 out (55 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.5:high PASS 100% 126 in → 99 out (84 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.5:high__json_schema PASS 100% 155 in → 134 out (111 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.5:low PASS 100% 122 in → 82 out (67 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.5:low__json_schema PASS 100% 153 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.5:medium PASS 100% 127 in → 88 out (73 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.5:medium__json_schema PASS 100% 158 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.5:none PASS 100% 122 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.5:none__json_schema PASS 100% 161 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.5:xhigh PASS 100% 120 in → 531 out (516 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.5:xhigh__json_schema PASS 100% 155 in → 256 out (233 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-luna:high PASS 100% 121 in → 77 out (62 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-luna:high__json_schema PASS 100% 156 in → 103 out (80 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-luna:low PASS 100% 121 in → 36 out (21 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-luna:low__json_schema PASS 100% 158 in → 43 out (20 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-luna:max PASS 100% 121 in → 77 out (62 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-luna:max__json_schema PASS 100% 158 in → 88 out (65 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-luna:medium PASS 100% 120 in → 36 out (21 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-luna:medium__json_schema PASS 100% 161 in → 59 out (36 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-luna:none PASS 100% 122 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-luna:none__json_schema PASS 100% 156 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-luna:xhigh PASS 100% 126 in → 152 out (137 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 158 in → 85 out (62 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-sol:high PASS 100% 122 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-sol:high__json_schema PASS 100% 160 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-sol:low PASS 100% 121 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-sol:low__json_schema PASS 100% 154 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-sol:max PASS 100% 121 in → 369 out (354 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-sol:max__json_schema PASS 100% 156 in → 141 out (118 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-sol:medium PASS 100% 125 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-sol:medium__json_schema PASS 100% 156 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-sol:none PASS 100% 122 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-sol:none__json_schema PASS 100% 159 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-sol:xhigh PASS 100% 121 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 158 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-terra:high PASS 100% 122 in → 75 out (60 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-terra:low PASS 100% 125 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-terra:low__json_schema PASS 100% 161 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-5.6-terra:max PASS 100% 125 in → 89 out (74 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-terra:medium PASS 100% 122 in → 132 out (117 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-terra:none PASS 100% 124 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
openai/gpt-5.6-terra:none__json_schema PASS 100% 154 in → 21 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-oss-120b:high PASS 100% 183 in → 349 out (370 reasoning)
git worktree add ../feature-wt feature
openai/gpt-oss-120b:high__json_schema PASS 100% 177 in → 319 out (324 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-oss-120b:low PASS 100% 185 in → 89 out (80 reasoning)
git worktree add ../feature-wt feature
openai/gpt-oss-120b:low__json_schema PASS 100% 180 in → 50 out (26 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
openai/gpt-oss-120b:medium PASS 100% 186 in → 173 out (173 reasoning)
git worktree add ../feature-wt feature
openai/gpt-oss-120b:medium__json_schema PASS 100% 171 in → 161 out (148 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-oss-120b:xhigh PASS 100% 188 in → 260 out (290 reasoning)
git worktree add ../feature-wt feature
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 179 in → 228 out (208 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-oss-20b:high PASS 100% 181 in → 308 out (292 reasoning)
git worktree add ../feature-wt feature
openai/gpt-oss-20b:high__json_schema PASS 100% 168 in → 237 out (242 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
openai/gpt-oss-20b:low PASS 100% 185 in → 172 out (163 reasoning)
git worktree add ../feature-wt feature
openai/gpt-oss-20b:low__json_schema PASS 100% 184 in → 40 out (18 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-oss-20b:medium PASS 100% 169 in → 146 out (146 reasoning)
git worktree add ../feature-wt feature
openai/gpt-oss-20b:medium__json_schema PASS 100% 183 in → 143 out (122 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
openai/gpt-oss-20b:xhigh PASS 100% 170 in → 855 out (915 reasoning)
git worktree add ../feature-wt feature
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 180 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
poolside/laguna-m.1:high PASS 100% 154 in → 280 out (269 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-m.1:high__json_schema PASS 100% 147 in → 393 out (373 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
poolside/laguna-m.1:low PASS 100% 152 in → 407 out (396 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-m.1:low__json_schema PASS 100% 151 in → 252 out (232 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
poolside/laguna-m.1:medium PASS 100% 148 in → 311 out (301 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-m.1:medium__json_schema PASS 100% 154 in → 343 out (324 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
poolside/laguna-m.1:none PASS 100% 148 in → 11 out (0 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-m.1:none__json_schema PASS 100% 150 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-m.1:xhigh PASS 100% 148 in → 306 out (295 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-m.1:xhigh__json_schema PASS 100% 148 in → 295 out (280 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs-2.1:high PASS 100% 151 in → 362 out (353 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs-2.1:high__json_schema PASS 100% 154 in → 367 out (352 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs-2.1:low PASS 100% 144 in → 286 out (277 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs-2.1:low__json_schema PASS 100% 149 in → 287 out (272 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs-2.1:medium PASS 100% 150 in → 224 out (215 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 151 in → 311 out (296 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs-2.1:none PASS 100% 148 in → 9 out (0 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs-2.1:none__json_schema PASS 100% 150 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs-2.1:xhigh PASS 100% 150 in → 262 out (253 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 151 in → 234 out (219 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs.2:high PASS 100% 189 in → 132 out (121 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs.2:high__json_schema PASS 100% 191 in → 132 out (117 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs.2:low PASS 100% 183 in → 141 out (130 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs.2:low__json_schema PASS 100% 182 in → 129 out (114 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs.2:medium PASS 100% 184 in → 182 out (170 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs.2:medium__json_schema PASS 100% 188 in → 132 out (116 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs.2:none PASS 100% 190 in → 11 out (0 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs.2:none__json_schema PASS 100% 187 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
poolside/laguna-xs.2:xhigh PASS 100% 185 in → 398 out (386 reasoning)
git worktree add ../feature-wt feature
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 187 in → 118 out (103 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
qwen/qwen3.6-27b:high PASS 100% 149 in → 250 out (217 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-27b:high__json_schema PASS 100% 149 in → 811 out (1 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-27b:low PASS 100% 147 in → 1,163 out (1,095 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-27b:low__json_schema PASS 100% 150 in → 1,099 out (1,025 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-27b:medium PASS 100% 154 in → 1,255 out (1,241 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-27b:medium__json_schema PASS 100% 155 in → 909 out (851 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-27b:none PASS 100% 153 in → 10 out (0 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-27b:none__json_schema PASS 100% 153 in → 20 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-27b:xhigh PASS 100% 150 in → 155 out (148 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 151 in → 1,236 out (1,168 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-35b-a3b:high PASS 100% 147 in → 921 out (891 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 147 in → 779 out (745 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-35b-a3b:low PASS 100% 155 in → 1,074 out (1,055 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 149 in → 933 out (937 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 152 in → 882 out (878 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 148 in → 1,319 out (1,310 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-35b-a3b:none PASS 100% 154 in → 10 out (0 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-35b-a3b:none__json_schema PASS 100% 153 in → 69 out (0 reasoning)
git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f001_rgndo6gf/worktree_usage_f001 worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f001_rgndo6gf/worktree_usage_f001 worktree add ../feature-wt feature"}
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 152 in → 898 out (887 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 151 in → 1,123 out (1,126 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
qwen/qwen3.6-flash:high PASS 100% 152 in → 618 out (604 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-flash:low PASS 100% 151 in → 1,149 out (1,135 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-flash:medium PASS 100% 149 in → 847 out (833 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-flash:none PASS 100% 150 in → 9 out (0 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.6-flash:xhigh PASS 100% 151 in → 904 out (890 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-flash:high PASS 100% 153 in → 837 out (823 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-flash:low PASS 100% 153 in → 907 out (893 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-flash:max PASS 100% 153 in → 325 out (311 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-flash:medium PASS 100% 150 in → 882 out (868 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-flash:none PASS 100% 154 in → 9 out (0 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-flash:xhigh PASS 100% 151 in → 1,088 out (1,074 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-max:high PASS 100% 149 in → 653 out (639 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-max:low PASS 100% 149 in → 627 out (613 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-max:medium PASS 100% 149 in → 870 out (856 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-max:none PASS 100% 151 in → 9 out (0 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-max:xhigh PASS 100% 148 in → 223 out (209 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-plus:high PASS 100% 152 in → 716 out (702 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-plus:low PASS 100% 148 in → 843 out (829 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-plus:medium PASS 100% 151 in → 449 out (435 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-plus:none PASS 100% 157 in → 9 out (0 reasoning)
git worktree add ../feature-wt feature
qwen/qwen3.7-plus:xhigh PASS 100% 149 in → 831 out (817 reasoning)
git worktree add ../feature-wt feature
tencent/hy3:high PASS 100% 134 in → 790 out (779 reasoning)
git worktree add ../feature-wt feature
tencent/hy3:high__json_schema PASS 100% 133 in → 492 out (474 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
tencent/hy3:low PASS 100% 131 in → 595 out (584 reasoning)
git worktree add ../feature-wt feature
tencent/hy3:low__json_schema PASS 100% 126 in → 308 out (283 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
tencent/hy3:medium PASS 100% 132 in → 1,684 out (1,673 reasoning)
git worktree add ../feature-wt feature
tencent/hy3:medium__json_schema PASS 100% 130 in → 2,400 out (2,342 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
tencent/hy3:none PASS 100% 135 in → 10 out (0 reasoning)
git worktree add ../feature-wt feature
tencent/hy3:xhigh PASS 100% 131 in → 1,009 out (998 reasoning)
git worktree add ../feature-wt feature
tencent/hy3:xhigh__json_schema PASS 100% 129 in → 825 out (827 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
thinkingmachines/inkling-small:high PASS 100% 131 in → 320 out (305 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling-small:high__json_schema PASS 100% 131 in → 301 out (280 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
thinkingmachines/inkling-small:low PASS 100% 130 in → 104 out (95 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling-small:low__json_schema PASS 100% 132 in → 37 out (15 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
thinkingmachines/inkling-small:max PASS 100% 126 in → 233 out (209 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling-small:max__json_schema PASS 100% 133 in → 301 out (282 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
thinkingmachines/inkling-small:medium PASS 100% 134 in → 204 out (160 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling-small:medium__json_schema PASS 100% 133 in → 199 out (178 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
thinkingmachines/inkling-small:none PASS 100% 128 in → 12 out (0 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling-small:xhigh PASS 100% 130 in → 112 out (83 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 132 in → 168 out (149 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
thinkingmachines/inkling:high PASS 100% 132 in → 133 out (118 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling:high__json_schema PASS 100% 130 in → 193 out (172 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
thinkingmachines/inkling:low PASS 100% 131 in → 31 out (15 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling:low__json_schema PASS 100% 130 in → 36 out (15 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
thinkingmachines/inkling:max PASS 100% 131 in → 267 out (251 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling:max__json_schema PASS 100% 135 in → 175 out (157 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
thinkingmachines/inkling:medium PASS 100% 130 in → 91 out (76 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling:medium__json_schema PASS 100% 134 in → 148 out (126 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
thinkingmachines/inkling:none PASS 100% 131 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling:none__json_schema PASS 100% 132 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
thinkingmachines/inkling:xhigh PASS 100% 130 in → 154 out (139 reasoning)
git worktree add ../feature-wt feature
thinkingmachines/inkling:xhigh__json_schema PASS 100% 130 in → 162 out (144 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
x-ai/grok-4.3:high PASS 100% 299 in → 173 out (164 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.3:high__json_schema PASS 100% 353 in → 483 out (466 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
x-ai/grok-4.3:low PASS 100% 304 in → 84 out (75 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.3:low__json_schema PASS 100% 363 in → 126 out (113 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
x-ai/grok-4.3:max PASS 100% 297 in → 133 out (124 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.3:max__json_schema PASS 100% 351 in → 421 out (408 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
x-ai/grok-4.3:medium PASS 100% 304 in → 358 out (349 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.3:medium__json_schema PASS 100% 362 in → 386 out (369 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
x-ai/grok-4.3:none PASS 100% 294 in → 9 out (0 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.3:none__json_schema PASS 100% 351 in → 13 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
x-ai/grok-4.3:xhigh PASS 100% 300 in → 89 out (80 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.3:xhigh__json_schema PASS 100% 352 in → 584 out (571 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
x-ai/grok-4.5:high PASS 100% 335 in → 209 out (200 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.5:high__json_schema PASS 100% 400 in → 363 out (349 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
x-ai/grok-4.5:low PASS 100% 333 in → 202 out (193 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.5:low__json_schema PASS 100% 394 in → 192 out (178 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
x-ai/grok-4.5:max PASS 100% 332 in → 213 out (204 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.5:max__json_schema PASS 100% 399 in → 215 out (201 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt feature"}
x-ai/grok-4.5:medium PASS 100% 332 in → 262 out (253 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.5:medium__json_schema PASS 100% 399 in → 295 out (281 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
x-ai/grok-4.5:xhigh PASS 100% 327 in → 225 out (216 reasoning)
git worktree add ../feature-wt feature
x-ai/grok-4.5:xhigh__json_schema PASS 100% 398 in → 306 out (292 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
z-ai/glm-4.7-flash:high PASS 100% 125 in → 248 out (237 reasoning)
git worktree add ../feature-wt feature
z-ai/glm-4.7-flash:low PASS 100% 129 in → 307 out (305 reasoning)
git worktree add ../feature-wt feature
z-ai/glm-4.7-flash:medium PASS 100% 126 in → 278 out (249 reasoning)
git worktree add ../feature-wt feature
z-ai/glm-4.7-flash:medium__json_schema PASS 100% 126 in → 273 out (238 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
z-ai/glm-4.7-flash:none__json_schema PASS 100% 122 in → 15 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
z-ai/glm-4.7-flash:xhigh PASS 100% 124 in → 266 out (238 reasoning)
git worktree add ../feature-wt feature
z-ai/glm-4.7-flash:xhigh__json_schema PASS 100% 128 in → 271 out (238 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../feature-wt feature"}
z-ai/glm-5.2:high PASS 100% 135 in → 242 out (231 reasoning)
git worktree add ../feature-wt feature
z-ai/glm-5.2:high__json_schema PASS 100% 135 in → 218 out (200 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
z-ai/glm-5.2:low PASS 100% 132 in → 198 out (183 reasoning)
git worktree add ../feature-wt feature
z-ai/glm-5.2:low__json_schema PASS 100% 310 in → 84 out (65 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
z-ai/glm-5.2:medium PASS 100% 135 in → 60 out (49 reasoning)
git worktree add ../feature-wt feature
z-ai/glm-5.2:medium__json_schema PASS 100% 129 in → 283 out (262 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
z-ai/glm-5.2:none PASS 100% 124 in → 10 out (0 reasoning)
git worktree add ../feature-wt feature
z-ai/glm-5.2:none__json_schema PASS 100% 129 in → 18 out (0 reasoning)
git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../feature-wt feature" }
z-ai/glm-5.2:xhigh PASS 100% 132 in → 69 out (66 reasoning)
git worktree add ../feature-wt feature
nvidia/nemotron-3-nano-30b-a3b:none FAIL 75% 159 in → 15 out (0 reasoning)
git worktree add ../feature-wt refs/heads/feature
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git -C ../feature-wt branch --show-current', 'contains': 'feature'}]
arcee-ai/trinity-mini:high FAIL 25% 122 in → 317 out (338 reasoning)
git worktree add../feature-wt feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
arcee-ai/trinity-mini:low FAIL 25% 122 in → 330 out (349 reasoning)
gitworktree add ../feature-wt feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
arcee-ai/trinity-mini:xhigh__json_schema FAIL 25% 124 in → 520 out (567 reasoning)
git worktreeadd ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "git worktreeadd ../feature-wt feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
deepseek/deepseek-v4-pro:high__json_schema FAIL 25% 126 in → 92 out (91 reasoning)
We need to generate the exact git worktree command to create a worktree for the 'feature' branch at path '../feature-wt' relative to the repo. The provided context includes a worktree and branch info, but we just need the command. The answer should be only the command text, no explanation. Assuming the current directory is the repo root. So: git worktree add ../feature-wt feature
JSON Schema Structured Output
(raw) { "command": "We need to generate the exact git worktree command to create a worktree for the 'feature' branch at path '../feature-wt' relative to the repo. The provided context includes a worktree and branch info, but we just need the command. The answer should be only the command text, no explanation. Assuming the current directory is the repo root. So: git worktree add ../feature-wt feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
google/gemma-4-31b-it:low FAIL 25% 165 in → 103 out (0 reasoning)
thought * Goal: Create a git worktree for the 'feature' branch at path '../feature-wt'. * Constraint: Output ONLY the git worktree command. * Command: `git worktree add <path> <branch>` * Path: `../feature-wt` * Branch: `feature` * `git worktree add ../feature-wt feature`git worktree add ../feature-wt feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
liquid/lfm-2-24b-a2b FAIL 25% 137 in → 11 out
git worktree add feature ../feature-wt
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
minimax/minimax-m3:high__json_schema FAIL 25% 276 in → 18 out (0 reasoning)
git worktree add -b feature ../feature-wt main
JSON Schema Structured Output
(raw) {"command": "git worktree add -b feature ../feature-wt main"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
minimax/minimax-m3:low__json_schema FAIL 25% 274 in → 20 out (0 reasoning)
git worktree add -b feature ../feature-wt main
JSON Schema Structured Output
(raw) { "command": "git worktree add -b feature ../feature-wt main" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
minimax/minimax-m3:xhigh__json_schema FAIL 25% 237 in → 20 out (19 reasoning)
git worktree add -b feature ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree add -b feature ../feature-wt" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.4:high FAIL 25% 118 in → 664 out (647 reasoning)
git worktree add -b feature ../feature-wt
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.4:low__json_schema FAIL 25% 159 in → 108 out (83 reasoning)
git worktree add -b feature ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree add -b feature ../feature-wt"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.4:medium FAIL 25% 119 in → 212 out (194 reasoning)
git worktree add -b feature ../feature-wt HEAD
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.4:medium__json_schema FAIL 25% 159 in → 152 out (127 reasoning)
git worktree add -b feature ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree add -b feature ../feature-wt"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.4:none FAIL 25% 125 in → 61 out (0 reasoning)
git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f001_n16f5ux3/worktree_usage_f001 worktree add -b feature ../feature-wt HEAD
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.4:none__json_schema FAIL 25% 156 in → 23 out (0 reasoning)
git worktree add ../feature-wt -b feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../feature-wt -b feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.4:xhigh FAIL 25% 120 in → 2,924 out (2,907 reasoning)
git worktree add -b feature ../feature-wt
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.4:xhigh__json_schema FAIL 25% 162 in → 4,212 out (4,142 reasoning)
git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f001_90f074f2/worktree_usage_f001 worktree add -b feature ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f001_90f074f2/worktree_usage_f001 worktree add -b feature ../feature-wt"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.6-terra:max__json_schema FAIL 25% 154 in → 541 out (516 reasoning)
git worktree add -b feature ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree add -b feature ../feature-wt"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
openai/gpt-5.6-terra:xhigh FAIL 25% 122 in → 311 out (294 reasoning)
git worktree add -b feature ../feature-wt
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
z-ai/glm-4.7-flash:none FAIL 25% 131 in → 11 out (0 reasoning)
git worktree add ../feature-wt -b feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../feature-wt'}, {'type': 'branch_exists', 'name': 'feature', 'in_worktree': '../feature-wt'}, {'type': 'file_content', 'path': '../feature-wt/feature.txt', 'value': 'Feature code'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: gitworktree add ../feature-wt feature
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree add feature ../feature-wt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: {"command":"git worktree add -b feature ../feature-wt"} {"command":"git worktree add -b feature ../feature-wt"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Extra data: line 3 column 1 (char 57)
Failure: Failed to parse structured JSON response: Extra data: line 3 column 1 (char 57)
Invalid JSON. Output: {"command":"git worktree add -b feature ../feature-wt"} {"command":"git worktree add -b feature ../feature-wt"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Extra data: line 3 column 1 (char 57)
Failure: Failed to parse structured JSON response: Extra data: line 3 column 1 (char 57)
Invalid JSON. Output: {"command":"git worktree add -b feature ../feature-wt"} {"command":"git worktree add -b feature ../feature-wt"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Extra data: line 3 column 1 (char 57)
Failure: Failed to parse structured JSON response: Extra data: line 3 column 1 (char 57)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6e80af2f-d192-99d7-8f95-4dace9c9ab9a","request_id":"6e80af2f-d192-99d7-8f95-4dace9c9ab9a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-b7a230b8-8fea-9b25-a144-c0fd43474b51","request_id":"b7a230b8-8fea-9b25-a144-c0fd43474b51"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-b74f74c6-45ec-9699-bc3c-f2829f165d1a","request_id":"b74f74c6-45ec-9699-bc3c-f2829f165d1a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-544c90c0-3663-973b-9503-7797f48ea60c","request_id":"544c90c0-3663-973b-9503-7797f48ea60c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-261e9143-4b96-964f-8901-8433f3d3fb5d","request_id":"261e9143-4b96-964f-8901-8433f3d3fb5d"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-1d352df7-ae80-9607-b941-bdae8db4cd4d"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-12272c51-e844-9509-9007-a13315e2a50a"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-2da43aaf-1a78-9b47-9e8f-50a1fce635a5"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-123f11fe-2579-9f93-b3d0-cf606acd0ff1"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-8c191b0a-1cc6-97f9-ac32-a576d3870155"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-b3ab8754-7f3d-9007-b77e-1e19b804f4e1"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d2e4f75f-1eb7-9a3b-9d82-e471c2ef883b","request_id":"d2e4f75f-1eb7-9a3b-9d82-e471c2ef883b"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-34bf87aa-ea10-9290-ad62-831b54031c1f","request_id":"34bf87aa-ea10-9290-ad62-831b54031c1f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-34752d2e-255a-92f9-a872-4fcc1c2bfcdd","request_id":"34752d2e-255a-92f9-a872-4fcc1c2bfcdd"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-00c46a2c-b412-9902-850d-e101d6520c0e","request_id":"00c46a2c-b412-9902-850d-e101d6520c0e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1fa377ac-7c6a-9d63-83c2-876fa4ac9918","request_id":"1fa377ac-7c6a-9d63-83c2-876fa4ac9918"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a6de0b6e-e07e-96cf-87d0-5c98a5175909","request_id":"a6de0b6e-e07e-96cf-87d0-5c98a5175909"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-2b575303-2956-9417-be19-895982b4a5e3","request_id":"2b575303-2956-9417-be19-895982b4a5e3"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6a7111b5-53b7-97d3-87ed-0af9ad6afc94","request_id":"6a7111b5-53b7-97d3-87ed-0af9ad6afc94"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d4118344-d122-9004-b07d-042ce130faa9","request_id":"d4118344-d122-9004-b07d-042ce130faa9"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-0a1b6397-1bfc-9a57-9c95-518829f2ee86","request_id":"0a1b6397-1bfc-9a57-9c95-518829f2ee86"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Model 'tencent/hy3:none' violated the reasoning_level=none invariant: provider reported 1320 reasoning token(s)
Invalid JSON. Output: git worktree add ../feature-wt feature{ "command": "git worktree add ../feature-wt feature" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree add ../feature-wt feature
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)