Lock a worktree
Tests ability to lock a worktree to prevent modifications. Evaluates worktree-locking command knowledge.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo 'Hello' > hello.txt
  5. 05 git add hello.txt
  6. 06 git commit -m 'Initial commit'
  7. 07 git checkout -b feature
  8. 08 echo 'Feature' > feature.txt
  9. 09 git add feature.txt
  10. 10 git commit -m 'Add feature'
  11. 11 git checkout main
  12. 12 git worktree add ../feature-wt feature
Prompt
Lock the worktree at '../feature-wt' with the reason 'do not delete'. Output ONLY the git command, nothing else.
Expected
git worktree lock --reason 'do not delete' ../feature-wt

Scoped model quality, cost, API time, and token usage for worktree_usage/f010.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 267 in → 24 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
anthropic/claude-fable-5:high__json_schema PASS 100% 467 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-fable-5:low PASS 100% 262 in → 24 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
anthropic/claude-fable-5:low__json_schema PASS 100% 473 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-fable-5:max PASS 100% 271 in → 181 out (45 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-fable-5:max__json_schema PASS 100% 466 in → 178 out (46 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
anthropic/claude-fable-5:medium PASS 100% 264 in → 24 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
anthropic/claude-fable-5:medium__json_schema PASS 100% 470 in → 33 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
anthropic/claude-fable-5:xhigh PASS 100% 263 in → 28 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 477 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-haiku-4.5:high PASS 100% 251 in → 283 out (229 reasoning)
``` git worktree lock ../feature-wt --reason 'do not delete' ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 413 in → 209 out (165 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
anthropic/claude-haiku-4.5:low PASS 100% 250 in → 180 out (139 reasoning)
``` git worktree lock ../feature-wt --reason 'do not delete' ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 413 in → 242 out (206 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
anthropic/claude-haiku-4.5:medium PASS 100% 253 in → 168 out (126 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 414 in → 746 out (540 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-haiku-4.5:none PASS 100% 222 in → 25 out (0 reasoning)
``` git worktree lock ../feature-wt --reason 'do not delete' ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 380 in → 26 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 255 in → 150 out (110 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 404 in → 498 out (440 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
anthropic/claude-opus-4.6:high PASS 100% 220 in → 24 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 387 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.6:low PASS 100% 224 in → 24 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 384 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.6:max PASS 100% 218 in → 25 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 383 in → 65 out (21 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
anthropic/claude-opus-4.6:medium PASS 100% 221 in → 24 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 391 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.6:none PASS 100% 220 in → 24 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 377 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.6:xhigh PASS 100% 227 in → 24 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 376 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.7:high PASS 100% 271 in → 29 out (0 reasoning)
`git worktree lock --reason 'do not delete' ../feature-wt`
anthropic/claude-opus-4.7:high__json_schema PASS 100% 480 in → 34 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.7:low PASS 100% 262 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
anthropic/claude-opus-4.7:low__json_schema PASS 100% 482 in → 34 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.7:max PASS 100% 259 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
anthropic/claude-opus-4.7:max__json_schema PASS 100% 487 in → 34 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.7:medium PASS 100% 264 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 478 in → 34 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.7:none PASS 100% 271 in → 31 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-opus-4.7:none__json_schema PASS 100% 475 in → 34 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.7:xhigh PASS 100% 266 in → 26 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 483 in → 34 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.8:high PASS 100% 258 in → 29 out (0 reasoning)
``` git worktree lock --reason 'do not delete' ../feature-wt ```
anthropic/claude-opus-4.8:high__json_schema PASS 100% 480 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.8:low PASS 100% 261 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
anthropic/claude-opus-4.8:low__json_schema PASS 100% 473 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.8:max PASS 100% 269 in → 122 out (26 reasoning)
``` git worktree lock --reason 'do not delete' ../feature-wt ```
anthropic/claude-opus-4.8:max__json_schema PASS 100% 472 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.8:medium PASS 100% 259 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 467 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.8:none PASS 100% 260 in → 29 out (0 reasoning)
``` git worktree lock --reason 'do not delete' ../feature-wt ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 475 in → 31 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-opus-4.8:xhigh PASS 100% 266 in → 29 out (0 reasoning)
``` git worktree lock --reason 'do not delete' ../feature-wt ```
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 476 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-4.6:high PASS 100% 221 in → 23 out (0 reasoning)
`git worktree lock ../feature-wt --reason 'do not delete'`
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 384 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-4.6:low PASS 100% 212 in → 23 out (0 reasoning)
`git worktree lock ../feature-wt --reason 'do not delete'`
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 384 in → 25 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
anthropic/claude-sonnet-4.6:max PASS 100% 222 in → 111 out (63 reasoning)
`git worktree lock --reason 'do not delete' ../feature-wt`
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 385 in → 119 out (69 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-4.6:medium PASS 100% 217 in → 23 out (0 reasoning)
`git worktree lock ../feature-wt --reason 'do not delete'`
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 382 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-4.6:none PASS 100% 218 in → 23 out (0 reasoning)
`git worktree lock ../feature-wt --reason 'do not delete'`
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 382 in → 25 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 219 in → 23 out (0 reasoning)
`git worktree lock ../feature-wt --reason 'do not delete'`
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 389 in → 25 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-5:high PASS 100% 263 in → 28 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 468 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-5:low PASS 100% 262 in → 28 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-sonnet-5:low__json_schema PASS 100% 471 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-5:medium PASS 100% 267 in → 28 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 472 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-5:none PASS 100% 264 in → 24 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
anthropic/claude-sonnet-5:none__json_schema PASS 100% 474 in → 31 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
anthropic/claude-sonnet-5:xhigh PASS 100% 259 in → 28 out (0 reasoning)
``` git worktree lock --reason "do not delete" ../feature-wt ```
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 477 in → 32 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
arcee-ai/trinity-large-thinking:high PASS 100% 184 in → 778 out (778 reasoning)
git worktree lock --reason 'do not delete' '../feature-wt'
arcee-ai/trinity-large-thinking:low PASS 100% 185 in → 688 out (682 reasoning)
git worktree lock --reason='do not delete' ../feature-wt
arcee-ai/trinity-large-thinking:medium PASS 100% 190 in → 1,787 out (1,809 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
arcee-ai/trinity-large-thinking:xhigh PASS 100% 186 in → 556 out (555 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
arcee-ai/trinity-mini:xhigh__json_schema PASS 100% 185 in → 393 out (415 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
deepseek/deepseek-v4-flash-0731:high PASS 100% 273 in → 188 out (172 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 194 in → 222 out (209 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
deepseek/deepseek-v4-flash-0731:low PASS 100% 200 in → 152 out (135 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 196 in → 151 out (130 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
deepseek/deepseek-v4-flash-0731:max PASS 100% 275 in → 265 out (252 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 274 in → 138 out (119 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
deepseek/deepseek-v4-flash-0731:medium PASS 100% 192 in → 195 out (179 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 189 in → 154 out (130 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
deepseek/deepseek-v4-flash-0731:none PASS 100% 188 in → 15 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 191 in → 20 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 274 in → 122 out (107 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 194 in → 156 out (134 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason \"do not delete\""}
deepseek/deepseek-v4-flash:high PASS 100% 199 in → 82 out (65 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
deepseek/deepseek-v4-flash:low PASS 100% 192 in → 177 out (159 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
deepseek/deepseek-v4-flash:low__json_schema PASS 100% 200 in → 166 out (143 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
deepseek/deepseek-v4-flash:medium PASS 100% 191 in → 90 out (72 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
deepseek/deepseek-v4-flash:medium__json_schema PASS 100% 191 in → 98 out (75 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
deepseek/deepseek-v4-flash:none PASS 100% 191 in → 15 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 183 in → 22 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
deepseek/deepseek-v4-flash:xhigh PASS 100% 273 in → 253 out (234 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
deepseek/deepseek-v4-pro:high PASS 100% 191 in → 476 out (459 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 387 in → 225 out (203 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 192 in → 21 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
deepseek/deepseek-v4-pro:medium PASS 100% 192 in → 384 out (367 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 380 in → 156 out (134 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' ../feature-wt"}
deepseek/deepseek-v4-pro:none PASS 100% 195 in → 16 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 382 in → 21 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 267 in → 524 out (506 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 454 in → 932 out (910 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3-flash-preview:high PASS 100% 241 in → 155 out (140 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3-flash-preview:high__json_schema PASS 100% 301 in → 251 out (231 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3-flash-preview:low PASS 100% 240 in → 182 out (167 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
google/gemini-3-flash-preview:low__json_schema PASS 100% 298 in → 261 out (242 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason \"do not delete\""}
google/gemini-3-flash-preview:medium PASS 100% 240 in → 132 out (117 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3-flash-preview:medium__json_schema PASS 100% 236 in → 376 out (356 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
google/gemini-3-flash-preview:xhigh PASS 100% 240 in → 173 out (158 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 244 in → 350 out (331 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 232 in → 333 out (318 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 240 in → 476 out (456 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
google/gemini-3.1-flash-lite-preview:low PASS 100% 238 in → 125 out (110 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 299 in → 138 out (118 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
google/gemini-3.1-flash-lite-preview:medium PASS 100% 236 in → 156 out (141 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 240 in → 205 out (185 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 242 in → 251 out (236 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 245 in → 302 out (277 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
google/gemini-3.1-pro-preview:high PASS 100% 240 in → 319 out (304 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 298 in → 407 out (388 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.1-pro-preview:low PASS 100% 241 in → 129 out (114 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 291 in → 214 out (195 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.1-pro-preview:medium PASS 100% 241 in → 297 out (282 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 296 in → 98 out (78 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 246 in → 319 out (304 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 295 in → 265 out (246 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.5-flash-lite:high PASS 100% 240 in → 216 out (201 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 295 in → 394 out (374 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
google/gemini-3.5-flash-lite:low PASS 100% 236 in → 15 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 297 in → 25 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
google/gemini-3.5-flash-lite:max PASS 100% 241 in → 281 out (266 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 242 in → 451 out (427 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
google/gemini-3.5-flash-lite:medium PASS 100% 240 in → 148 out (133 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 300 in → 233 out (208 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
google/gemini-3.5-flash-lite:xhigh PASS 100% 244 in → 175 out (160 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 246 in → 454 out (434 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
google/gemini-3.5-flash:high PASS 100% 238 in → 241 out (226 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
google/gemini-3.5-flash:high__json_schema PASS 100% 301 in → 356 out (336 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.5-flash:low PASS 100% 240 in → 104 out (89 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
google/gemini-3.5-flash:low__json_schema PASS 100% 298 in → 77 out (57 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
google/gemini-3.5-flash:medium PASS 100% 232 in → 254 out (239 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
google/gemini-3.5-flash:medium__json_schema PASS 100% 297 in → 358 out (339 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.5-flash:xhigh PASS 100% 243 in → 636 out (621 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 300 in → 244 out (224 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.6-flash:high PASS 100% 244 in → 271 out (256 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
google/gemini-3.6-flash:high__json_schema PASS 100% 241 in → 496 out (476 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.6-flash:low PASS 100% 247 in → 96 out (81 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
google/gemini-3.6-flash:low__json_schema PASS 100% 235 in → 25 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
google/gemini-3.6-flash:max PASS 100% 235 in → 235 out (220 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
google/gemini-3.6-flash:max__json_schema PASS 100% 234 in → 432 out (413 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.6-flash:medium PASS 100% 243 in → 233 out (218 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
google/gemini-3.6-flash:medium__json_schema PASS 100% 237 in → 172 out (153 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
google/gemini-3.6-flash:xhigh PASS 100% 242 in → 350 out (335 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 293 in → 517 out (498 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
google/gemma-4-26b-a4b-it:high PASS 100% 253 in → 275 out (239 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
google/gemma-4-26b-a4b-it:low PASS 100% 254 in → 376 out (267 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
google/gemma-4-26b-a4b-it:medium PASS 100% 262 in → 487 out (402 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemma-4-26b-a4b-it:none PASS 100% 249 in → 16 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemma-4-26b-a4b-it:none__json_schema PASS 100% 256 in → 22 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 258 in → 375 out (259 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
google/gemma-4-31b-it:high PASS 100% 250 in → 188 out (146 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
google/gemma-4-31b-it:high__json_schema PASS 100% 259 in → 199 out (150 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
google/gemma-4-31b-it:low PASS 100% 255 in → 139 out (109 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
google/gemma-4-31b-it:medium PASS 100% 254 in → 150 out (116 reasoning)
git worktree lock ../feature-wt --reason="do not delete"
google/gemma-4-31b-it:xhigh PASS 100% 259 in → 168 out (152 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 251 in → 144 out (104 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
ibm-granite/granite-4.1-8b PASS 100% 215 in → 16 out
git worktree lock ../feature-wt --reason "do not delete"
ibm-granite/granite-4.1-8b__json_schema PASS 100% 210 in → 26 out
git worktree lock '../feature-wt' --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock '../feature-wt' --reason 'do not delete'" }
inclusionai/ling-2.6-flash PASS 100% 245 in → 16 out
git worktree lock ../feature-wt --reason "do not delete"
inclusionai/ling-2.6-flash__json_schema PASS 100% 246 in → 26 out
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
minimax/minimax-m2.5:high PASS 100% 219 in → 180 out (164 reasoning)
git worktree lock ../feature-wt --reason="do not delete"
minimax/minimax-m2.5:high__json_schema PASS 100% 216 in → 356 out (333 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
minimax/minimax-m2.5:low PASS 100% 217 in → 135 out (118 reasoning)
git worktree lock ../feature-wt --reason="do not delete"
minimax/minimax-m2.5:low__json_schema PASS 100% 219 in → 300 out (276 reasoning)
git worktree lock ../feature-wt --reason="do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason=\"do not delete\"" }
minimax/minimax-m2.5:medium PASS 100% 218 in → 218 out (181 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
minimax/minimax-m2.5:medium__json_schema PASS 100% 220 in → 342 out (346 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
minimax/minimax-m2.5:xhigh PASS 100% 210 in → 130 out (114 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 240 in → 200 out (170 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
minimax/minimax-m2.7:high PASS 100% 218 in → 286 out (270 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
minimax/minimax-m2.7:high__json_schema PASS 100% 216 in → 20 out (20 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
minimax/minimax-m2.7:low PASS 100% 215 in → 378 out (360 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
minimax/minimax-m2.7:low__json_schema PASS 100% 356 in → 521 out (496 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
minimax/minimax-m2.7:medium PASS 100% 215 in → 328 out (349 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
minimax/minimax-m2.7:medium__json_schema PASS 100% 350 in → 647 out (626 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
minimax/minimax-m2.7:xhigh PASS 100% 217 in → 1,072 out (1,054 reasoning)
git worktree lock "../feature-wt" --reason "do not delete"
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 351 in → 298 out (272 reasoning)
git worktree lock '../feature-wt' --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock '../feature-wt' --reason \"do not delete\"" }
minimax/minimax-m3:high PASS 100% 357 in → 50 out (35 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
minimax/minimax-m3:high__json_schema PASS 100% 348 in → 22 out (0 reasoning)
git worktree lock --reason 'do not delete' '../feature-wt'
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' '../feature-wt'"}
minimax/minimax-m3:low PASS 100% 301 in → 172 out (155 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
minimax/minimax-m3:low__json_schema PASS 100% 346 in → 21 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
minimax/minimax-m3:medium PASS 100% 356 in → 60 out (46 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
minimax/minimax-m3:medium__json_schema PASS 100% 349 in → 22 out (0 reasoning)
git worktree lock --reason 'do not delete' '../feature-wt'
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason 'do not delete' '../feature-wt'"}
minimax/minimax-m3:xhigh PASS 100% 349 in → 56 out (40 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
minimax/minimax-m3:xhigh__json_schema PASS 100% 304 in → 24 out (22 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
mistralai/devstral-2512 PASS 100% 244 in → 21 out
```sh git worktree lock --reason "do not delete" ../feature-wt ```
mistralai/devstral-2512__json_schema PASS 100% 239 in → 21 out
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
mistralai/mistral-medium-3-5:high PASS 100% 257 in → 618 out (641 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 241 in → 153 out (143 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
mistralai/mistral-medium-3-5:low PASS 100% 253 in → 646 out (658 reasoning)
git worktree lock --reason 'do not delete' '../feature-wt'
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 236 in → 526 out (553 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
mistralai/mistral-medium-3-5:medium PASS 100% 251 in → 795 out (831 reasoning)
git worktree lock --reason 'do not delete' '../feature-wt'
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 237 in → 618 out (607 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock '../feature-wt' --reason 'do not delete'"}
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 243 in → 22 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
mistralai/mistral-medium-3-5:xhigh PASS 100% 254 in → 2,542 out (2,809 reasoning)
git worktree lock --reason 'do not delete' '../feature-wt'
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 240 in → 358 out (341 reasoning)
git worktree lock --reason "do not delete" '../feature-wt'
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" '../feature-wt'"}
moonshotai/kimi-k2.6:high PASS 100% 174 in → 275 out (271 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k2.6:high__json_schema PASS 100% 176 in → 713 out (571 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
moonshotai/kimi-k2.6:low PASS 100% 184 in → 405 out (388 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k2.6:low__json_schema PASS 100% 182 in → 99 out (0 reasoning)
cd /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_mx1w34b9/worktree_usage_f010 && git worktree lock --reason 'do not delete' /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_mx1w34b9/feature-wt
JSON Schema Structured Output
(raw) {"command": "cd /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_mx1w34b9/worktree_usage_f010 && git worktree lock --reason 'do not delete' /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_mx1w34b9/feature-wt"}
moonshotai/kimi-k2.6:medium PASS 100% 178 in → 1,159 out (1,301 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
moonshotai/kimi-k2.6:xhigh PASS 100% 178 in → 206 out (191 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k2.6:xhigh__json_schema PASS 100% 182 in → 347 out (327 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
moonshotai/kimi-k2.7-code:high PASS 100% 179 in → 120 out (103 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 185 in → 115 out (93 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
moonshotai/kimi-k2.7-code:low PASS 100% 179 in → 111 out (94 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 266 in → 145 out (124 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
moonshotai/kimi-k2.7-code:medium PASS 100% 179 in → 78 out (61 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 185 in → 112 out (87 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
moonshotai/kimi-k2.7-code:xhigh PASS 100% 182 in → 112 out (104 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 263 in → 165 out (143 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
moonshotai/kimi-k3:high PASS 100% 260 in → 142 out (112 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k3:high__json_schema PASS 100% 253 in → 85 out (55 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k3:low PASS 100% 254 in → 83 out (53 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k3:low__json_schema PASS 100% 253 in → 137 out (107 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
moonshotai/kimi-k3:max PASS 100% 258 in → 78 out (48 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
moonshotai/kimi-k3:max__json_schema PASS 100% 254 in → 96 out (66 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k3:medium PASS 100% 261 in → 163 out (133 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
moonshotai/kimi-k3:medium__json_schema PASS 100% 349 in → 79 out (44 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
moonshotai/kimi-k3:xhigh PASS 100% 259 in → 97 out (67 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 260 in → 151 out (121 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 258 in → 353 out (343 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 250 in → 503 out (479 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 258 in → 209 out (202 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
nvidia/nemotron-3-nano-30b-a3b:low__json_schema PASS 100% 253 in → 408 out (398 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 256 in → 464 out (476 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 259 in → 419 out (385 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
nvidia/nemotron-3-nano-30b-a3b:none__json_schema PASS 100% 249 in → 23 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 254 in → 429 out (429 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 257 in → 296 out (282 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock '../feature-wt' --reason 'do not delete'" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 248 in → 139 out (122 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 257 in → 216 out (176 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 263 in → 210 out (178 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 250 in → 153 out (128 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 250 in → 149 out (139 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 256 in → 194 out (154 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 253 in → 16 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 253 in → 24 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 256 in → 174 out (153 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 252 in → 237 out (206 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
openai/gpt-5.4-mini:high PASS 100% 188 in → 188 out (167 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.4-mini:high__json_schema PASS 100% 219 in → 157 out (128 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.4-mini:low PASS 100% 188 in → 111 out (90 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.4-mini:low__json_schema PASS 100% 233 in → 64 out (35 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason \"do not delete\""}
openai/gpt-5.4-mini:medium PASS 100% 185 in → 137 out (116 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
openai/gpt-5.4-mini:medium__json_schema PASS 100% 217 in → 192 out (163 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.4-mini:xhigh PASS 100% 200 in → 5,717 out (5,696 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 222 in → 545 out (516 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.4-nano:high PASS 100% 184 in → 19 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
openai/gpt-5.4-nano:high__json_schema PASS 100% 224 in → 71 out (0 reasoning)
git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_k59g8ln5/worktree_usage_f010 worktree lock --reason "do not delete" feature-wt
JSON Schema Structured Output
(raw) {"command":"git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_k59g8ln5/worktree_usage_f010 worktree lock --reason \"do not delete\" feature-wt"}
openai/gpt-5.4-nano:low PASS 100% 180 in → 19 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 222 in → 997 out (968 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.4:high PASS 100% 189 in → 120 out (99 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.4:high__json_schema PASS 100% 222 in → 133 out (104 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.4:low PASS 100% 188 in → 69 out (48 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.4:low__json_schema PASS 100% 227 in → 77 out (48 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.4:medium PASS 100% 191 in → 116 out (95 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.4:medium__json_schema PASS 100% 229 in → 135 out (106 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.4:none PASS 100% 185 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.4:none__json_schema PASS 100% 223 in → 27 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.4:xhigh PASS 100% 190 in → 216 out (195 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.4:xhigh__json_schema PASS 100% 219 in → 545 out (516 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.5:high PASS 100% 189 in → 81 out (60 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.5:high__json_schema PASS 100% 223 in → 114 out (85 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.5:low PASS 100% 191 in → 57 out (36 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.5:low__json_schema PASS 100% 224 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.5:medium PASS 100% 189 in → 65 out (44 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.5:medium__json_schema PASS 100% 219 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.5:none PASS 100% 195 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.5:none__json_schema PASS 100% 217 in → 27 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.5:xhigh PASS 100% 188 in → 148 out (127 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.5:xhigh__json_schema PASS 100% 221 in → 155 out (126 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.6-luna:high PASS 100% 188 in → 83 out (62 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-luna:high__json_schema PASS 100% 221 in → 96 out (67 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.6-luna:low PASS 100% 187 in → 63 out (42 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
openai/gpt-5.6-luna:max PASS 100% 193 in → 87 out (66 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-luna:max__json_schema PASS 100% 224 in → 280 out (251 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.6-luna:medium PASS 100% 194 in → 108 out (87 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-luna:medium__json_schema PASS 100% 239 in → 64 out (35 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-luna:none PASS 100% 190 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-luna:none__json_schema PASS 100% 226 in → 27 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.6-luna:xhigh PASS 100% 185 in → 109 out (88 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 232 in → 100 out (71 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-sol:high PASS 100% 185 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-sol:high__json_schema PASS 100% 228 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-sol:low PASS 100% 192 in → 19 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.6-sol:low__json_schema PASS 100% 225 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-sol:max PASS 100% 190 in → 74 out (53 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.6-sol:max__json_schema PASS 100% 226 in → 168 out (139 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-sol:medium PASS 100% 188 in → 19 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.6-sol:medium__json_schema PASS 100% 219 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-sol:none PASS 100% 191 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-sol:none__json_schema PASS 100% 229 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-sol:xhigh PASS 100% 189 in → 19 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 224 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-terra:high PASS 100% 183 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-terra:high__json_schema PASS 100% 228 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-5.6-terra:low PASS 100% 183 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-terra:low__json_schema PASS 100% 231 in → 27 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.6-terra:max PASS 100% 188 in → 113 out (92 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-terra:max__json_schema PASS 100% 224 in → 157 out (128 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.6-terra:medium PASS 100% 182 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-terra:medium__json_schema PASS 100% 222 in → 27 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.6-terra:none PASS 100% 182 in → 19 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-terra:none__json_schema PASS 100% 221 in → 27 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-5.6-terra:xhigh PASS 100% 186 in → 98 out (77 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 224 in → 27 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
openai/gpt-oss-120b:high PASS 100% 236 in → 627 out (609 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-oss-120b:high__json_schema PASS 100% 235 in → 643 out (619 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-oss-120b:medium PASS 100% 251 in → 216 out (208 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
openai/gpt-oss-120b:medium__json_schema PASS 100% 248 in → 406 out (374 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason \"do not delete\" ../feature-wt"}
openai/gpt-oss-120b:xhigh PASS 100% 237 in → 537 out (555 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 247 in → 501 out (469 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason \"do not delete\""}
openai/gpt-oss-20b:high PASS 100% 244 in → 3,058 out (3,069 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
openai/gpt-oss-20b:high__json_schema PASS 100% 253 in → 572 out (556 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
openai/gpt-oss-20b:low PASS 100% 245 in → 41 out (16 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-oss-20b:medium PASS 100% 250 in → 450 out (421 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
openai/gpt-oss-20b:medium__json_schema PASS 100% 231 in → 160 out (130 reasoning)
git worktree lock ../feature-wt --reason="do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason=\"do not delete\"" }
openai/gpt-oss-20b:xhigh PASS 100% 249 in → 522 out (433 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 257 in → 594 out (593 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
poolside/laguna-m.1:high PASS 100% 227 in → 658 out (640 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
poolside/laguna-m.1:high__json_schema PASS 100% 228 in → 228 out (204 reasoning)
git worktree lock ../feature-wt --reason="do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason=\"do not delete\"" }
poolside/laguna-m.1:low PASS 100% 228 in → 291 out (272 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
poolside/laguna-m.1:low__json_schema PASS 100% 232 in → 324 out (302 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
poolside/laguna-m.1:medium PASS 100% 228 in → 392 out (374 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
poolside/laguna-m.1:none PASS 100% 229 in → 17 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
poolside/laguna-xs-2.1:high PASS 100% 229 in → 329 out (314 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
poolside/laguna-xs-2.1:high__json_schema PASS 100% 235 in → 493 out (472 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
poolside/laguna-xs-2.1:low PASS 100% 233 in → 354 out (338 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
poolside/laguna-xs-2.1:low__json_schema PASS 100% 234 in → 635 out (615 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
poolside/laguna-xs-2.1:medium PASS 100% 237 in → 301 out (286 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 231 in → 418 out (392 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
poolside/laguna-xs-2.1:none PASS 100% 236 in → 32 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete" </think>git worktree lock ../feature-wt --reason "do not delete"
poolside/laguna-xs-2.1:xhigh PASS 100% 236 in → 442 out (427 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 222 in → 379 out (358 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
poolside/laguna-xs.2:high PASS 100% 266 in → 113 out (96 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
poolside/laguna-xs.2:low PASS 100% 269 in → 553 out (536 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
poolside/laguna-xs.2:low__json_schema PASS 100% 265 in → 193 out (172 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
poolside/laguna-xs.2:none PASS 100% 270 in → 17 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
poolside/laguna-xs.2:xhigh PASS 100% 266 in → 96 out (78 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 266 in → 350 out (329 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
qwen/qwen3.6-27b:low PASS 100% 240 in → 752 out (726 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.6-27b:medium__json_schema PASS 100% 241 in → 1,235 out (1 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason 'do not delete' ../feature-wt" }
qwen/qwen3.6-27b:none PASS 100% 240 in → 16 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
qwen/qwen3.6-35b-a3b:high PASS 100% 237 in → 578 out (558 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 242 in → 1,052 out (997 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
qwen/qwen3.6-35b-a3b:low PASS 100% 235 in → 1,314 out (1,233 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 235 in → 312 out (270 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 236 in → 1,075 out (989 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 236 in → 1,256 out (1,184 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock '../feature-wt' --reason 'do not delete'" }
qwen/qwen3.6-35b-a3b:none PASS 100% 239 in → 16 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 242 in → 1,428 out (1,408 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 241 in → 1,047 out (998 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
qwen/qwen3.6-flash:high PASS 100% 237 in → 265 out (245 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
qwen/qwen3.6-flash:medium PASS 100% 233 in → 1,235 out (1,215 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.6-flash:xhigh PASS 100% 242 in → 813 out (792 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
qwen/qwen3.7-flash:high PASS 100% 237 in → 779 out (758 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
qwen/qwen3.7-flash:low PASS 100% 235 in → 1,313 out (1,293 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.7-flash:max PASS 100% 235 in → 1,369 out (1,349 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.7-flash:medium PASS 100% 237 in → 854 out (834 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
qwen/qwen3.7-flash:xhigh PASS 100% 237 in → 972 out (952 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
qwen/qwen3.7-max:high PASS 100% 238 in → 193 out (173 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
qwen/qwen3.7-max:low PASS 100% 232 in → 619 out (599 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
qwen/qwen3.7-max:medium PASS 100% 241 in → 298 out (278 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
qwen/qwen3.7-max:none PASS 100% 241 in → 15 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
qwen/qwen3.7-max:xhigh PASS 100% 238 in → 935 out (915 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
qwen/qwen3.7-plus:high PASS 100% 242 in → 494 out (474 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
qwen/qwen3.7-plus:low PASS 100% 241 in → 895 out (875 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
qwen/qwen3.7-plus:medium PASS 100% 242 in → 337 out (317 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
qwen/qwen3.7-plus:none PASS 100% 236 in → 15 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
qwen/qwen3.7-plus:xhigh PASS 100% 240 in → 565 out (545 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
tencent/hy3:high PASS 100% 203 in → 385 out (368 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
tencent/hy3:high__json_schema PASS 100% 193 in → 876 out (859 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
tencent/hy3:low PASS 100% 200 in → 258 out (241 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
tencent/hy3:medium PASS 100% 193 in → 279 out (264 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
tencent/hy3:medium__json_schema PASS 100% 194 in → 298 out (257 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason \"do not delete\"" }
tencent/hy3:none PASS 100% 205 in → 16 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
tencent/hy3:none__json_schema PASS 100% 198 in → 22 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
tencent/hy3:xhigh PASS 100% 197 in → 693 out (676 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
tencent/hy3:xhigh__json_schema PASS 100% 198 in → 604 out (589 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
thinkingmachines/inkling-small:high PASS 100% 193 in → 140 out (126 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
thinkingmachines/inkling-small:high__json_schema PASS 100% 198 in → 181 out (154 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
thinkingmachines/inkling-small:low PASS 100% 198 in → 43 out (23 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
thinkingmachines/inkling-small:low__json_schema PASS 100% 193 in → 47 out (22 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock --reason \"do not delete\" ../feature-wt"}
thinkingmachines/inkling-small:max PASS 100% 194 in → 144 out (131 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
thinkingmachines/inkling-small:max__json_schema PASS 100% 197 in → 139 out (114 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
thinkingmachines/inkling-small:medium PASS 100% 191 in → 152 out (133 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
thinkingmachines/inkling-small:medium__json_schema PASS 100% 192 in → 170 out (142 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason 'do not delete' ../feature-wt" }
thinkingmachines/inkling-small:xhigh PASS 100% 189 in → 120 out (99 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 198 in → 123 out (96 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
thinkingmachines/inkling:high PASS 100% 196 in → 125 out (109 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
thinkingmachines/inkling:low PASS 100% 193 in → 39 out (18 reasoning)
git worktree lock --reason "do not delete" ../feature-wt
thinkingmachines/inkling:low__json_schema PASS 100% 193 in → 46 out (20 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt --reason 'do not delete'" }
thinkingmachines/inkling:max PASS 100% 194 in → 83 out (67 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
thinkingmachines/inkling:medium PASS 100% 200 in → 85 out (63 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
thinkingmachines/inkling:xhigh PASS 100% 191 in → 86 out (65 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
thinkingmachines/inkling:xhigh__json_schema PASS 100% 199 in → 140 out (110 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason 'do not delete' ../feature-wt" }
x-ai/grok-4.3:high PASS 100% 354 in → 268 out (253 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
x-ai/grok-4.3:high__json_schema PASS 100% 417 in → 447 out (428 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
x-ai/grok-4.3:low PASS 100% 364 in → 280 out (265 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
x-ai/grok-4.3:low__json_schema PASS 100% 422 in → 266 out (243 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason 'do not delete' ../feature-wt" }
x-ai/grok-4.3:max PASS 100% 355 in → 203 out (188 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
x-ai/grok-4.3:max__json_schema PASS 100% 410 in → 515 out (496 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
x-ai/grok-4.3:medium PASS 100% 356 in → 651 out (636 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
x-ai/grok-4.3:medium__json_schema PASS 100% 419 in → 435 out (416 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
x-ai/grok-4.3:none PASS 100% 353 in → 15 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
x-ai/grok-4.3:none__json_schema PASS 100% 411 in → 19 out (0 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
x-ai/grok-4.3:xhigh PASS 100% 360 in → 223 out (208 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
x-ai/grok-4.3:xhigh__json_schema PASS 100% 414 in → 626 out (607 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
x-ai/grok-4.5:high PASS 100% 400 in → 183 out (165 reasoning)
``` git worktree lock ../feature-wt --reason 'do not delete' ```
x-ai/grok-4.5:high__json_schema PASS 100% 463 in → 542 out (522 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
x-ai/grok-4.5:low PASS 100% 402 in → 131 out (112 reasoning)
``` git worktree lock --reason 'do not delete' ../feature-wt ```
x-ai/grok-4.5:low__json_schema PASS 100% 464 in → 200 out (180 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
x-ai/grok-4.5:max PASS 100% 402 in → 250 out (231 reasoning)
``` git worktree lock --reason 'do not delete' ../feature-wt ```
x-ai/grok-4.5:max__json_schema PASS 100% 465 in → 220 out (200 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' ../feature-wt"}
x-ai/grok-4.5:medium PASS 100% 404 in → 431 out (412 reasoning)
```git git worktree lock ../feature-wt --reason 'do not delete' ```
x-ai/grok-4.5:medium__json_schema PASS 100% 462 in → 267 out (246 reasoning)
git worktree lock --reason 'do not delete' '../feature-wt'
JSON Schema Structured Output
(raw) {"command":"git worktree lock --reason 'do not delete' '../feature-wt'"}
x-ai/grok-4.5:xhigh PASS 100% 399 in → 209 out (189 reasoning)
```git git worktree lock --reason 'do not delete' '../feature-wt' ```
x-ai/grok-4.5:xhigh__json_schema PASS 100% 466 in → 380 out (360 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
z-ai/glm-4.7-flash:high PASS 100% 202 in → 387 out (355 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
z-ai/glm-4.7-flash:high__json_schema PASS 100% 200 in → 313 out (282 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
z-ai/glm-4.7-flash:low PASS 100% 198 in → 280 out (250 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
z-ai/glm-4.7-flash:low__json_schema PASS 100% 197 in → 311 out (278 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
z-ai/glm-4.7-flash:medium PASS 100% 195 in → 303 out (267 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
z-ai/glm-4.7-flash:medium__json_schema PASS 100% 194 in → 309 out (270 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
z-ai/glm-4.7-flash:none PASS 100% 201 in → 16 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
z-ai/glm-4.7-flash:none__json_schema PASS 100% 195 in → 21 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason \"do not delete\""}
z-ai/glm-4.7-flash:xhigh PASS 100% 200 in → 270 out (236 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
z-ai/glm-5.2:high PASS 100% 209 in → 298 out (283 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
z-ai/glm-5.2:high__json_schema PASS 100% 202 in → 347 out (325 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt --reason 'do not delete'"}
z-ai/glm-5.2:low PASS 100% 198 in → 84 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
z-ai/glm-5.2:low__json_schema PASS 100% 383 in → 218 out (197 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason \"do not delete\""}
z-ai/glm-5.2:medium PASS 100% 200 in → 226 out (0 reasoning)
git worktree lock ../feature-wt --reason "do not delete"
z-ai/glm-5.2:medium__json_schema PASS 100% 208 in → 159 out (135 reasoning)
git worktree lock --reason 'do not delete' ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock --reason 'do not delete' ../feature-wt" }
z-ai/glm-5.2:none PASS 100% 197 in → 16 out (0 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
z-ai/glm-5.2:none__json_schema PASS 100% 376 in → 20 out (0 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --reason 'do not delete'"}
z-ai/glm-5.2:xhigh PASS 100% 197 in → 445 out (428 reasoning)
git worktree lock ../feature-wt --reason 'do not delete'
z-ai/glm-5.2:xhigh__json_schema PASS 100% 204 in → 403 out (380 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock '../feature-wt' --reason 'do not delete'"}
arcee-ai/trinity-mini:high FAIL 50% 184 in → 348 out (371 reasoning)
git worktree lock ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
arcee-ai/trinity-mini:high__json_schema FAIL 50% 181 in → 524 out (544 reasoning)
git worktree lock ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
arcee-ai/trinity-mini:low__json_schema FAIL 50% 186 in → 330 out (353 reasoning)
git worktree lock ../feature-wt
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
arcee-ai/trinity-mini:medium FAIL 50% 182 in → 361 out (391 reasoning)
git worktree lock ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
google/gemma-4-31b-it:low__json_schema FAIL 50% 256 in → 1,220 out (1,164 reasoning)
git worktree lock ../feature-wt
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
google/gemma-4-31b-it:medium__json_schema FAIL 50% 264 in → 1,070 out (1,056 reasoning)
git worktree lock ../feature-wt
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
arcee-ai/trinity-mini:low FAIL 0% 194 in → 357 out (372 reasoning)
git worktreelock ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
arcee-ai/trinity-mini:medium__json_schema FAIL 0% 184 in → 368 out (375 reasoning)
git worktree lock ../feature-wt "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt \"do not delete\"" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
arcee-ai/trinity-mini:xhigh FAIL 0% 173 in → 286 out (306 reasoning)
git worktree lock../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
Invalid JSON. Output: git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
deepseek/deepseek-v4-flash:xhigh__json_schema FAIL 0% 281 in → 205 out (182 reasoning)
git worktree lock ../feature-wt -r 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt -r 'do not delete'" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
deepseek/deepseek-v4-pro:low FAIL 0% 191 in → 302 out (264 reasoning)
gitworktree lock --reason "do not delete" ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
google/gemma-4-26b-a4b-it:high__json_schema FAIL 0% 259 in → 225 out (172 reasoning)
git worktree lock ../feature-wt -m 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt -m 'do not delete'"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
google/gemma-4-26b-a4b-it:low__json_schema FAIL 0% 264 in → 407 out (326 reasoning)
git worktree lock ../feature-wt -m "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt -m \"do not delete\"" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
google/gemma-4-26b-a4b-it:medium__json_schema FAIL 0% 261 in → 456 out (332 reasoning)
git worktree lock ../feature-wt -m "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt -m \"do not delete\"" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
google/gemma-4-26b-a4b-it:xhigh FAIL 0% 257 in → 284 out (268 reasoning)
git worktree lock ../feature-wt -m "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
google/gemma-4-31b-it:none FAIL 0% 255 in → 16 out (0 reasoning)
git worktree lock ../feature-wt -m "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
google/gemma-4-31b-it:none__json_schema FAIL 0% 256 in → 21 out (0 reasoning)
git worktree lock ../feature-wt --message "do not delete"
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt --message \"do not delete\""}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
liquid/lfm-2-24b-a2b FAIL 0% 210 in → 55 out
git worktree remove -f /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010__ddkwz9n/feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
Invalid JSON. Output: git worktree remove /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_oayp0z41/worktree_usage_f010 --force --no-commit --quiet --worktree /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_oayp0z41/feature-wt "do not delete"
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
mistralai/mistral-medium-3-5:none FAIL 0% 256 in → 17 out (0 reasoning)
git worktree lock '../feature-wt' -r "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
Invalid JSON. Output: git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
nvidia/nemotron-3-nano-30b-a3b:none FAIL 0% 255 in → 19 out (0 reasoning)
git worktree add --force --name feature-wt ../feature-wt do not delete
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.4-mini:none FAIL 0% 184 in → 58 out (0 reasoning)
git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_xetoa70j worktree lock --reason 'do not delete' ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.4-mini:none__json_schema FAIL 0% 226 in → 67 out (0 reasoning)
git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_cgpvbgv4/feature-wt worktree lock --reason "do not delete"
JSON Schema Structured Output
(raw) {"command":"git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_cgpvbgv4/feature-wt worktree lock --reason \"do not delete\""}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.4-nano:low__json_schema FAIL 0% 222 in → 66 out (0 reasoning)
git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_uxyfevgg/ worktree lock ../feature-wt "do not delete"
JSON Schema Structured Output
(raw) {"command":"git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_uxyfevgg/ worktree lock ../feature-wt \"do not delete\""}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.4-nano:medium FAIL 0% 186 in → 21 out (0 reasoning)
git -C ../feature-wt worktree lock --reason "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.4-nano:medium__json_schema FAIL 0% 223 in → 65 out (0 reasoning)
git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_t8h632c6 worktree lock ../feature-wt "do not delete"
JSON Schema Structured Output
(raw) {"command":"git -C /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f010_t8h632c6 worktree lock ../feature-wt \"do not delete\""}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.4-nano:none FAIL 0% 184 in → 21 out (0 reasoning)
git -C ../feature-wt worktree lock --reason "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.4-nano:none__json_schema FAIL 0% 218 in → 25 out (0 reasoning)
git worktree lock ../feature-wt "do not delete"
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt \"do not delete\""}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.4-nano:xhigh FAIL 0% 187 in → 1,408 out (1,389 reasoning)
git worktree lock ../feature-wt 'do not delete'
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-5.6-luna:low__json_schema FAIL 0% 215 in → 30 out (0 reasoning)
git -C '../feature-wt' worktree lock --reason 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git -C '../feature-wt' worktree lock --reason 'do not delete'"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-oss-120b:low FAIL 0% 252 in → 63 out (34 reasoning)
git worktree lock ../feature-wt -m "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-oss-120b:low__json_schema FAIL 0% 238 in → 76 out (43 reasoning)
git worktree lock ../feature-wt -m "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt -m \"do not delete\"" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
openai/gpt-oss-20b:low__json_schema FAIL 0% 248 in → 19 out (0 reasoning)
git worktree lock ../feature-wt -m 'do not delete'
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt -m 'do not delete'"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-m.1:medium__json_schema FAIL 0% 232 in → 355 out (337 reasoning)
git worktree lock ../feature-wt "do not delete"
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt \"do not delete\""}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-m.1:none__json_schema FAIL 0% 235 in → 21 out (0 reasoning)
git worktree lock ../feature-wt -m 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt -m 'do not delete'"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-m.1:xhigh FAIL 0% 230 in → 453 out (435 reasoning)
git worktree lock ../feature-wt -m "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-m.1:xhigh__json_schema FAIL 0% 229 in → 565 out (547 reasoning)
git worktree lock ../feature-wt "do not delete"
JSON Schema Structured Output
(raw) {"command":"git worktree lock ../feature-wt \"do not delete\""}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-xs-2.1:none__json_schema FAIL 0% 233 in → 21 out (0 reasoning)
git worktree lock ../feature-wt -m 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt -m 'do not delete'"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-xs.2:high__json_schema FAIL 0% 268 in → 492 out (473 reasoning)
git worktree lock '../feature-wt' -z 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock '../feature-wt' -z 'do not delete'"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-xs.2:medium FAIL 0% 276 in → 203 out (186 reasoning)
git worktree lock ../feature-wt -z "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-xs.2:medium__json_schema FAIL 0% 270 in → 150 out (125 reasoning)
git worktree lock ../feature-wt -m "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt -m \"do not delete\"" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
poolside/laguna-xs.2:none__json_schema FAIL 0% 273 in → 21 out (0 reasoning)
git worktree lock ../feature-wt -m 'do not delete'
JSON Schema Structured Output
(raw) {"command": "git worktree lock ../feature-wt -m 'do not delete'"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
qwen/qwen3.6-27b:high FAIL 0% 234 in → 1,274 out (1,210 reasoning)
git worktree lock ../feature-wt -m "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
qwen/qwen3.6-27b:high__json_schema FAIL 0% 239 in → 1,243 out (1,181 reasoning)
git worktree lock ../feature-wt "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt \"do not delete\"" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
qwen/qwen3.6-27b:low__json_schema FAIL 0% 237 in → 363 out (336 reasoning)
git worktree lock ../feature-wt -m "do not delete"
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt -m \"do not delete\"" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
qwen/qwen3.6-27b:medium FAIL 0% 242 in → 870 out (840 reasoning)
git worktree lock ../feature-wt -m "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
qwen/qwen3.6-27b:none__json_schema FAIL 0% 240 in → 24 out (0 reasoning)
git lock worktree '../feature-wt' -m 'do not delete'
JSON Schema Structured Output
(raw) { "command": "git lock worktree '../feature-wt' -m 'do not delete'" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
qwen/qwen3.6-27b:xhigh FAIL 0% 235 in → 1,337 out (1,239 reasoning)
git worktree lock -m "do not delete" ../feature-wt
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
qwen/qwen3.6-35b-a3b:none__json_schema FAIL 0% 237 in → 24 out (0 reasoning)
git worktree lock ../feature-wt -m do not delete
JSON Schema Structured Output
(raw) { "command": "git worktree lock ../feature-wt -m do not delete" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6132d73a-2fc6-9ae5-87ae-56de8fce3d21","request_id":"6132d73a-2fc6-9ae5-87ae-56de8fce3d21"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
qwen/qwen3.6-flash:low FAIL 0% 230 in → 929 out (909 reasoning)
git worktree lock ../feature-wt -m "do not delete"
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-dc008cf2-5ced-9644-aa61-fbd609ac9359","request_id":"dc008cf2-5ced-9644-aa61-fbd609ac9359"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-9970ec03-044d-93f5-ae9a-7d56dac87071","request_id":"9970ec03-044d-93f5-ae9a-7d56dac87071"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
qwen/qwen3.6-flash:none FAIL 0% 240 in → 13 out (0 reasoning)
git worktree lock ../feature-wt --reason do not delete
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-9a6ad402-35db-91d8-8b53-68789e25f2aa","request_id":"9a6ad402-35db-91d8-8b53-68789e25f2aa"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f830a0ea-04df-9495-a529-335dea84c3f4","request_id":"f830a0ea-04df-9495-a529-335dea84c3f4"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-deb6729c-03c7-9a66-a6ad-5463830a0dcc"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-190be4e3-adf0-932e-9b98-ba6706e2ffea"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-3ddc1ce2-007c-9ff3-9d9a-6b0b7d0bc85a"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-f3ab591d-d36b-9500-913b-dcd620287793"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
qwen/qwen3.7-flash:none FAIL 0% 244 in → 13 out (0 reasoning)
git worktree lock ../feature-wt --reason do not delete
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-39818488-36bd-9679-97b2-40a375f56a5c"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-f493391a-8d6b-9ef5-b627-cd9dc9b3f068"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-96126891-cbaa-9450-a889-d2967ea90e9e","request_id":"96126891-cbaa-9450-a889-d2967ea90e9e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-7807b758-7e58-9f05-be52-69bdcf9e495f","request_id":"7807b758-7e58-9f05-be52-69bdcf9e495f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-4d563b2e-575f-9051-9d1f-62a4c15cbe9c","request_id":"4d563b2e-575f-9051-9d1f-62a4c15cbe9c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-482ce841-7ca0-9bbf-8754-9e88ea495a8f","request_id":"482ce841-7ca0-9bbf-8754-9e88ea495a8f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-3a0eaafe-e002-9c4f-99ec-3c4212950ba6","request_id":"3a0eaafe-e002-9c4f-99ec-3c4212950ba6"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a5c49b4d-3a73-91b6-91f4-60f144e208c3","request_id":"a5c49b4d-3a73-91b6-91f4-60f144e208c3"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a03f8408-4d79-9fa0-9d3e-1ddba1bd7937","request_id":"a03f8408-4d79-9fa0-9d3e-1ddba1bd7937"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a739daa5-2308-9c0a-8c43-70d64cf508cf","request_id":"a739daa5-2308-9c0a-8c43-70d64cf508cf"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1baa0e96-7c65-9890-bc85-6211680cc5b1","request_id":"1baa0e96-7c65-9890-bc85-6211680cc5b1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-7e3bf796-63a2-90cc-b229-9fa52b787ae7","request_id":"7e3bf796-63a2-90cc-b229-9fa52b787ae7"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: OpenAI-compatible response contained provider error: Provider returned error
thinkingmachines/inkling-small:none FAIL 0% 192 in → 19 out (0 reasoning)
git worktree lock '../feature-wt' --reason 'do not delete'<|end_message|>
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
Invalid JSON. Output: git worktree lock '../feature-wt' --reason 'do not delete'{"command": "git worktree lock '../feature-wt' --reason 'do not delete'"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree lock --reason "do not delete" ../feature-wt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree lock ../feature-wt --reason "do not delete"
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
thinkingmachines/inkling:none FAIL 0% 199 in → 18 out (0 reasoning)
git worktree lock --reason "do not delete" ../feature-wt<|end_message|>
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'locked'}, {'type': 'git_output', 'command': 'git worktree list --porcelain', 'contains': 'do not delete'}]
Invalid JSON. Output: git worktree lock --reason "do not delete" ../feature-wt{ "command": "git worktree lock --reason \"do not delete\" ../feature-wt" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)