Create worktree with new branch
Tests ability to create a new branch and worktree simultaneously. Evaluates combined worktree-create and branch-create.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo 'Hello' > hello.txt
  5. 05 git add hello.txt
  6. 06 git commit -m 'Initial commit'
Prompt
Create a git worktree at '../new-feature' with a new branch called 'new-feature'. Output ONLY the git worktree command, nothing else.
Expected
git worktree add -b new-feature ../new-feature main

Scoped model quality, cost, API time, and token usage for worktree_usage/f005.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 158 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-fable-5:high__json_schema PASS 100% 373 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-fable-5:low PASS 100% 161 in → 19 out (0 reasoning)
git worktree add -b new-feature ../new-feature
anthropic/claude-fable-5:low__json_schema PASS 100% 370 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-fable-5:max PASS 100% 162 in → 269 out (50 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-fable-5:max__json_schema PASS 100% 373 in → 267 out (65 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-fable-5:medium PASS 100% 163 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-fable-5:medium__json_schema PASS 100% 370 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-fable-5:xhigh PASS 100% 161 in → 33 out (12 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 377 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-haiku-4.5:high PASS 100% 170 in → 190 out (146 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 327 in → 261 out (234 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
anthropic/claude-haiku-4.5:low PASS 100% 166 in → 217 out (172 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 327 in → 233 out (202 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
anthropic/claude-haiku-4.5:medium PASS 100% 167 in → 233 out (196 reasoning)
``` git worktree add ../new-feature -b new-feature ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 327 in → 241 out (206 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
anthropic/claude-haiku-4.5:none PASS 100% 139 in → 21 out (0 reasoning)
``` git worktree add ../new-feature -b new-feature ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 298 in → 22 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 164 in → 172 out (129 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 323 in → 266 out (228 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
anthropic/claude-opus-4.6:high PASS 100% 139 in → 21 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 302 in → 21 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.6:low PASS 100% 136 in → 21 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 294 in → 21 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.6:max PASS 100% 136 in → 77 out (38 reasoning)
``` git worktree add ../new-feature -b new-feature ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 298 in → 64 out (25 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
anthropic/claude-opus-4.6:medium PASS 100% 142 in → 21 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 300 in → 21 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.6:none PASS 100% 135 in → 21 out (0 reasoning)
``` git worktree add ../new-feature -b new-feature ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 298 in → 21 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.6:xhigh PASS 100% 136 in → 21 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 298 in → 21 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.7:high PASS 100% 164 in → 26 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.7:high__json_schema PASS 100% 373 in → 28 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.7:low PASS 100% 163 in → 23 out (0 reasoning)
`git worktree add -b new-feature ../new-feature`
anthropic/claude-opus-4.7:low__json_schema PASS 100% 373 in → 28 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.7:max PASS 100% 165 in → 26 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 378 in → 28 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.7:medium PASS 100% 166 in → 26 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 372 in → 28 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.7:none PASS 100% 165 in → 26 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.7:none__json_schema PASS 100% 377 in → 28 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.7:xhigh PASS 100% 168 in → 23 out (0 reasoning)
`git worktree add -b new-feature ../new-feature`
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 378 in → 28 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.8:high PASS 100% 166 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.8:high__json_schema PASS 100% 377 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.8:low PASS 100% 162 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.8:low__json_schema PASS 100% 370 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.8:max PASS 100% 161 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.8:max__json_schema PASS 100% 368 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.8:medium PASS 100% 159 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 370 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.8:none PASS 100% 165 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 367 in → 25 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-opus-4.8:xhigh PASS 100% 163 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 371 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-sonnet-4.6:high PASS 100% 135 in → 81 out (46 reasoning)
git worktree add -b new-feature ../new-feature
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 301 in → 21 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
anthropic/claude-sonnet-4.6:low PASS 100% 137 in → 19 out (0 reasoning)
`git worktree add -b new-feature ../new-feature`
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 299 in → 21 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
anthropic/claude-sonnet-4.6:max PASS 100% 134 in → 110 out (72 reasoning)
`git worktree add -b new-feature ../new-feature`
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 299 in → 110 out (70 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-sonnet-4.6:medium PASS 100% 138 in → 19 out (0 reasoning)
`git worktree add ../new-feature -b new-feature`
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 299 in → 21 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
anthropic/claude-sonnet-4.6:none PASS 100% 138 in → 21 out (0 reasoning)
``` git worktree add ../new-feature -b new-feature ```
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 298 in → 21 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 138 in → 63 out (25 reasoning)
``` git worktree add ../new-feature -b new-feature ```
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 300 in → 21 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
anthropic/claude-sonnet-5:high PASS 100% 164 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 372 in → 55 out (30 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-sonnet-5:low PASS 100% 159 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-sonnet-5:low__json_schema PASS 100% 374 in → 33 out (10 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-sonnet-5:medium PASS 100% 162 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 372 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
anthropic/claude-sonnet-5:none PASS 100% 159 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-sonnet-5:none__json_schema PASS 100% 367 in → 25 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
anthropic/claude-sonnet-5:xhigh PASS 100% 162 in → 23 out (0 reasoning)
``` git worktree add -b new-feature ../new-feature ```
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 374 in → 26 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
arcee-ai/trinity-large-thinking:xhigh PASS 100% 114 in → 686 out (677 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-flash-0731:high PASS 100% 195 in → 61 out (47 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 260 in → 150 out (138 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
deepseek/deepseek-v4-flash-0731:low PASS 100% 115 in → 178 out (164 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 115 in → 120 out (112 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
deepseek/deepseek-v4-flash-0731:max PASS 100% 200 in → 138 out (124 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 192 in → 132 out (106 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 120 in → 90 out (72 reasoning)
git worktree add ../new-feature -b new-feature
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 124 in → 117 out (92 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
deepseek/deepseek-v4-flash-0731:none PASS 100% 118 in → 14 out (0 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 118 in → 21 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 197 in → 61 out (48 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 205 in → 92 out (70 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
deepseek/deepseek-v4-flash:high PASS 100% 117 in → 240 out (222 reasoning)
git worktree add ../new-feature -b new-feature
deepseek/deepseek-v4-flash:high__json_schema PASS 100% 208 in → 20 out (0 reasoning)
git worktree add -b new-feature ../new-feature main
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature main"}
deepseek/deepseek-v4-flash:low PASS 100% 121 in → 425 out (405 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-flash:medium PASS 100% 122 in → 257 out (242 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-flash:xhigh PASS 100% 196 in → 243 out (216 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-pro:high PASS 100% 119 in → 198 out (183 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 303 in → 386 out (366 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
deepseek/deepseek-v4-pro:low PASS 100% 119 in → 69 out (54 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 119 in → 91 out (68 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 117 in → 18 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
deepseek/deepseek-v4-pro:none PASS 100% 116 in → 13 out (0 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 123 in → 18 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 199 in → 345 out (330 reasoning)
git worktree add -b new-feature ../new-feature
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 119 in → 71 out (0 reasoning)
cd /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f005_ukwgkuf4/worktree_usage_f005 && git worktree add -b new-feature ../new-feature HEAD
JSON Schema Structured Output
(raw) { "command": "cd /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f005_ukwgkuf4/worktree_usage_f005 && git worktree add -b new-feature ../new-feature HEAD" }
google/gemini-3-flash-preview:high PASS 100% 143 in → 154 out (141 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3-flash-preview:high__json_schema PASS 100% 198 in → 256 out (239 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3-flash-preview:low PASS 100% 143 in → 159 out (146 reasoning)
git worktree add ../new-feature -b new-feature
google/gemini-3-flash-preview:low__json_schema PASS 100% 202 in → 132 out (115 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3-flash-preview:medium PASS 100% 140 in → 246 out (233 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3-flash-preview:medium__json_schema PASS 100% 197 in → 246 out (228 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3-flash-preview:xhigh PASS 100% 144 in → 197 out (184 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 142 in → 147 out (130 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 142 in → 226 out (213 reasoning)
git worktree add ../new-feature -b new-feature
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 197 in → 388 out (370 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.1-flash-lite-preview:low PASS 100% 140 in → 162 out (149 reasoning)
git worktree add ../new-feature -b new-feature
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 143 in → 139 out (116 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
google/gemini-3.1-flash-lite-preview:medium PASS 100% 139 in → 139 out (126 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 201 in → 197 out (179 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 144 in → 278 out (265 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 199 in → 435 out (417 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
google/gemini-3.1-pro-preview:high PASS 100% 141 in → 258 out (245 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 199 in → 367 out (350 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.1-pro-preview:low PASS 100% 142 in → 397 out (384 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 198 in → 236 out (218 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.1-pro-preview:medium PASS 100% 141 in → 423 out (410 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 199 in → 293 out (275 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 140 in → 383 out (370 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 200 in → 344 out (328 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.5-flash-lite:high PASS 100% 142 in → 457 out (444 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 142 in → 355 out (337 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.5-flash-lite:low PASS 100% 144 in → 13 out (0 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 147 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemini-3.5-flash-lite:max PASS 100% 140 in → 305 out (292 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 144 in → 376 out (359 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.5-flash-lite:medium PASS 100% 140 in → 244 out (231 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 196 in → 279 out (261 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 143 in → 373 out (360 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 143 in → 361 out (343 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.5-flash:high PASS 100% 145 in → 659 out (646 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash:high__json_schema PASS 100% 200 in → 426 out (408 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.5-flash:low PASS 100% 140 in → 245 out (232 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash:low__json_schema PASS 100% 196 in → 157 out (139 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
google/gemini-3.5-flash:medium PASS 100% 143 in → 367 out (354 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash:medium__json_schema PASS 100% 199 in → 191 out (174 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.5-flash:xhigh PASS 100% 142 in → 426 out (413 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 198 in → 261 out (238 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemini-3.6-flash:high PASS 100% 143 in → 231 out (218 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.6-flash:high__json_schema PASS 100% 201 in → 183 out (166 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.6-flash:low PASS 100% 141 in → 221 out (208 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.6-flash:low__json_schema PASS 100% 194 in → 17 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.6-flash:max PASS 100% 143 in → 317 out (304 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.6-flash:max__json_schema PASS 100% 144 in → 270 out (253 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.6-flash:medium PASS 100% 143 in → 273 out (260 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.6-flash:medium__json_schema PASS 100% 197 in → 200 out (183 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemini-3.6-flash:xhigh PASS 100% 146 in → 332 out (319 reasoning)
git worktree add -b new-feature ../new-feature
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 203 in → 217 out (194 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemma-4-26b-a4b-it:high PASS 100% 157 in → 273 out (259 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-26b-a4b-it:high__json_schema PASS 100% 158 in → 213 out (166 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemma-4-26b-a4b-it:low PASS 100% 155 in → 304 out (259 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 159 in → 248 out (191 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemma-4-26b-a4b-it:medium PASS 100% 156 in → 294 out (215 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 156 in → 291 out (205 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
google/gemma-4-26b-a4b-it:none PASS 100% 151 in → 14 out (0 reasoning)
git worktree add ../new-feature -b new-feature
google/gemma-4-26b-a4b-it:none__json_schema PASS 100% 154 in → 24 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemma-4-26b-a4b-it:xhigh PASS 100% 158 in → 309 out (234 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 161 in → 340 out (270 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemma-4-31b-it:high PASS 100% 155 in → 137 out (101 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-31b-it:low PASS 100% 162 in → 168 out (123 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-31b-it:low__json_schema PASS 100% 158 in → 216 out (155 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemma-4-31b-it:medium PASS 100% 160 in → 147 out (106 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-31b-it:medium__json_schema PASS 100% 156 in → 151 out (1 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
google/gemma-4-31b-it:none PASS 100% 154 in → 14 out (0 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-31b-it:none__json_schema PASS 100% 153 in → 19 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
google/gemma-4-31b-it:xhigh PASS 100% 162 in → 177 out (1 reasoning)
git worktree add -b new-feature ../new-feature
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 152 in → 183 out (130 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
minimax/minimax-m2.5:high PASS 100% 145 in → 116 out (124 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m2.5:high__json_schema PASS 100% 169 in → 402 out (394 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
minimax/minimax-m2.5:low PASS 100% 144 in → 189 out (176 reasoning)
git worktree add ../new-feature -b new-feature
minimax/minimax-m2.5:low__json_schema PASS 100% 147 in → 143 out (123 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
minimax/minimax-m2.5:medium PASS 100% 144 in → 106 out (108 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m2.5:medium__json_schema PASS 100% 143 in → 205 out (186 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
minimax/minimax-m2.5:xhigh PASS 100% 152 in → 193 out (180 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 162 in → 263 out (241 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
minimax/minimax-m2.7:high PASS 100% 145 in → 309 out (297 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m2.7:high__json_schema PASS 100% 142 in → 304 out (291 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
minimax/minimax-m2.7:low PASS 100% 142 in → 284 out (271 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m2.7:low__json_schema PASS 100% 277 in → 422 out (405 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
minimax/minimax-m2.7:medium PASS 100% 143 in → 524 out (503 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m2.7:medium__json_schema PASS 100% 276 in → 614 out (597 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
minimax/minimax-m2.7:xhigh PASS 100% 144 in → 206 out (192 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 276 in → 378 out (357 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
minimax/minimax-m3:high PASS 100% 282 in → 125 out (126 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m3:high__json_schema PASS 100% 267 in → 18 out (0 reasoning)
git worktree add -b new-feature '../new-feature'
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature '../new-feature'"}
minimax/minimax-m3:low PASS 100% 281 in → 49 out (40 reasoning)
git worktree add -b new-feature ../new-feature HEAD
minimax/minimax-m3:low__json_schema PASS 100% 230 in → 21 out (20 reasoning)
git worktree add -b new-feature ../new-feature HEAD
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature HEAD" }
minimax/minimax-m3:medium PASS 100% 285 in → 90 out (86 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m3:medium__json_schema PASS 100% 268 in → 17 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
minimax/minimax-m3:xhigh PASS 100% 281 in → 112 out (95 reasoning)
git worktree add -b new-feature ../new-feature
minimax/minimax-m3:xhigh__json_schema PASS 100% 266 in → 17 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
mistralai/devstral-2512 PASS 100% 142 in → 19 out
```bash git worktree add ../new-feature -b new-feature ```
mistralai/devstral-2512__json_schema PASS 100% 140 in → 19 out
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
mistralai/mistral-medium-3-5:high PASS 100% 153 in → 448 out (412 reasoning)
git worktree add -b new-feature ../new-feature
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 144 in → 364 out (366 reasoning)
git worktree add -b new-feature ../new-feature main
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature main"}
mistralai/mistral-medium-3-5:low PASS 100% 150 in → 549 out (561 reasoning)
git worktree add -b new-feature ../new-feature
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 135 in → 309 out (300 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
mistralai/mistral-medium-3-5:medium PASS 100% 155 in → 850 out (818 reasoning)
git worktree add -b new-feature ../new-feature
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 140 in → 358 out (358 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
mistralai/mistral-medium-3-5:none PASS 100% 155 in → 19 out (0 reasoning)
```sh git worktree add ../new-feature -b new-feature ```
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 140 in → 19 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 154 in → 586 out (593 reasoning)
git worktree add -b new-feature ../new-feature
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 144 in → 320 out (334 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
moonshotai/kimi-k2.6:high PASS 100% 111 in → 250 out (255 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k2.6:high__json_schema PASS 100% 112 in → 436 out (382 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
moonshotai/kimi-k2.6:low PASS 100% 113 in → 236 out (227 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k2.6:low__json_schema PASS 100% 112 in → 366 out (348 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
moonshotai/kimi-k2.6:medium PASS 100% 113 in → 391 out (401 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 112 in → 391 out (395 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
moonshotai/kimi-k2.6:xhigh PASS 100% 111 in → 370 out (371 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k2.6:xhigh__json_schema PASS 100% 113 in → 20 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
moonshotai/kimi-k2.7-code:high PASS 100% 111 in → 112 out (99 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 193 in → 108 out (90 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
moonshotai/kimi-k2.7-code:low PASS 100% 111 in → 179 out (166 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 198 in → 53 out (35 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
moonshotai/kimi-k2.7-code:medium PASS 100% 116 in → 128 out (127 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k2.7-code:xhigh PASS 100% 114 in → 154 out (159 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 113 in → 135 out (127 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
moonshotai/kimi-k3:high PASS 100% 187 in → 85 out (59 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:high__json_schema PASS 100% 183 in → 187 out (161 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:low PASS 100% 188 in → 178 out (152 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:low__json_schema PASS 100% 190 in → 145 out (119 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:max PASS 100% 195 in → 173 out (147 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:max__json_schema PASS 100% 189 in → 177 out (151 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:medium PASS 100% 197 in → 110 out (84 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:medium__json_schema PASS 100% 193 in → 111 out (85 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:xhigh PASS 100% 191 in → 118 out (92 reasoning)
git worktree add -b new-feature ../new-feature
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 280 in → 172 out (141 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 153 in → 579 out (597 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
nvidia/nemotron-3-nano-30b-a3b:none PASS 100% 154 in → 49 out (0 reasoning)
git worktree add -b new-feature ../new-feature c97bd613e52c2e828a623ad0c9e809af2ab5db50
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 153 in → 118 out (109 reasoning)
git worktree add ../new-feature -b new-feature
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 156 in → 87 out (60 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 154 in → 94 out (74 reasoning)
git worktree add ../new-feature -b new-feature
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 153 in → 111 out (81 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 160 in → 14 out (0 reasoning)
git worktree add ../new-feature -b new-feature
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 156 in → 22 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 151 in → 102 out (94 reasoning)
git worktree add ../new-feature -b new-feature
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 152 in → 94 out (66 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
openai/gpt-5.4-mini:high PASS 100% 113 in → 148 out (131 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.4-mini:high__json_schema PASS 100% 156 in → 202 out (177 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4-mini:low PASS 100% 110 in → 54 out (37 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.4-mini:low__json_schema PASS 100% 148 in → 62 out (37 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
openai/gpt-5.4-mini:medium PASS 100% 113 in → 97 out (80 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.4-mini:medium__json_schema PASS 100% 152 in → 120 out (95 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4-mini:none PASS 100% 112 in → 16 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.4-mini:none__json_schema PASS 100% 153 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4-mini:xhigh PASS 100% 118 in → 389 out (372 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 153 in → 1,059 out (1,034 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4-nano:high PASS 100% 112 in → 15 out (0 reasoning)
git worktree add ../new-feature -b new-feature
openai/gpt-5.4-nano:high__json_schema PASS 100% 145 in → 211 out (166 reasoning)
git worktree add -b new-feature ../new-feature 3a38ace172699f75ce382e231adc754c8411ba38
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature 3a38ace172699f75ce382e231adc754c8411ba38"}
openai/gpt-5.4-nano:low PASS 100% 113 in → 18 out (0 reasoning)
git worktree add --force ../new-feature -b new-feature HEAD
openai/gpt-5.4-nano:low__json_schema PASS 100% 146 in → 24 out (0 reasoning)
git worktree add -b new-feature ../new-feature HEAD
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature HEAD"}
openai/gpt-5.4-nano:medium PASS 100% 112 in → 119 out (102 reasoning)
git worktree add ../new-feature -b new-feature
openai/gpt-5.4-nano:medium__json_schema PASS 100% 147 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4-nano:none PASS 100% 114 in → 16 out (0 reasoning)
git worktree add ../new-feature -b new-feature HEAD
openai/gpt-5.4-nano:none__json_schema PASS 100% 152 in → 24 out (0 reasoning)
git worktree add -b new-feature ../new-feature HEAD
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature HEAD"}
openai/gpt-5.4-nano:xhigh PASS 100% 110 in → 259 out (242 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 150 in → 471 out (446 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4:high PASS 100% 118 in → 84 out (67 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.4:high__json_schema PASS 100% 146 in → 389 out (364 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4:low PASS 100% 113 in → 27 out (9 reasoning)
git worktree add -b new-feature ../new-feature HEAD
openai/gpt-5.4:low__json_schema PASS 100% 147 in → 67 out (42 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4:medium PASS 100% 109 in → 79 out (62 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.4:medium__json_schema PASS 100% 149 in → 138 out (113 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4:none PASS 100% 116 in → 16 out (0 reasoning)
git worktree add -b new-feature ../new-feature HEAD
openai/gpt-5.4:none__json_schema PASS 100% 149 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.4:xhigh PASS 100% 115 in → 534 out (516 reasoning)
git worktree add -b new-feature ../new-feature HEAD
openai/gpt-5.4:xhigh__json_schema PASS 100% 146 in → 541 out (516 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.5:high PASS 100% 120 in → 72 out (55 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.5:high__json_schema PASS 100% 151 in → 72 out (47 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.5:low PASS 100% 115 in → 52 out (35 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.5:low__json_schema PASS 100% 149 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.5:medium PASS 100% 115 in → 77 out (60 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.5:medium__json_schema PASS 100% 145 in → 77 out (52 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.5:none PASS 100% 115 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.5:none__json_schema PASS 100% 152 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.5:xhigh PASS 100% 111 in → 126 out (109 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.5:xhigh__json_schema PASS 100% 149 in → 442 out (417 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-luna:high PASS 100% 114 in → 53 out (36 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-luna:high__json_schema PASS 100% 149 in → 63 out (38 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-luna:low PASS 100% 115 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-luna:low__json_schema PASS 100% 145 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-luna:max PASS 100% 115 in → 94 out (77 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-luna:max__json_schema PASS 100% 148 in → 161 out (136 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-luna:medium PASS 100% 114 in → 41 out (24 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-luna:medium__json_schema PASS 100% 144 in → 49 out (24 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-luna:none PASS 100% 115 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-luna:none__json_schema PASS 100% 146 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-luna:xhigh PASS 100% 117 in → 92 out (75 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 150 in → 78 out (53 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-sol:high PASS 100% 113 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-sol:high__json_schema PASS 100% 147 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-sol:low PASS 100% 113 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-sol:low__json_schema PASS 100% 150 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-sol:max PASS 100% 113 in → 62 out (45 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-sol:max__json_schema PASS 100% 146 in → 108 out (83 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-sol:medium PASS 100% 110 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-sol:medium__json_schema PASS 100% 152 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-sol:none PASS 100% 115 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-sol:none__json_schema PASS 100% 147 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-sol:xhigh PASS 100% 116 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 151 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-terra:high PASS 100% 111 in → 46 out (29 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-terra:high__json_schema PASS 100% 149 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-terra:low PASS 100% 109 in → 65 out (48 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-terra:low__json_schema PASS 100% 151 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-terra:max PASS 100% 112 in → 68 out (51 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-terra:max__json_schema PASS 100% 146 in → 144 out (119 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-terra:medium PASS 100% 114 in → 40 out (23 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-terra:medium__json_schema PASS 100% 148 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-terra:none PASS 100% 112 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-terra:none__json_schema PASS 100% 150 in → 23 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-5.6-terra:xhigh PASS 100% 111 in → 46 out (29 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 151 in → 80 out (55 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-oss-120b:high PASS 100% 167 in → 906 out (929 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-oss-120b:high__json_schema PASS 100% 163 in → 452 out (456 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-oss-120b:low PASS 100% 172 in → 61 out (42 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-oss-120b:low__json_schema PASS 100% 172 in → 57 out (35 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-oss-120b:medium PASS 100% 180 in → 132 out (112 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-oss-120b:medium__json_schema PASS 100% 175 in → 187 out (181 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-oss-120b:xhigh PASS 100% 178 in → 441 out (479 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 159 in → 730 out (751 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
openai/gpt-oss-20b:high PASS 100% 160 in → 1,330 out (1,391 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-oss-20b:xhigh PASS 100% 173 in → 399 out (405 reasoning)
git worktree add -b new-feature ../new-feature
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 275 in → 475 out (447 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
poolside/laguna-m.1:high__json_schema PASS 100% 144 in → 336 out (315 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command" : "git worktree add ../new-feature -b new-feature" }
poolside/laguna-m.1:medium PASS 100% 141 in → 310 out (298 reasoning)
git worktree add -b new-feature ../new-feature
poolside/laguna-m.1:none PASS 100% 141 in → 13 out (0 reasoning)
git worktree add ../new-feature -b new-feature
poolside/laguna-m.1:none__json_schema PASS 100% 140 in → 17 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
poolside/laguna-xs-2.1:high PASS 100% 134 in → 278 out (266 reasoning)
git worktree add -b new-feature ../new-feature
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 143 in → 265 out (248 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
poolside/laguna-xs-2.1:none PASS 100% 144 in → 11 out (0 reasoning)
git worktree add -b new-feature ../new-feature
poolside/laguna-xs-2.1:none__json_schema PASS 100% 137 in → 17 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
poolside/laguna-xs-2.1:xhigh PASS 100% 138 in → 344 out (334 reasoning)
git worktree add -b new-feature ../new-feature main
poolside/laguna-xs.2:high PASS 100% 182 in → 372 out (362 reasoning)
git worktree add -b new-feature ../new-feature
poolside/laguna-xs.2:low PASS 100% 176 in → 353 out (339 reasoning)
git worktree add -b new-feature ../new-feature HEAD
poolside/laguna-xs.2:low__json_schema PASS 100% 174 in → 414 out (398 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 179 in → 169 out (153 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
qwen/qwen3.6-27b:high PASS 100% 141 in → 820 out (1 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.6-27b:high__json_schema PASS 100% 139 in → 2,498 out (2,415 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
qwen/qwen3.6-27b:medium PASS 100% 143 in → 1,081 out (1,009 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.6-27b:medium__json_schema PASS 100% 144 in → 22 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
qwen/qwen3.6-27b:none PASS 100% 145 in → 12 out (0 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.6-27b:none__json_schema PASS 100% 148 in → 22 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
qwen/qwen3.6-27b:xhigh PASS 100% 140 in → 1,029 out (1 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 144 in → 1,157 out (1 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
qwen/qwen3.6-35b-a3b:high PASS 100% 141 in → 1,183 out (1,100 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.6-35b-a3b:low PASS 100% 144 in → 359 out (335 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.6-35b-a3b:medium PASS 100% 142 in → 1,381 out (1,365 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.6-35b-a3b:none PASS 100% 141 in → 11 out (0 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.6-flash:medium PASS 100% 142 in → 1,810 out (1,794 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.7-flash:medium PASS 100% 144 in → 711 out (695 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.7-flash:none PASS 100% 145 in → 11 out (0 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.7-max:high PASS 100% 146 in → 306 out (290 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.7-max:low PASS 100% 142 in → 202 out (186 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.7-max:medium PASS 100% 142 in → 403 out (387 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.7-max:xhigh PASS 100% 143 in → 206 out (190 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.7-plus:high PASS 100% 136 in → 513 out (497 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.7-plus:low PASS 100% 138 in → 992 out (976 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.7-plus:medium PASS 100% 143 in → 697 out (681 reasoning)
git worktree add -b new-feature ../new-feature
qwen/qwen3.7-plus:none PASS 100% 146 in → 11 out (0 reasoning)
git worktree add ../new-feature -b new-feature
qwen/qwen3.7-plus:xhigh PASS 100% 139 in → 684 out (668 reasoning)
git worktree add -b new-feature ../new-feature
tencent/hy3:high PASS 100% 125 in → 486 out (471 reasoning)
git worktree add -b new-feature ../new-feature
tencent/hy3:high__json_schema PASS 100% 123 in → 460 out (417 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
tencent/hy3:low PASS 100% 126 in → 294 out (279 reasoning)
git worktree add -b new-feature ../new-feature
tencent/hy3:medium PASS 100% 128 in → 302 out (287 reasoning)
git worktree add -b new-feature ../new-feature
tencent/hy3:medium__json_schema PASS 100% 124 in → 325 out (267 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
tencent/hy3:none PASS 100% 126 in → 14 out (0 reasoning)
git worktree add -b new-feature ../new-feature
tencent/hy3:xhigh PASS 100% 123 in → 720 out (705 reasoning)
git worktree add -b new-feature ../new-feature
tencent/hy3:xhigh__json_schema PASS 100% 121 in → 756 out (679 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
thinkingmachines/inkling-small:high PASS 100% 125 in → 149 out (132 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling-small:high__json_schema PASS 100% 118 in → 192 out (168 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
thinkingmachines/inkling-small:low PASS 100% 129 in → 39 out (24 reasoning)
git worktree add ../new-feature -b new-feature
thinkingmachines/inkling-small:low__json_schema PASS 100% 122 in → 77 out (53 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
thinkingmachines/inkling-small:max PASS 100% 123 in → 290 out (271 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling-small:max__json_schema PASS 100% 118 in → 164 out (140 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
thinkingmachines/inkling-small:medium PASS 100% 120 in → 74 out (60 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling-small:medium__json_schema PASS 100% 121 in → 95 out (74 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
thinkingmachines/inkling-small:none PASS 100% 118 in → 14 out (0 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling-small:xhigh PASS 100% 121 in → 161 out (151 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 122 in → 121 out (97 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
thinkingmachines/inkling:high PASS 100% 130 in → 143 out (107 reasoning)
git worktree add ../new-feature -b new-feature
thinkingmachines/inkling:low PASS 100% 121 in → 34 out (19 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling:low__json_schema PASS 100% 122 in → 37 out (14 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
thinkingmachines/inkling:max PASS 100% 124 in → 219 out (202 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling:max__json_schema PASS 100% 121 in → 182 out (158 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
thinkingmachines/inkling:medium PASS 100% 123 in → 60 out (48 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling:medium__json_schema PASS 100% 121 in → 88 out (65 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
thinkingmachines/inkling:none PASS 100% 122 in → 15 out (0 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling:none__json_schema PASS 100% 118 in → 20 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
thinkingmachines/inkling:xhigh PASS 100% 123 in → 82 out (65 reasoning)
git worktree add -b new-feature ../new-feature
thinkingmachines/inkling:xhigh__json_schema PASS 100% 124 in → 149 out (125 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
x-ai/grok-4.3:high PASS 100% 290 in → 176 out (165 reasoning)
git worktree add ../new-feature -b new-feature
x-ai/grok-4.3:high__json_schema PASS 100% 342 in → 718 out (703 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
x-ai/grok-4.3:low PASS 100% 291 in → 275 out (264 reasoning)
git worktree add -b new-feature ../new-feature
x-ai/grok-4.3:low__json_schema PASS 100% 348 in → 248 out (229 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
x-ai/grok-4.3:max PASS 100% 293 in → 297 out (286 reasoning)
git worktree add -b new-feature ../new-feature
x-ai/grok-4.3:max__json_schema PASS 100% 344 in → 394 out (375 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
x-ai/grok-4.3:medium PASS 100% 298 in → 694 out (683 reasoning)
git worktree add -b new-feature ../new-feature
x-ai/grok-4.3:medium__json_schema PASS 100% 352 in → 572 out (553 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add -b new-feature ../new-feature" }
x-ai/grok-4.3:none PASS 100% 287 in → 11 out (0 reasoning)
git worktree add ../new-feature -b new-feature
x-ai/grok-4.3:none__json_schema PASS 100% 342 in → 15 out (0 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
x-ai/grok-4.3:xhigh PASS 100% 289 in → 218 out (207 reasoning)
git worktree add ../new-feature -b new-feature
x-ai/grok-4.3:xhigh__json_schema PASS 100% 341 in → 419 out (404 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
x-ai/grok-4.5:high PASS 100% 323 in → 333 out (320 reasoning)
git worktree add -b new-feature ../new-feature
x-ai/grok-4.5:high__json_schema PASS 100% 390 in → 356 out (338 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add -b new-feature ../new-feature"}
x-ai/grok-4.5:low PASS 100% 321 in → 263 out (246 reasoning)
``` git worktree add -b new-feature ../new-feature ```
x-ai/grok-4.5:low__json_schema PASS 100% 387 in → 120 out (102 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
x-ai/grok-4.5:max PASS 100% 327 in → 249 out (236 reasoning)
git worktree add -b new-feature ../new-feature
x-ai/grok-4.5:max__json_schema PASS 100% 385 in → 348 out (330 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
x-ai/grok-4.5:medium PASS 100% 326 in → 247 out (234 reasoning)
git worktree add -b new-feature ../new-feature
x-ai/grok-4.5:medium__json_schema PASS 100% 388 in → 345 out (327 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
x-ai/grok-4.5:xhigh PASS 100% 321 in → 148 out (135 reasoning)
git worktree add -b new-feature ../new-feature
x-ai/grok-4.5:xhigh__json_schema PASS 100% 387 in → 396 out (378 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
z-ai/glm-4.7-flash:medium__json_schema PASS 100% 121 in → 264 out (243 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature -b new-feature"}
z-ai/glm-5.2:high PASS 100% 126 in → 319 out (306 reasoning)
git worktree add -b new-feature ../new-feature
z-ai/glm-5.2:high__json_schema PASS 100% 296 in → 57 out (39 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
z-ai/glm-5.2:low PASS 100% 123 in → 248 out (235 reasoning)
git worktree add -b new-feature ../new-feature
z-ai/glm-5.2:low__json_schema PASS 100% 128 in → 20 out (19 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature -b new-feature" }
z-ai/glm-5.2:medium PASS 100% 128 in → 254 out (241 reasoning)
git worktree add -b new-feature ../new-feature
z-ai/glm-5.2:none PASS 100% 120 in → 11 out (0 reasoning)
git worktree add -b new-feature ../new-feature
z-ai/glm-5.2:none__json_schema PASS 100% 120 in → 17 out (0 reasoning)
git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add -b new-feature ../new-feature"}
z-ai/glm-5.2:xhigh PASS 100% 126 in → 347 out (334 reasoning)
git worktree add -b new-feature ../new-feature
z-ai/glm-5.2:xhigh__json_schema PASS 100% 302 in → 85 out (68 reasoning)
git worktree add ../new-feature -b new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature -b new-feature"}
arcee-ai/trinity-large-thinking:high FAIL 33.3% 116 in → 468 out (459 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-large-thinking:low FAIL 33.3% 115 in → 498 out (489 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-large-thinking:medium FAIL 33.3% 117 in → 560 out (553 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-mini:high FAIL 33.3% 113 in → 349 out (387 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-mini:high__json_schema FAIL 33.3% 115 in → 340 out (371 reasoning)
git worktreeadd ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktreeadd ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-mini:low FAIL 33.3% 115 in → 302 out (329 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-mini:low__json_schema FAIL 33.3% 113 in → 347 out (376 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-mini:medium FAIL 33.3% 113 in → 411 out (445 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-mini:medium__json_schema FAIL 33.3% 113 in → 342 out (365 reasoning)
gitworktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "gitworktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-mini:xhigh FAIL 33.3% 117 in → 377 out (421 reasoning)
git worktree add../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
arcee-ai/trinity-mini:xhigh__json_schema FAIL 33.3% 115 in → 399 out (432 reasoning)
git worktree add../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
deepseek/deepseek-v4-flash:low__json_schema FAIL 33.3% 115 in → 100 out (85 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
deepseek/deepseek-v4-flash:medium__json_schema FAIL 33.3% 120 in → 171 out (162 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
deepseek/deepseek-v4-flash:none FAIL 33.3% 118 in → 12 out (0 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
deepseek/deepseek-v4-flash:none__json_schema FAIL 33.3% 118 in → 19 out (0 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
deepseek/deepseek-v4-flash:xhigh__json_schema FAIL 33.3% 197 in → 286 out (295 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
deepseek/deepseek-v4-pro:medium FAIL 33.3% 118 in → 229 out (226 reasoning)
gitworktree add ../new-feature -b new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
ibm-granite/granite-4.1-8b FAIL 33.3% 130 in → 10 out
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
ibm-granite/granite-4.1-8b__json_schema FAIL 33.3% 129 in → 20 out
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
inclusionai/ling-2.6-flash FAIL 33.3% 149 in → 10 out
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
inclusionai/ling-2.6-flash__json_schema FAIL 33.3% 153 in → 14 out
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
liquid/lfm-2-24b-a2b FAIL 33.3% 134 in → 67 out
```bash git worktree add -p /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f005_8ign6oup/worktree_usage_f005 new-feature ```
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-nano-30b-a3b:high FAIL 33.3% 156 in → 232 out (243 reasoning)
gitworktree add --branch new-feature ../new-feature HEAD
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-nano-30b-a3b:high__json_schema FAIL 33.3% 157 in → 416 out (447 reasoning)
git worktree add --branch new-feature ../new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add --branch new-feature ../new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-nano-30b-a3b:low FAIL 33.3% 150 in → 199 out (206 reasoning)
git worktree add --branch new-feature ../new-feature HEAD
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-nano-30b-a3b:low__json_schema FAIL 33.3% 154 in → 316 out (257 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-nano-30b-a3b:medium FAIL 33.3% 157 in → 371 out (378 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-nano-30b-a3b:none__json_schema FAIL 33.3% 156 in → 27 out (0 reasoning)
git worktree add ../new-feature --branch new-feature HEAD
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature --branch new-feature HEAD" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-nano-30b-a3b:xhigh FAIL 33.3% 156 in → 461 out (499 reasoning)
git worktree add --branch new-feature ../new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema FAIL 33.3% 157 in → 259 out (266 reasoning)
git worktree add --branch new-feature ../new-feature .
JSON Schema Structured Output
(raw) { "command": "git worktree add --branch new-feature ../new-feature ." }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-super-120b-a12b:low__json_schema FAIL 33.3% 152 in → 81 out (57 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
nvidia/nemotron-3-super-120b-a12b:medium FAIL 33.3% 156 in → 89 out (83 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
openai/gpt-oss-20b:high__json_schema FAIL 33.3% 172 in → 317 out (364 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
openai/gpt-oss-20b:low FAIL 33.3% 181 in → 23 out (4 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
openai/gpt-oss-20b:low__json_schema FAIL 33.3% 175 in → 63 out (46 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command":"git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
openai/gpt-oss-20b:medium FAIL 33.3% 175 in → 137 out (137 reasoning)
git worktree add -b new-feature ../new-feature .
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
openai/gpt-oss-20b:medium__json_schema FAIL 33.3% 175 in → 179 out (152 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-m.1:high FAIL 33.3% 136 in → 302 out (304 reasoning)
(empty output)
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-m.1:low FAIL 33.3% 142 in → 338 out (327 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-m.1:low__json_schema FAIL 33.3% 142 in → 318 out (299 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-m.1:medium__json_schema FAIL 33.3% 139 in → 228 out (208 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-m.1:xhigh FAIL 33.3% 141 in → 336 out (325 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-m.1:xhigh__json_schema FAIL 33.3% 146 in → 354 out (339 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs-2.1:high__json_schema FAIL 33.3% 140 in → 490 out (476 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs-2.1:low FAIL 33.3% 138 in → 257 out (248 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs-2.1:low__json_schema FAIL 33.3% 140 in → 345 out (330 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs-2.1:medium FAIL 33.3% 145 in → 422 out (414 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs-2.1:xhigh__json_schema FAIL 33.3% 142 in → 260 out (245 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs.2:high__json_schema FAIL 33.3% 180 in → 219 out (200 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs.2:medium FAIL 33.3% 178 in → 148 out (138 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs.2:medium__json_schema FAIL 33.3% 177 in → 142 out (128 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs.2:none FAIL 33.3% 179 in → 11 out (0 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs.2:none__json_schema FAIL 33.3% 178 in → 20 out (0 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
poolside/laguna-xs.2:xhigh FAIL 33.3% 176 in → 192 out (182 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-27b:low FAIL 33.3% 142 in → 145 out (141 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-27b:low__json_schema FAIL 33.3% 138 in → 177 out (171 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-35b-a3b:high__json_schema FAIL 33.3% 140 in → 1,200 out (1,164 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-35b-a3b:low__json_schema FAIL 33.3% 143 in → 889 out (887 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-35b-a3b:medium__json_schema FAIL 33.3% 142 in → 348 out (326 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-35b-a3b:none__json_schema FAIL 33.3% 143 in → 23 out (0 reasoning)
git worktree add --branch new-feature ../new-feature main
JSON Schema Structured Output
(raw) { "command": "git worktree add --branch new-feature ../new-feature main" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-35b-a3b:xhigh FAIL 33.3% 144 in → 1,862 out (1,793 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-35b-a3b:xhigh__json_schema FAIL 33.3% 141 in → 1,096 out (1,061 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) { "command": "git worktree add ../new-feature new-feature" }
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-flash:high FAIL 33.3% 140 in → 961 out (947 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-flash:low FAIL 33.3% 139 in → 1,801 out (1,787 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-flash:none FAIL 33.3% 143 in → 11 out (0 reasoning)
git worktree add --branch new-feature ../new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.6-flash:xhigh FAIL 33.3% 144 in → 1,494 out (1,478 reasoning)
git worktree add --branch new-feature ../new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.7-flash:high FAIL 33.3% 140 in → 814 out (800 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.7-flash:low FAIL 33.3% 139 in → 563 out (549 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.7-flash:max FAIL 33.3% 140 in → 1,084 out (1,070 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.7-flash:xhigh FAIL 33.3% 139 in → 343 out (329 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
qwen/qwen3.7-max:none FAIL 33.3% 140 in → 9 out (0 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
z-ai/glm-4.7-flash:high FAIL 33.3% 122 in → 289 out (286 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
z-ai/glm-4.7-flash:low FAIL 33.3% 116 in → 262 out (247 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
z-ai/glm-4.7-flash:medium FAIL 33.3% 118 in → 577 out (566 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
z-ai/glm-4.7-flash:none FAIL 33.3% 120 in → 9 out (0 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
z-ai/glm-4.7-flash:none__json_schema FAIL 33.3% 118 in → 15 out (0 reasoning)
git worktree add ../new-feature new-feature
JSON Schema Structured Output
(raw) {"command": "git worktree add ../new-feature new-feature"}
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
z-ai/glm-4.7-flash:xhigh FAIL 33.3% 121 in → 237 out (223 reasoning)
git worktree add ../new-feature new-feature
Failure: Failed assertions: [{'type': 'dir_exists', 'path': '../new-feature'}, {'type': 'branch_exists', 'name': 'new-feature'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree{ "command": "git worktree add -b new-feature ../new-feature" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: ```bash git worktree add /private/var/folders/kg/gb4597jx5jv6b7tngk181jr40000gn/T/worktree_usage_f005_juvj56m9/worktree_usage_f005 new-feature ```
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1bac79bf-3d29-9aa6-b17b-e72ca186d52c","request_id":"1bac79bf-3d29-9aa6-b17b-e72ca186d52c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8ccccbd6-a2ca-95cc-8602-f780047ebbb5","request_id":"8ccccbd6-a2ca-95cc-8602-f780047ebbb5"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8e2e49e1-8770-9d85-8105-ca7edcec6be1","request_id":"8e2e49e1-8770-9d85-8105-ca7edcec6be1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-df878dd3-8b14-922f-bd8f-a647406d0192","request_id":"df878dd3-8b14-922f-bd8f-a647406d0192"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-fef8301b-1dcf-9d4d-af40-8b1defd71182","request_id":"fef8301b-1dcf-9d4d-af40-8b1defd71182"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-a56c9f6e-3afc-941a-a3ce-63bf7dbc52d2"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-932115a0-f182-97af-87dc-b1b693c292a0"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-e09f7819-29e0-942e-ae87-11faf914fab6"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-d32cc766-52c9-9094-9cf7-d5622d30f531"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-68ce25a4-b639-988a-b89d-b402267452f2"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-2b0c4098-e51d-982c-bf6e-cc90b32fb7f7"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-96288818-794a-9f94-95a4-a8c2fc20b244","request_id":"96288818-794a-9f94-95a4-a8c2fc20b244"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f104fd27-d444-930e-98cb-45d5e85fe18a","request_id":"f104fd27-d444-930e-98cb-45d5e85fe18a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-ab984377-4cd3-9325-bbf9-e4631d9c7155","request_id":"ab984377-4cd3-9325-bbf9-e4631d9c7155"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d94b4cf0-6c96-9280-8cff-1748f85b799e","request_id":"d94b4cf0-6c96-9280-8cff-1748f85b799e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d7070684-4aa9-9d12-a837-b5bde326e3ee","request_id":"d7070684-4aa9-9d12-a837-b5bde326e3ee"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-3d89a388-506e-9753-98f1-58efbea2c11f","request_id":"3d89a388-506e-9753-98f1-58efbea2c11f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f048c40f-9659-9868-b6a6-865536a0ff0d","request_id":"f048c40f-9659-9868-b6a6-865536a0ff0d"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-35298a82-f80f-91e9-b32d-f22347fe701f","request_id":"35298a82-f80f-91e9-b32d-f22347fe701f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-af222955-12c1-9d57-b837-ad01f35d7093","request_id":"af222955-12c1-9d57-b837-ad01f35d7093"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-246a7b62-6ba2-9e9d-820c-02f4da2d26ec","request_id":"246a7b62-6ba2-9e9d-820c-02f4da2d26ec"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Model 'tencent/hy3:none' violated the reasoning_level=none invariant: provider reported 416 reasoning token(s)
Invalid JSON. Output: git worktree add -b new-feature ../new-feature{"command": "git worktree add -b new-feature ../new-feature"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git worktree add -b new-feature ../new-feature
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)