Remove untracked files with interactive mode confirmation
Tests ability to use interactive mode confirmation with git clean -i. Evaluates interactive-cleanup workflow knowledge.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo 'tracked' > tracked.txt
  5. 05 git add tracked.txt
  6. 06 git commit -m 'Initial commit'
  7. 07 echo 'junk1' > junk1.txt
  8. 08 echo 'junk2' > junk2.txt
  9. 09 mkdir -p builddir
  10. 10 echo 'obj' > builddir/out.o
Prompt
Remove all untracked files and directories non-interactively (force mode). Output ONLY the git command, nothing else.
Expected
git clean -f -d

Scoped model quality, cost, API time, and token usage for git_clean/f008.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 111 in → 16 out (23 reasoning)
git clean -fd
anthropic/claude-fable-5:high__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-fable-5:low PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-fable-5:low__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-fable-5:max PASS 100% 111 in → 123 out (56 reasoning)
git clean -fd
anthropic/claude-fable-5:max__json_schema PASS 100% 321 in → 97 out (45 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-fable-5:medium PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-fable-5:medium__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-fable-5:xhigh PASS 100% 111 in → 16 out (23 reasoning)
git clean -fd
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-haiku-4.5:high PASS 100% 123 in → 215 out (198 reasoning)
``` git clean -fd ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 286 in → 225 out (200 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-haiku-4.5:low PASS 100% 123 in → 358 out (323 reasoning)
``` git clean -fd ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 286 in → 280 out (265 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-haiku-4.5:medium PASS 100% 123 in → 268 out (246 reasoning)
``` git clean -fd ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 286 in → 703 out (527 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-haiku-4.5:none PASS 100% 94 in → 11 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 256 in → 12 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 123 in → 173 out (157 reasoning)
``` git clean -fd ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 286 in → 1,241 out (641 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-opus-4.6:high PASS 100% 94 in → 12 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.6:low PASS 100% 94 in → 11 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.6:max PASS 100% 94 in → 12 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 257 in → 75 out (49 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.6:medium PASS 100% 94 in → 11 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.6:none PASS 100% 94 in → 11 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.6:xhigh PASS 100% 94 in → 11 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.7:high PASS 100% 116 in → 10 out (0 reasoning)
git clean -fd
anthropic/claude-opus-4.7:high__json_schema PASS 100% 326 in → 17 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.7:low PASS 100% 116 in → 10 out (0 reasoning)
git clean -fd
anthropic/claude-opus-4.7:low__json_schema PASS 100% 326 in → 17 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.7:max PASS 100% 116 in → 15 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 326 in → 17 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.7:medium PASS 100% 116 in → 10 out (0 reasoning)
git clean -fd
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 326 in → 17 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.7:none PASS 100% 116 in → 12 out (0 reasoning)
`git clean -fd`
anthropic/claude-opus-4.7:none__json_schema PASS 100% 326 in → 17 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.7:xhigh PASS 100% 116 in → 12 out (0 reasoning)
`git clean -fd`
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 326 in → 17 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.8:high PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-opus-4.8:high__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.8:low PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-opus-4.8:low__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.8:max PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-opus-4.8:max__json_schema PASS 100% 321 in → 87 out (29 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.8:medium PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.8:none PASS 100% 111 in → 12 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 321 in → 14 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-opus-4.8:xhigh PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-sonnet-4.6:high PASS 100% 94 in → 72 out (46 reasoning)
``` git clean -fd ```
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-sonnet-4.6:low PASS 100% 94 in → 9 out (0 reasoning)
`git clean -fd`
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-sonnet-4.6:max PASS 100% 94 in → 101 out (79 reasoning)
`git clean -fd`
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 257 in → 79 out (52 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-sonnet-4.6:medium PASS 100% 94 in → 9 out (0 reasoning)
`git clean -fd`
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-sonnet-4.6:none PASS 100% 94 in → 11 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 94 in → 72 out (46 reasoning)
``` git clean -fd ```
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 257 in → 11 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-sonnet-5:high PASS 100% 111 in → 12 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-sonnet-5:low PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-sonnet-5:low__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-sonnet-5:medium PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
anthropic/claude-sonnet-5:none PASS 100% 111 in → 12 out (0 reasoning)
``` git clean -fd ```
anthropic/claude-sonnet-5:none__json_schema PASS 100% 321 in → 14 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
anthropic/claude-sonnet-5:xhigh PASS 100% 111 in → 8 out (0 reasoning)
git clean -fd
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 321 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
arcee-ai/trinity-large-thinking:high PASS 100% 72 in → 583 out (597 reasoning)
git clean -fd
arcee-ai/trinity-large-thinking:low PASS 100% 72 in → 350 out (360 reasoning)
git clean -fd
arcee-ai/trinity-large-thinking:medium PASS 100% 72 in → 415 out (422 reasoning)
git clean -fd
arcee-ai/trinity-large-thinking:xhigh PASS 100% 72 in → 434 out (441 reasoning)
git clean -fd
arcee-ai/trinity-mini:high PASS 100% 72 in → 257 out (284 reasoning)
git clean -fd
arcee-ai/trinity-mini:high__json_schema PASS 100% 72 in → 261 out (279 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
arcee-ai/trinity-mini:low__json_schema PASS 100% 72 in → 274 out (301 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
arcee-ai/trinity-mini:medium PASS 100% 72 in → 311 out (356 reasoning)
git clean -fd
arcee-ai/trinity-mini:medium__json_schema PASS 100% 72 in → 363 out (376 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
arcee-ai/trinity-mini:xhigh PASS 100% 72 in → 390 out (428 reasoning)
git clean -fd
arcee-ai/trinity-mini:xhigh__json_schema PASS 100% 72 in → 384 out (397 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
deepseek/deepseek-v4-flash-0731:high PASS 100% 151 in → 43 out (38 reasoning)
git clean -fd
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 151 in → 71 out (63 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
deepseek/deepseek-v4-flash-0731:low PASS 100% 72 in → 169 out (165 reasoning)
git clean -fd
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 72 in → 191 out (173 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
deepseek/deepseek-v4-flash-0731:max PASS 100% 151 in → 77 out (72 reasoning)
git clean -fd
deepseek/deepseek-v4-flash-0731:medium PASS 100% 72 in → 46 out (44 reasoning)
git clean -fd
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 72 in → 171 out (163 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
deepseek/deepseek-v4-flash-0731:none PASS 100% 72 in → 5 out (0 reasoning)
git clean -fd
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 72 in → 12 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 72 in → 162 out (161 reasoning)
git clean -fd
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 72 in → 178 out (166 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
deepseek/deepseek-v4-flash:high PASS 100% 72 in → 171 out (167 reasoning)
git clean -fd
deepseek/deepseek-v4-flash:high__json_schema PASS 100% 164 in → 10 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
deepseek/deepseek-v4-flash:low PASS 100% 72 in → 150 out (144 reasoning)
git clean -fd
deepseek/deepseek-v4-flash:low__json_schema PASS 100% 72 in → 17 out (2 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
deepseek/deepseek-v4-flash:medium PASS 100% 72 in → 244 out (239 reasoning)
git clean -fd
deepseek/deepseek-v4-flash:medium__json_schema PASS 100% 74 in → 98 out (84 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) { "command": "git clean -fdx" }
deepseek/deepseek-v4-flash:none PASS 100% 72 in → 4 out (0 reasoning)
git clean -fd
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 72 in → 14 out (0 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) { "command": "git clean -fdx" }
deepseek/deepseek-v4-flash:xhigh PASS 100% 151 in → 222 out (216 reasoning)
git clean -fd
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 164 in → 9 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
deepseek/deepseek-v4-pro:high PASS 100% 72 in → 148 out (142 reasoning)
git clean -fd
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 259 in → 129 out (118 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
deepseek/deepseek-v4-pro:low PASS 100% 72 in → 71 out (66 reasoning)
git clean -fd
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 259 in → 275 out (264 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
deepseek/deepseek-v4-pro:medium PASS 100% 72 in → 221 out (216 reasoning)
git clean -fd
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 74 in → 268 out (255 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
deepseek/deepseek-v4-pro:none PASS 100% 72 in → 4 out (0 reasoning)
git clean -fd
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 72 in → 9 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 151 in → 255 out (249 reasoning)
git clean -fd
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 153 in → 227 out (213 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
google/gemini-3-flash-preview:high PASS 100% 77 in → 223 out (219 reasoning)
git clean -fd
google/gemini-3-flash-preview:high__json_schema PASS 100% 78 in → 205 out (196 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3-flash-preview:low PASS 100% 77 in → 230 out (226 reasoning)
git clean -fd
google/gemini-3-flash-preview:low__json_schema PASS 100% 134 in → 188 out (179 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3-flash-preview:medium PASS 100% 77 in → 250 out (246 reasoning)
git clean -fd
google/gemini-3-flash-preview:medium__json_schema PASS 100% 134 in → 153 out (145 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3-flash-preview:xhigh PASS 100% 77 in → 242 out (238 reasoning)
git clean -fd
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 134 in → 285 out (277 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 78 in → 307 out (303 reasoning)
git clean -fd
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 78 in → 551 out (542 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.1-flash-lite-preview:low PASS 100% 77 in → 147 out (143 reasoning)
git clean -fd
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 134 in → 113 out (99 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
google/gemini-3.1-flash-lite-preview:medium PASS 100% 77 in → 237 out (233 reasoning)
git clean -fd
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 78 in → 226 out (217 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 78 in → 235 out (231 reasoning)
git clean -fd
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 78 in → 395 out (382 reasoning)
git clean -df
JSON Schema Structured Output
(raw) { "command": "git clean -df" }
google/gemini-3.1-pro-preview:high PASS 100% 77 in → 302 out (298 reasoning)
git clean -fd
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 134 in → 309 out (301 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.1-pro-preview:low PASS 100% 77 in → 166 out (162 reasoning)
git clean -fd
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 134 in → 249 out (240 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.1-pro-preview:medium PASS 100% 77 in → 258 out (254 reasoning)
git clean -fd
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 134 in → 198 out (189 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 77 in → 363 out (359 reasoning)
git clean -fd
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 134 in → 376 out (367 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.5-flash-lite:high PASS 100% 77 in → 214 out (210 reasoning)
git clean -fd
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 134 in → 323 out (315 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.5-flash-lite:low PASS 100% 77 in → 4 out (0 reasoning)
git clean -fd
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 134 in → 9 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.5-flash-lite:max PASS 100% 77 in → 193 out (189 reasoning)
git clean -fd
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 134 in → 210 out (201 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.5-flash-lite:medium PASS 100% 77 in → 199 out (195 reasoning)
git clean -fd
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 134 in → 150 out (141 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 77 in → 208 out (204 reasoning)
git clean -fd
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 134 in → 279 out (271 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.5-flash:high PASS 100% 77 in → 192 out (188 reasoning)
git clean -fd
google/gemini-3.5-flash:high__json_schema PASS 100% 134 in → 291 out (282 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.5-flash:low PASS 100% 77 in → 251 out (247 reasoning)
git clean -fd
google/gemini-3.5-flash:low__json_schema PASS 100% 134 in → 63 out (54 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.5-flash:medium PASS 100% 77 in → 317 out (313 reasoning)
git clean -fd
google/gemini-3.5-flash:medium__json_schema PASS 100% 134 in → 293 out (285 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.5-flash:xhigh PASS 100% 77 in → 294 out (290 reasoning)
git clean -fd
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 134 in → 238 out (229 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemini-3.6-flash:high PASS 100% 77 in → 259 out (255 reasoning)
git clean -fd
google/gemini-3.6-flash:high__json_schema PASS 100% 78 in → 299 out (291 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.6-flash:low PASS 100% 78 in → 172 out (168 reasoning)
git clean -fd
google/gemini-3.6-flash:low__json_schema PASS 100% 78 in → 8 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.6-flash:max PASS 100% 78 in → 245 out (241 reasoning)
git clean -fd
google/gemini-3.6-flash:max__json_schema PASS 100% 134 in → 294 out (286 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.6-flash:medium PASS 100% 78 in → 312 out (308 reasoning)
git clean -fd
google/gemini-3.6-flash:medium__json_schema PASS 100% 78 in → 263 out (255 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemini-3.6-flash:xhigh PASS 100% 78 in → 271 out (267 reasoning)
git clean -fd
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 134 in → 307 out (299 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
google/gemma-4-26b-a4b-it:high PASS 100% 92 in → 428 out (390 reasoning)
git clean -fd
google/gemma-4-26b-a4b-it:low PASS 100% 92 in → 228 out (198 reasoning)
git clean -fd
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 93 in → 308 out (256 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemma-4-26b-a4b-it:medium PASS 100% 93 in → 376 out (332 reasoning)
git clean -fd
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 92 in → 291 out (246 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
google/gemma-4-26b-a4b-it:none PASS 100% 90 in → 5 out (0 reasoning)
git clean -fd
google/gemma-4-26b-a4b-it:none__json_schema PASS 100% 90 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
google/gemma-4-26b-a4b-it:xhigh PASS 100% 93 in → 277 out (234 reasoning)
git clean -fd
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 93 in → 293 out (256 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
google/gemma-4-31b-it:high PASS 100% 93 in → 165 out (1 reasoning)
git clean -fd
google/gemma-4-31b-it:high__json_schema PASS 100% 92 in → 187 out (149 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
google/gemma-4-31b-it:low PASS 100% 93 in → 140 out (119 reasoning)
git clean -fd
google/gemma-4-31b-it:medium PASS 100% 96 in → 232 out (227 reasoning)
git clean -fd
google/gemma-4-31b-it:medium__json_schema PASS 100% 93 in → 224 out (1 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemma-4-31b-it:none PASS 100% 90 in → 5 out (0 reasoning)
git clean -fd
google/gemma-4-31b-it:none__json_schema PASS 100% 90 in → 10 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
google/gemma-4-31b-it:xhigh PASS 100% 92 in → 122 out (113 reasoning)
git clean -fd
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 93 in → 159 out (134 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
ibm-granite/granite-4.1-8b PASS 100% 92 in → 5 out
git clean -fd
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
inclusionai/ling-2.6-flash PASS 100% 91 in → 10 out
```git git clean -fd ```
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
minimax/minimax-m2.5:high__json_schema PASS 100% 118 in → 162 out (166 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
minimax/minimax-m2.5:low PASS 100% 102 in → 598 out (652 reasoning)
git clean -fd
minimax/minimax-m2.5:low__json_schema PASS 100% 102 in → 255 out (251 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
minimax/minimax-m2.5:medium PASS 100% 105 in → 196 out (191 reasoning)
git clean -fd
minimax/minimax-m2.5:medium__json_schema PASS 100% 102 in → 358 out (391 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
minimax/minimax-m2.5:xhigh PASS 100% 102 in → 252 out (251 reasoning)
git clean -fd
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 102 in → 175 out (186 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
minimax/minimax-m2.7:high PASS 100% 102 in → 342 out (363 reasoning)
git clean -fd
minimax/minimax-m2.7:high__json_schema PASS 100% 234 in → 225 out (215 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
minimax/minimax-m2.7:low PASS 100% 102 in → 230 out (242 reasoning)
git clean -fd
minimax/minimax-m2.7:low__json_schema PASS 100% 101 in → 271 out (272 reasoning)
git clean -f -d
JSON Schema Structured Output
(raw) {"command": "git clean -f -d"}
minimax/minimax-m2.7:medium PASS 100% 105 in → 139 out (134 reasoning)
git clean -fd
minimax/minimax-m2.7:medium__json_schema PASS 100% 234 in → 231 out (221 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
minimax/minimax-m2.7:xhigh PASS 100% 102 in → 221 out (232 reasoning)
git clean -fd
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 234 in → 243 out (231 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) {"command": "git clean -fdx"}
minimax/minimax-m3:high PASS 100% 240 in → 169 out (189 reasoning)
git clean -fd
minimax/minimax-m3:high__json_schema PASS 100% 227 in → 12 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
minimax/minimax-m3:low PASS 100% 240 in → 35 out (36 reasoning)
git clean -fd
minimax/minimax-m3:low__json_schema PASS 100% 227 in → 13 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
minimax/minimax-m3:medium PASS 100% 240 in → 35 out (36 reasoning)
git clean -fd
minimax/minimax-m3:medium__json_schema PASS 100% 227 in → 12 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
minimax/minimax-m3:xhigh PASS 100% 240 in → 36 out (35 reasoning)
git clean -fd
minimax/minimax-m3:xhigh__json_schema PASS 100% 188 in → 13 out (12 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
mistralai/devstral-2512 PASS 100% 72 in → 10 out
```bash git clean -fd ```
mistralai/devstral-2512__json_schema PASS 100% 72 in → 10 out
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
mistralai/mistral-medium-3-5:high PASS 100% 84 in → 373 out (395 reasoning)
git clean -fd
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 72 in → 461 out (472 reasoning)
git clean -df
JSON Schema Structured Output
(raw) {"command": "git clean -df"}
mistralai/mistral-medium-3-5:low PASS 100% 84 in → 457 out (479 reasoning)
git clean -fd
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 72 in → 2,311 out (2,239 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
mistralai/mistral-medium-3-5:medium PASS 100% 84 in → 424 out (436 reasoning)
git clean -fd
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 72 in → 466 out (460 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
mistralai/mistral-medium-3-5:none PASS 100% 84 in → 5 out (0 reasoning)
git clean -fd
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 72 in → 10 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 84 in → 286 out (290 reasoning)
git clean -fd
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 72 in → 439 out (447 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
moonshotai/kimi-k2.6:high PASS 100% 72 in → 734 out (729 reasoning)
git clean -fd
moonshotai/kimi-k2.6:low PASS 100% 72 in → 397 out (396 reasoning)
git clean -fd
moonshotai/kimi-k2.6:low__json_schema PASS 100% 71 in → 606 out (477 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
moonshotai/kimi-k2.6:medium PASS 100% 72 in → 378 out (372 reasoning)
git clean -fd
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 71 in → 849 out (752 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
moonshotai/kimi-k2.6:xhigh PASS 100% 72 in → 330 out (326 reasoning)
git clean -fd
moonshotai/kimi-k2.6:xhigh__json_schema PASS 100% 72 in → 623 out (672 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
moonshotai/kimi-k2.7-code:high PASS 100% 71 in → 93 out (87 reasoning)
git clean -fd
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 72 in → 127 out (114 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd"}
moonshotai/kimi-k2.7-code:low PASS 100% 72 in → 167 out (177 reasoning)
git clean -fd
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 72 in → 103 out (96 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
moonshotai/kimi-k2.7-code:medium PASS 100% 72 in → 86 out (80 reasoning)
git clean -fd
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 72 in → 143 out (132 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
moonshotai/kimi-k2.7-code:xhigh PASS 100% 72 in → 120 out (114 reasoning)
git clean -fd
moonshotai/kimi-k3:high PASS 100% 149 in → 75 out (56 reasoning)
git clean -fd
moonshotai/kimi-k3:high__json_schema PASS 100% 149 in → 104 out (85 reasoning)
git clean -fd
moonshotai/kimi-k3:low PASS 100% 149 in → 106 out (87 reasoning)
git clean -fd
moonshotai/kimi-k3:low__json_schema PASS 100% 149 in → 85 out (66 reasoning)
git clean -fd
moonshotai/kimi-k3:max PASS 100% 149 in → 119 out (100 reasoning)
git clean -fd
moonshotai/kimi-k3:max__json_schema PASS 100% 149 in → 119 out (100 reasoning)
git clean -fd
moonshotai/kimi-k3:medium PASS 100% 149 in → 78 out (59 reasoning)
git clean -fd
moonshotai/kimi-k3:medium__json_schema PASS 100% 149 in → 77 out (58 reasoning)
git clean -fd
moonshotai/kimi-k3:xhigh PASS 100% 149 in → 109 out (90 reasoning)
git clean -fd
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 149 in → 132 out (113 reasoning)
git clean -fd
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 85 in → 380 out (376 reasoning)
git clean -fd
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 85 in → 377 out (367 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) { "command": "git clean -fdx" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 85 in → 710 out (751 reasoning)
git clean -fd
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 85 in → 332 out (346 reasoning)
git clean -fdx .
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 85 in → 558 out (574 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
nvidia/nemotron-3-nano-30b-a3b:none__json_schema PASS 100% 85 in → 13 out (0 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) { "command": "git clean -fdx" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 85 in → 322 out (333 reasoning)
git clean -fdx
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 85 in → 224 out (214 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) { "command": "git clean -fdx" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 85 in → 89 out (79 reasoning)
git clean -fd
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 85 in → 200 out (179 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 85 in → 100 out (87 reasoning)
git clean -fd
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 85 in → 77 out (59 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) { "command": "git clean -fdx" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 85 in → 95 out (84 reasoning)
git clean -fd
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 85 in → 115 out (96 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 85 in → 6 out (0 reasoning)
git clean -dfx
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 85 in → 13 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 85 in → 189 out (188 reasoning)
git clean -fd
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 85 in → 197 out (181 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
openai/gpt-5.4-mini:high PASS 100% 68 in → 83 out (73 reasoning)
git clean -fd
openai/gpt-5.4-mini:high__json_schema PASS 100% 103 in → 150 out (132 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4-mini:low PASS 100% 68 in → 37 out (27 reasoning)
git clean -fd
openai/gpt-5.4-mini:low__json_schema PASS 100% 103 in → 52 out (34 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4-mini:medium PASS 100% 68 in → 61 out (51 reasoning)
git clean -fd
openai/gpt-5.4-mini:medium__json_schema PASS 100% 103 in → 89 out (71 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4-mini:none PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.4-mini:none__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4-mini:xhigh PASS 100% 68 in → 135 out (125 reasoning)
git clean -fd
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 103 in → 254 out (236 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4-nano:high PASS 100% 68 in → 26 out (0 reasoning)
git clean -fdx -f --dry-run --quiet && git clean -fdx -f --force
openai/gpt-5.4-nano:low__json_schema PASS 100% 103 in → 18 out (0 reasoning)
git clean -fd -f
JSON Schema Structured Output
(raw) {"command":"git clean -fd -f"}
openai/gpt-5.4-nano:medium PASS 100% 68 in → 24 out (0 reasoning)
git clean -fd -x -f --dry-run && git clean -fd -x -f
openai/gpt-5.4-nano:medium__json_schema PASS 100% 103 in → 17 out (0 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) {"command":"git clean -fdx"}
openai/gpt-5.4-nano:none PASS 100% 68 in → 11 out (0 reasoning)
git clean -fdx --force
openai/gpt-5.4-nano:none__json_schema PASS 100% 103 in → 18 out (0 reasoning)
git clean -fd -f
JSON Schema Structured Output
(raw) {"command":"git clean -fd -f"}
openai/gpt-5.4-nano:xhigh PASS 100% 68 in → 16 out (0 reasoning)
```sh git clean -fdx -f ```
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4:high PASS 100% 68 in → 54 out (44 reasoning)
git clean -fd
openai/gpt-5.4:high__json_schema PASS 100% 103 in → 63 out (45 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4:low PASS 100% 68 in → 26 out (16 reasoning)
git clean -fd
openai/gpt-5.4:low__json_schema PASS 100% 103 in → 42 out (24 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4:medium PASS 100% 68 in → 54 out (44 reasoning)
git clean -fd
openai/gpt-5.4:medium__json_schema PASS 100% 103 in → 60 out (42 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4:none PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.4:none__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.4:xhigh PASS 100% 68 in → 109 out (99 reasoning)
git clean -fd
openai/gpt-5.4:xhigh__json_schema PASS 100% 103 in → 534 out (516 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.5:high PASS 100% 68 in → 45 out (35 reasoning)
git clean -fd
openai/gpt-5.5:high__json_schema PASS 100% 103 in → 104 out (86 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.5:low PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.5:low__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.5:medium PASS 100% 68 in → 45 out (35 reasoning)
git clean -fd
openai/gpt-5.5:medium__json_schema PASS 100% 103 in → 17 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
openai/gpt-5.5:none PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.5:none__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.5:xhigh PASS 100% 68 in → 70 out (60 reasoning)
git clean -fd
openai/gpt-5.5:xhigh__json_schema PASS 100% 103 in → 159 out (140 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
openai/gpt-5.6-luna:high PASS 100% 68 in → 63 out (53 reasoning)
git clean -fd
openai/gpt-5.6-luna:high__json_schema PASS 100% 103 in → 47 out (29 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-luna:low PASS 100% 68 in → 42 out (32 reasoning)
git clean -fd
openai/gpt-5.6-luna:low__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-luna:max PASS 100% 68 in → 114 out (104 reasoning)
git clean -fd
openai/gpt-5.6-luna:max__json_schema PASS 100% 103 in → 270 out (252 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-luna:medium PASS 100% 68 in → 50 out (40 reasoning)
git clean -fd
openai/gpt-5.6-luna:medium__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-luna:none PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-luna:none__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-luna:xhigh PASS 100% 68 in → 95 out (85 reasoning)
git clean -fd
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 103 in → 57 out (39 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-sol:high PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-sol:high__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-sol:low PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-sol:low__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-sol:max PASS 100% 68 in → 49 out (39 reasoning)
git clean -fd
openai/gpt-5.6-sol:max__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-sol:medium PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-sol:medium__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-sol:none PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-sol:none__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-sol:xhigh PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-terra:high PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-terra:high__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-terra:low PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-terra:low__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-terra:max PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-terra:max__json_schema PASS 100% 103 in → 175 out (157 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-terra:medium PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-terra:medium__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-terra:none PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-terra:none__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-5.6-terra:xhigh PASS 100% 68 in → 8 out (0 reasoning)
git clean -fd
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 103 in → 16 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-oss-120b:high PASS 100% 127 in → 549 out (559 reasoning)
git clean -fd
openai/gpt-oss-120b:high__json_schema PASS 100% 129 in → 786 out (756 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
openai/gpt-oss-120b:low PASS 100% 129 in → 70 out (55 reasoning)
git clean -fd
openai/gpt-oss-120b:low__json_schema PASS 100% 131 in → 127 out (116 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-oss-120b:medium PASS 100% 131 in → 117 out (115 reasoning)
git clean -fd
openai/gpt-oss-120b:medium__json_schema PASS 100% 129 in → 129 out (111 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-oss-120b:xhigh PASS 100% 127 in → 450 out (473 reasoning)
git clean -fd
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 129 in → 449 out (438 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
openai/gpt-oss-20b:high PASS 100% 129 in → 638 out (631 reasoning)
git clean -f -d
openai/gpt-oss-20b:low__json_schema PASS 100% 129 in → 9 out (0 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) {"command":"git clean -fdx"}
openai/gpt-oss-20b:medium PASS 100% 127 in → 187 out (174 reasoning)
git clean -fd
openai/gpt-oss-20b:medium__json_schema PASS 100% 131 in → 378 out (386 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
openai/gpt-oss-20b:xhigh PASS 100% 129 in → 247 out (231 reasoning)
git clean -fdx
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 116 in → 667 out (679 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
poolside/laguna-m.1:high PASS 100% 82 in → 305 out (298 reasoning)
git clean -fd
poolside/laguna-m.1:high__json_schema PASS 100% 82 in → 358 out (342 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
poolside/laguna-m.1:low PASS 100% 82 in → 426 out (419 reasoning)
git clean -fd
poolside/laguna-m.1:low__json_schema PASS 100% 82 in → 310 out (299 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
poolside/laguna-m.1:medium PASS 100% 82 in → 536 out (529 reasoning)
git clean -fd
poolside/laguna-m.1:medium__json_schema PASS 100% 82 in → 362 out (346 reasoning)
git clean -df
JSON Schema Structured Output
(raw) { "command": "git clean -df" }
poolside/laguna-m.1:none PASS 100% 82 in → 6 out (0 reasoning)
git clean -fd
poolside/laguna-m.1:none__json_schema PASS 100% 82 in → 10 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
poolside/laguna-m.1:xhigh PASS 100% 82 in → 187 out (180 reasoning)
git clean -fd
poolside/laguna-m.1:xhigh__json_schema PASS 100% 82 in → 229 out (218 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
poolside/laguna-xs-2.1:high PASS 100% 82 in → 161 out (156 reasoning)
git clean -df
poolside/laguna-xs-2.1:high__json_schema PASS 100% 82 in → 468 out (453 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
poolside/laguna-xs-2.1:low PASS 100% 82 in → 311 out (306 reasoning)
git clean -fd
poolside/laguna-xs-2.1:low__json_schema PASS 100% 82 in → 269 out (258 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
poolside/laguna-xs-2.1:medium PASS 100% 82 in → 127 out (122 reasoning)
git clean -fd
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 82 in → 249 out (234 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
poolside/laguna-xs-2.1:none PASS 100% 82 in → 4 out (0 reasoning)
git clean -fd
poolside/laguna-xs-2.1:none__json_schema PASS 100% 82 in → 14 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
poolside/laguna-xs-2.1:xhigh PASS 100% 82 in → 132 out (127 reasoning)
git clean -fd
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 82 in → 150 out (139 reasoning)
git clean -df
JSON Schema Structured Output
(raw) {"command": "git clean -df"}
poolside/laguna-xs.2:high PASS 100% 119 in → 77 out (70 reasoning)
git clean -fd
poolside/laguna-xs.2:high__json_schema PASS 100% 119 in → 213 out (202 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
poolside/laguna-xs.2:low PASS 100% 119 in → 113 out (106 reasoning)
git clean -fd
poolside/laguna-xs.2:low__json_schema PASS 100% 119 in → 156 out (145 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
poolside/laguna-xs.2:medium PASS 100% 119 in → 115 out (108 reasoning)
git clean -fd
poolside/laguna-xs.2:medium__json_schema PASS 100% 119 in → 128 out (112 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
poolside/laguna-xs.2:none PASS 100% 119 in → 6 out (0 reasoning)
git clean -fd
poolside/laguna-xs.2:none__json_schema PASS 100% 119 in → 10 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
poolside/laguna-xs.2:xhigh PASS 100% 119 in → 150 out (143 reasoning)
git clean -fd
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 119 in → 166 out (150 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-27b:high PASS 100% 82 in → 820 out (778 reasoning)
git clean -fd
qwen/qwen3.6-27b:high__json_schema PASS 100% 82 in → 1,125 out (1,055 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-27b:low PASS 100% 82 in → 891 out (882 reasoning)
git clean -fd
qwen/qwen3.6-27b:low__json_schema PASS 100% 82 in → 1,289 out (1,176 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-27b:medium PASS 100% 82 in → 777 out (725 reasoning)
git clean -fd
qwen/qwen3.6-27b:medium__json_schema PASS 100% 82 in → 1,291 out (1,220 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-27b:none PASS 100% 84 in → 5 out (0 reasoning)
git clean -fd
qwen/qwen3.6-27b:none__json_schema PASS 100% 84 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-27b:xhigh PASS 100% 82 in → 1,053 out (1,019 reasoning)
git clean -fd
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 82 in → 995 out (916 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-35b-a3b:high PASS 100% 82 in → 821 out (761 reasoning)
git clean -fd
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 82 in → 677 out (647 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-35b-a3b:low PASS 100% 82 in → 1,095 out (1,036 reasoning)
git clean -df
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 82 in → 1,039 out (974 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 82 in → 956 out (910 reasoning)
git clean -fd
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 82 in → 849 out (793 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-35b-a3b:none PASS 100% 84 in → 5 out (0 reasoning)
git clean -fd
qwen/qwen3.6-35b-a3b:none__json_schema PASS 100% 84 in → 15 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 82 in → 821 out (793 reasoning)
git clean -df
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 82 in → 1,061 out (995 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
qwen/qwen3.6-flash:high PASS 100% 82 in → 1,497 out (1,488 reasoning)
git clean -fd
qwen/qwen3.6-flash:low PASS 100% 82 in → 797 out (788 reasoning)
git clean -fd
qwen/qwen3.6-flash:medium PASS 100% 82 in → 1,010 out (1,001 reasoning)
git clean -fd
qwen/qwen3.6-flash:none PASS 100% 84 in → 4 out (0 reasoning)
git clean -fd
qwen/qwen3.6-flash:xhigh PASS 100% 82 in → 936 out (927 reasoning)
git clean -fd
qwen/qwen3.7-flash:high PASS 100% 82 in → 1,056 out (1,047 reasoning)
git clean -fd
qwen/qwen3.7-flash:low PASS 100% 82 in → 943 out (934 reasoning)
git clean -fd
qwen/qwen3.7-flash:max PASS 100% 82 in → 404 out (395 reasoning)
git clean -fd
qwen/qwen3.7-flash:medium PASS 100% 82 in → 380 out (371 reasoning)
git clean -fd
qwen/qwen3.7-flash:none PASS 100% 84 in → 4 out (0 reasoning)
git clean -fd
qwen/qwen3.7-flash:xhigh PASS 100% 82 in → 1,115 out (1,106 reasoning)
git clean -df
qwen/qwen3.7-max:high PASS 100% 82 in → 605 out (596 reasoning)
git clean -fd
qwen/qwen3.7-max:low PASS 100% 82 in → 418 out (409 reasoning)
git clean -fd
qwen/qwen3.7-max:medium PASS 100% 82 in → 650 out (641 reasoning)
git clean -fd
qwen/qwen3.7-max:none PASS 100% 84 in → 4 out (0 reasoning)
git clean -fd
qwen/qwen3.7-max:xhigh PASS 100% 82 in → 588 out (579 reasoning)
git clean -fd
qwen/qwen3.7-plus:high PASS 100% 82 in → 683 out (674 reasoning)
git clean -fd
qwen/qwen3.7-plus:low PASS 100% 82 in → 398 out (389 reasoning)
git clean -fd
qwen/qwen3.7-plus:medium PASS 100% 82 in → 546 out (537 reasoning)
git clean -fd
qwen/qwen3.7-plus:none PASS 100% 84 in → 4 out (0 reasoning)
git clean -fd
qwen/qwen3.7-plus:xhigh PASS 100% 82 in → 628 out (619 reasoning)
git clean -fd
tencent/hy3:high PASS 100% 77 in → 298 out (292 reasoning)
git clean -fd
tencent/hy3:high__json_schema PASS 100% 77 in → 376 out (380 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
tencent/hy3:low PASS 100% 77 in → 138 out (130 reasoning)
git clean -f -d
tencent/hy3:low__json_schema PASS 100% 77 in → 376 out (353 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
tencent/hy3:medium PASS 100% 77 in → 382 out (376 reasoning)
git clean -fd
tencent/hy3:medium__json_schema PASS 100% 77 in → 218 out (203 reasoning)
git clean -f -d
JSON Schema Structured Output
(raw) { "command": "git clean -f -d" }
tencent/hy3:none PASS 100% 80 in → 5 out (0 reasoning)
git clean -fd
tencent/hy3:none__json_schema PASS 100% 80 in → 12 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
tencent/hy3:xhigh PASS 100% 77 in → 438 out (432 reasoning)
git clean -fd
tencent/hy3:xhigh__json_schema PASS 100% 77 in → 447 out (458 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
thinkingmachines/inkling-small:high PASS 100% 77 in → 126 out (109 reasoning)
git clean -fd -f
thinkingmachines/inkling-small:high__json_schema PASS 100% 77 in → 356 out (338 reasoning)
git clean -fd -f
JSON Schema Structured Output
(raw) { "command": "git clean -fd -f" }
thinkingmachines/inkling-small:low PASS 100% 77 in → 100 out (88 reasoning)
git clean -fd -f
thinkingmachines/inkling-small:low__json_schema PASS 100% 77 in → 150 out (131 reasoning)
git clean -fd -f
JSON Schema Structured Output
(raw) { "command": "git clean -fd -f" }
thinkingmachines/inkling-small:max PASS 100% 77 in → 209 out (199 reasoning)
git clean -fd
thinkingmachines/inkling-small:max__json_schema PASS 100% 77 in → 563 out (545 reasoning)
git clean -fd --force
JSON Schema Structured Output
(raw) { "command": "git clean -fd --force" }
thinkingmachines/inkling-small:medium PASS 100% 77 in → 185 out (173 reasoning)
git clean -fd -f
thinkingmachines/inkling-small:medium__json_schema PASS 100% 77 in → 340 out (321 reasoning)
git clean -fd -f
JSON Schema Structured Output
(raw) { "command": "git clean -fd -f" }
thinkingmachines/inkling-small:xhigh PASS 100% 77 in → 988 out (1,013 reasoning)
git clean -fd
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 77 in → 153 out (137 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
thinkingmachines/inkling:high PASS 100% 77 in → 274 out (258 reasoning)
git clean -fd
thinkingmachines/inkling:low PASS 100% 77 in → 21 out (10 reasoning)
git clean -fd
thinkingmachines/inkling:low__json_schema PASS 100% 77 in → 56 out (40 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
thinkingmachines/inkling:max PASS 100% 77 in → 175 out (165 reasoning)
git clean -fd
thinkingmachines/inkling:max__json_schema PASS 100% 77 in → 307 out (290 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
thinkingmachines/inkling:medium PASS 100% 77 in → 205 out (195 reasoning)
git clean -fd
thinkingmachines/inkling:medium__json_schema PASS 100% 77 in → 182 out (165 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
thinkingmachines/inkling:none__json_schema PASS 100% 75 in → 12 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
thinkingmachines/inkling:xhigh PASS 100% 77 in → 302 out (292 reasoning)
git clean -fd
thinkingmachines/inkling:xhigh__json_schema PASS 100% 77 in → 277 out (264 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
x-ai/grok-4.3:high PASS 100% 247 in → 162 out (158 reasoning)
git clean -fd
x-ai/grok-4.3:high__json_schema PASS 100% 303 in → 230 out (222 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
x-ai/grok-4.3:low PASS 100% 253 in → 180 out (176 reasoning)
git clean -fd
x-ai/grok-4.3:low__json_schema PASS 100% 309 in → 307 out (299 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
x-ai/grok-4.3:max PASS 100% 247 in → 354 out (350 reasoning)
git clean -fd
x-ai/grok-4.3:max__json_schema PASS 100% 303 in → 682 out (670 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
x-ai/grok-4.3:medium PASS 100% 253 in → 176 out (170 reasoning)
`git clean -fd`
x-ai/grok-4.3:medium__json_schema PASS 100% 309 in → 577 out (565 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
x-ai/grok-4.3:none PASS 100% 245 in → 4 out (0 reasoning)
git clean -fd
x-ai/grok-4.3:none__json_schema PASS 100% 301 in → 8 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
x-ai/grok-4.3:xhigh PASS 100% 247 in → 185 out (179 reasoning)
`git clean -fd`
x-ai/grok-4.3:xhigh__json_schema PASS 100% 303 in → 412 out (404 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
x-ai/grok-4.5:high PASS 100% 271 in → 142 out (134 reasoning)
``` git clean -fd ```
x-ai/grok-4.5:high__json_schema PASS 100% 337 in → 318 out (309 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
x-ai/grok-4.5:low PASS 100% 271 in → 175 out (167 reasoning)
``` git clean -fd ```
x-ai/grok-4.5:low__json_schema PASS 100% 337 in → 141 out (132 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
x-ai/grok-4.5:max PASS 100% 271 in → 266 out (262 reasoning)
git clean -fd
x-ai/grok-4.5:max__json_schema PASS 100% 337 in → 296 out (287 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
x-ai/grok-4.5:medium PASS 100% 271 in → 283 out (279 reasoning)
git clean -fd
x-ai/grok-4.5:medium__json_schema PASS 100% 337 in → 398 out (389 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
x-ai/grok-4.5:xhigh PASS 100% 271 in → 229 out (225 reasoning)
git clean -fd
x-ai/grok-4.5:xhigh__json_schema PASS 100% 337 in → 351 out (342 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command":"git clean -fd"}
z-ai/glm-4.7-flash:high PASS 100% 74 in → 454 out (454 reasoning)
git clean -fd
z-ai/glm-4.7-flash:low PASS 100% 74 in → 531 out (507 reasoning)
git clean -fd
z-ai/glm-4.7-flash:low__json_schema PASS 100% 74 in → 571 out (566 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
z-ai/glm-4.7-flash:medium PASS 100% 74 in → 559 out (547 reasoning)
git clean -fd
z-ai/glm-4.7-flash:none PASS 100% 74 in → 5 out (0 reasoning)
git clean -fdx
z-ai/glm-4.7-flash:none__json_schema PASS 100% 74 in → 19 out (0 reasoning)
rm -rf builddir junk1.txt junk2.txt
JSON Schema Structured Output
(raw) {"command": "rm -rf builddir junk1.txt junk2.txt"}
z-ai/glm-4.7-flash:xhigh PASS 100% 74 in → 411 out (401 reasoning)
git clean -fd
z-ai/glm-5.2:high PASS 100% 81 in → 323 out (322 reasoning)
git clean -fd
z-ai/glm-5.2:high__json_schema PASS 100% 74 in → 374 out (347 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
z-ai/glm-5.2:low PASS 100% 81 in → 345 out (339 reasoning)
git clean -fd
z-ai/glm-5.2:low__json_schema PASS 100% 81 in → 398 out (393 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
z-ai/glm-5.2:medium PASS 100% 81 in → 272 out (249 reasoning)
git clean -fd
z-ai/glm-5.2:medium__json_schema PASS 100% 81 in → 393 out (380 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
z-ai/glm-5.2:none PASS 100% 75 in → 5 out (0 reasoning)
git clean -fd
z-ai/glm-5.2:none__json_schema PASS 100% 75 in → 13 out (0 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
z-ai/glm-5.2:xhigh PASS 100% 81 in → 233 out (211 reasoning)
git clean -fd
z-ai/glm-5.2:xhigh__json_schema PASS 100% 81 in → 405 out (392 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -fd" }
arcee-ai/trinity-mini:low FAIL 25% 72 in → 335 out (375 reasoning)
gitclean -fd
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
liquid/lfm-2-24b-a2b FAIL 25% 81 in → 19 out
git rm -rf --force builddir/out.o junk1.txt junk2.txt
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
minimax/minimax-m2.5:high FAIL 25% 107 in → 137 out (147 reasoning)
clean -fd
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
moonshotai/kimi-k2.6:high__json_schema FAIL 25% 72 in → 558 out (617 reasoning)
sed -i 's/xyz/abc/' /path/to/file
JSON Schema Structured Output
(raw) { "command": "sed -i 's/xyz/abc/' /path/to/file" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
nvidia/nemotron-3-nano-30b-a3b:none FAIL 25% 85 in → 6 out (0 reasoning)
git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
openai/gpt-5.4-nano:high__json_schema FAIL 25% 103 in → 20 out (0 reasoning)
git clean -fd -x -n
JSON Schema Structured Output
(raw) {"command":"git clean -fd -x -n"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
openai/gpt-5.4-nano:low FAIL 25% 68 in → 14 out (0 reasoning)
git clean -fd -f -n --force
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
openai/gpt-oss-20b:high__json_schema FAIL 25% 129 in → 11 out (0 reasoning)
??
JSON Schema Structured Output
(raw) { "command": "??" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
openai/gpt-oss-20b:low FAIL 25% 127 in → 27 out (12 reasoning)
git clean -fdz
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
thinkingmachines/inkling-small:none FAIL 25% 77 in → 9 out (0 reasoning)
git clean -fd -f<|end_message|>
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
thinkingmachines/inkling:none FAIL 25% 77 in → 8 out (0 reasoning)
git clean -fdx<|end_message|>
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'junk1.txt'}, {'type': 'file_not_exists', 'path': 'junk2.txt'}, {'type': 'dir_not_exists', 'path': 'builddir'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fd
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fd
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: OpenAI-compatible response contained provider error: The operation was aborted
Invalid JSON. Output: git rm -rf --force builddir/out.o junk1.txt junk2.txt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1bf0738f-4ca1-99d6-9e06-32d90d51b105","request_id":"1bf0738f-4ca1-99d6-9e06-32d90d51b105"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-744f1789-0603-9df6-a429-78cfb7ff0b01","request_id":"744f1789-0603-9df6-a429-78cfb7ff0b01"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-92f681c7-adf5-9b0b-941d-457407be64cd","request_id":"92f681c7-adf5-9b0b-941d-457407be64cd"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-0e234a55-c8f9-9c96-be22-0176281abee2","request_id":"0e234a55-c8f9-9c96-be22-0176281abee2"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-5bdd5179-bba2-9101-b64f-a07fcd1515f2","request_id":"5bdd5179-bba2-9101-b64f-a07fcd1515f2"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-9a9806d5-e868-9cba-89d8-d343ebf05283"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-b8ff1641-3408-9519-ad40-d5f0382e9c9d"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-35fa02bb-359d-9c5b-bde0-c396940b6988"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-9378af7d-30c6-9bcd-acd8-6f491c3e9aa1"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-09bc90f3-fb92-987a-92e7-e6dfe53a544f"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-e4fdc09b-7ebb-9be5-8f7e-8acc2c6b9b80"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-b3c713f6-45ee-9db0-8c80-c308f06553d4","request_id":"b3c713f6-45ee-9db0-8c80-c308f06553d4"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-bf54d7cd-8332-9aca-8019-490a41a89e83","request_id":"bf54d7cd-8332-9aca-8019-490a41a89e83"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-9f38e4b3-beef-9072-ba5e-6772c5a8088c","request_id":"9f38e4b3-beef-9072-ba5e-6772c5a8088c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-79bcde41-77b5-96a0-9a52-e5cb6df41ade","request_id":"79bcde41-77b5-96a0-9a52-e5cb6df41ade"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-72bc2e50-d41f-9c77-840f-94b518624d56","request_id":"72bc2e50-d41f-9c77-840f-94b518624d56"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-09eb3f4b-fcb8-9abb-947f-b85b694a7cd8","request_id":"09eb3f4b-fcb8-9abb-947f-b85b694a7cd8"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-2999661f-6387-9332-b3e7-fd929e86f8ba","request_id":"2999661f-6387-9332-b3e7-fd929e86f8ba"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-9e901d4a-c228-916c-9174-1c840188acfa","request_id":"9e901d4a-c228-916c-9174-1c840188acfa"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f229c4d6-c02a-9276-be8e-58c9c398f09e","request_id":"f229c4d6-c02a-9276-be8e-58c9c398f09e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a012a683-9152-9351-b33e-e1be1aee69f0","request_id":"a012a683-9152-9351-b33e-e1be1aee69f0"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: git clean -fd -f{"command": "git clean -fd -f"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fd
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)