Remove all untracked and ignored files
Tests ability to remove both untracked and ignored files with git clean -fx. Evaluates comprehensive cleanup flags.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo '*.log' > .gitignore
  5. 05 echo 'tracked' > tracked.txt
  6. 06 git add .gitignore tracked.txt
  7. 07 git commit -m 'Initial commit'
  8. 08 echo 'data' > debug.log
  9. 09 echo 'untracked' > notes.txt
Prompt
Remove all untracked and ignored files (but not directories). Output ONLY the git command, nothing else.
Expected
git clean -f -x

Scoped model quality, cost, API time, and token usage for git_clean/f005.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5.1:high PASS 100% 78 in → 8 out (0 reasoning)
git clean -fx
anthropic/claude-fable-5.1:low PASS 100% 78 in → 8 out (0 reasoning)
git clean -fx
anthropic/claude-fable-5.1:low__json_schema PASS 100% 288 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-fable-5.1:max PASS 100% 78 in → 110 out (102 reasoning)
git clean -fx
anthropic/claude-fable-5.1:max__json_schema PASS 100% 288 in → 106 out (91 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-fable-5.1:medium PASS 100% 78 in → 8 out (0 reasoning)
git clean -fx
anthropic/claude-fable-5.1:medium__json_schema PASS 100% 288 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-fable-5.1:xhigh PASS 100% 78 in → 98 out (90 reasoning)
git clean -fx
anthropic/claude-fable-5.1:xhigh__json_schema PASS 100% 288 in → 75 out (59 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-fable-5:high PASS 100% 76 in → 49 out (32 reasoning)
git clean -fx
anthropic/claude-fable-5:high__json_schema PASS 100% 286 in → 44 out (45 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-fable-5:low PASS 100% 76 in → 26 out (32 reasoning)
git clean -f -x
anthropic/claude-fable-5:low__json_schema PASS 100% 286 in → 16 out (0 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-fable-5:max PASS 100% 76 in → 212 out (74 reasoning)
``` git clean -fx ```
anthropic/claude-fable-5:max__json_schema PASS 100% 286 in → 163 out (64 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-fable-5:medium PASS 100% 76 in → 41 out (33 reasoning)
``` git clean -f -x ```
anthropic/claude-fable-5:medium__json_schema PASS 100% 286 in → 46 out (34 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-fable-5:xhigh PASS 100% 76 in → 89 out (64 reasoning)
``` git clean -fx ```
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 286 in → 77 out (44 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-haiku-4.5:high PASS 100% 88 in → 1,298 out (720 reasoning)
``` git clean -f -x ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 251 in → 979 out (580 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-haiku-4.5:low PASS 100% 88 in → 347 out (319 reasoning)
``` git clean -f -x ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 251 in → 890 out (546 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-haiku-4.5:medium PASS 100% 88 in → 4,694 out (1,764 reasoning)
``` git clean -fx ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 251 in → 359 out (315 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 88 in → 609 out (522 reasoning)
``` git clean -fx ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 251 in → 348 out (324 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-opus-4.6:high PASS 100% 59 in → 12 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 222 in → 123 out (101 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:low PASS 100% 59 in → 11 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 222 in → 11 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:max PASS 100% 59 in → 217 out (185 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 222 in → 117 out (94 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:medium PASS 100% 59 in → 11 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 222 in → 11 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:none PASS 100% 59 in → 11 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 222 in → 11 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:xhigh PASS 100% 59 in → 157 out (134 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 222 in → 97 out (76 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:high PASS 100% 81 in → 12 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.7:high__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:low PASS 100% 81 in → 10 out (0 reasoning)
git clean -fx
anthropic/claude-opus-4.7:low__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:max PASS 100% 81 in → 15 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:medium PASS 100% 81 in → 12 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:none PASS 100% 81 in → 12 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.7:none__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:xhigh PASS 100% 81 in → 12 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.8:high PASS 100% 76 in → 8 out (0 reasoning)
git clean -fx
anthropic/claude-opus-4.8:high__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-opus-4.8:low PASS 100% 76 in → 10 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.8:low__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.8:max PASS 100% 76 in → 321 out (74 reasoning)
`git clean -fx`
anthropic/claude-opus-4.8:max__json_schema PASS 100% 286 in → 206 out (61 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-opus-4.8:medium PASS 100% 76 in → 8 out (0 reasoning)
git clean -fx
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.8:none PASS 100% 76 in → 12 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
anthropic/claude-opus-4.8:xhigh PASS 100% 76 in → 133 out (69 reasoning)
`git clean -fx`
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-5.5:high PASS 100% 78 in → 52 out (44 reasoning)
git clean -fx
anthropic/claude-opus-5.5:high__json_schema PASS 100% 288 in → 46 out (31 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-opus-5.5:low PASS 100% 78 in → 31 out (0 reasoning)
git clean -fX && git clean -f Actually, simpler: `git clean -fx`
anthropic/claude-opus-5.5:low__json_schema PASS 100% 288 in → 16 out (0 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-opus-5.5:max PASS 100% 78 in → 152 out (140 reasoning)
``` git clean -fx ```
anthropic/claude-opus-5.5:max__json_schema PASS 100% 288 in → 116 out (101 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-opus-5.5:medium PASS 100% 78 in → 45 out (33 reasoning)
``` git clean -fx ```
anthropic/claude-opus-5.5:medium__json_schema PASS 100% 288 in → 50 out (34 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-opus-5.5:xhigh PASS 100% 78 in → 61 out (53 reasoning)
git clean -fx
anthropic/claude-opus-5.5:xhigh__json_schema PASS 100% 288 in → 59 out (44 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-5:high PASS 100% 76 in → 41 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-5:high__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-5:low PASS 100% 76 in → 10 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-5:low__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-5:max PASS 100% 76 in → 89 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-5:max__json_schema PASS 100% 286 in → 45 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-5:medium PASS 100% 76 in → 10 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-5:medium__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-5:xhigh PASS 100% 76 in → 53 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-5:xhigh__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-sonnet-4.6:high PASS 100% 59 in → 129 out (109 reasoning)
``` git clean -fx ```
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 222 in → 171 out (146 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-4.6:max PASS 100% 59 in → 289 out (217 reasoning)
``` git clean -fx ```
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 222 in → 147 out (122 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 59 in → 105 out (81 reasoning)
``` git clean -fx ```
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 222 in → 208 out (178 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-5:high PASS 100% 76 in → 13 out (0 reasoning)
``` git clean -x -f ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -xf
JSON Schema Structured Output
(raw) {"command": "git clean -xf"}
anthropic/claude-sonnet-5:low__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-5:medium PASS 100% 76 in → 12 out (0 reasoning)
``` git clean -xf ```
anthropic/claude-sonnet-5:none PASS 100% 76 in → 12 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-sonnet-5:none__json_schema PASS 100% 286 in → 14 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
arcee-ai/trinity-large-thinking:high PASS 100% 50 in → 738 out (734 reasoning)
git clean -xf
arcee-ai/trinity-large-thinking:low PASS 100% 50 in → 1,109 out (1,115 reasoning)
git clean -fx
arcee-ai/trinity-large-thinking:medium PASS 100% 50 in → 368 out (362 reasoning)
git clean -f -x
arcee-ai/trinity-large-thinking:xhigh PASS 100% 50 in → 964 out (963 reasoning)
git clean -fx
arcee-ai/trinity-mini:high PASS 100% 50 in → 329 out (350 reasoning)
git clean -f -x
arcee-ai/trinity-mini:low PASS 100% 50 in → 373 out (409 reasoning)
git clean -f -x
arcee-ai/trinity-mini:medium PASS 100% 50 in → 505 out (542 reasoning)
git clean -f -x
arcee-ai/trinity-mini:medium__json_schema PASS 100% 50 in → 1,254 out (1,290 reasoning)
git clean -x -f
JSON Schema Structured Output
(raw) { "command": "git clean -x -f" }
arcee-ai/trinity-mini:xhigh PASS 100% 50 in → 683 out (703 reasoning)
git clean -f -x
arcee-ai/trinity-mini:xhigh__json_schema PASS 100% 50 in → 371 out (375 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command":"git clean -f -x" }
deepseek/deepseek-v4-flash-0731:high PASS 100% 53 in → 356 out (348 reasoning)
git clean -f -x
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 126 in → 903 out (951 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
deepseek/deepseek-v4-flash-0731:low PASS 100% 47 in → 231 out (219 reasoning)
git clean -fx
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 47 in → 292 out (275 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
deepseek/deepseek-v4-flash-0731:max PASS 100% 126 in → 1,568 out (1,623 reasoning)
git clean -fx
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 126 in → 4,585 out (4,599 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 47 in → 320 out (314 reasoning)
git clean -fx
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 47 in → 277 out (268 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx"}
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 47 in → 374 out (403 reasoning)
git clean -fx
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 47 in → 354 out (331 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
deepseek/deepseek-v4-flash:high PASS 100% 47 in → 451 out (420 reasoning)
git clean -fx
deepseek/deepseek-v4-flash:low PASS 100% 47 in → 394 out (386 reasoning)
git clean -f -x
deepseek/deepseek-v4-flash:xhigh PASS 100% 126 in → 496 out (488 reasoning)
git clean -f -x
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 126 in → 777 out (775 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
deepseek/deepseek-v4-pro:high PASS 100% 47 in → 266 out (258 reasoning)
git clean -f -x
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 234 in → 227 out (217 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
deepseek/deepseek-v4-pro:low PASS 100% 47 in → 329 out (321 reasoning)
git clean -f -x
deepseek/deepseek-v4-pro:medium PASS 100% 47 in → 335 out (329 reasoning)
git clean -fx
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 234 in → 358 out (347 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 49 in → 12 out (0 reasoning)
rm -f notes.txt debug.log
JSON Schema Structured Output
(raw) {"command": "rm -f notes.txt debug.log"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 126 in → 1,228 out (1,223 reasoning)
git clean -fx
deepseek/deepseek-v4.1-flash:high PASS 100% 73 in → 930 out (924 reasoning)
git clean -fx
deepseek/deepseek-v4.1-flash:high__json_schema PASS 100% 73 in → 1,084 out (1,102 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
deepseek/deepseek-v4.1-flash:low PASS 100% 73 in → 640 out (635 reasoning)
git clean -fx
deepseek/deepseek-v4.1-flash:low__json_schema PASS 100% 73 in → 319 out (309 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
deepseek/deepseek-v4.1-flash:max PASS 100% 73 in → 1,822 out (1,816 reasoning)
git clean -fx
deepseek/deepseek-v4.1-flash:max__json_schema PASS 100% 73 in → 262 out (252 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
deepseek/deepseek-v4.1-flash:medium PASS 100% 73 in → 759 out (753 reasoning)
git clean -fx
deepseek/deepseek-v4.1-flash:medium__json_schema PASS 100% 73 in → 311 out (299 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
deepseek/deepseek-v4.1-flash:none__json_schema PASS 100% 47 in → 16 out (0 reasoning)
git clean -fX && git clean -f
JSON Schema Structured Output
(raw) {"command": "git clean -fX && git clean -f"}
deepseek/deepseek-v4.1-flash:xhigh PASS 100% 73 in → 570 out (564 reasoning)
git clean -fx
deepseek/deepseek-v4.1-flash:xhigh__json_schema PASS 100% 73 in → 427 out (415 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemini-3-flash-preview:high PASS 100% 49 in → 210 out (206 reasoning)
git clean -fx
google/gemini-3-flash-preview:high__json_schema PASS 100% 106 in → 271 out (261 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
google/gemini-3-flash-preview:low PASS 100% 49 in → 229 out (225 reasoning)
git clean -fx
google/gemini-3-flash-preview:low__json_schema PASS 100% 106 in → 324 out (316 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3-flash-preview:medium PASS 100% 49 in → 228 out (224 reasoning)
git clean -fx
google/gemini-3-flash-preview:medium__json_schema PASS 100% 106 in → 328 out (320 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3-flash-preview:xhigh PASS 100% 49 in → 256 out (252 reasoning)
git clean -fx
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 106 in → 348 out (339 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 50 in → 359 out (355 reasoning)
git clean -xf
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 50 in → 474 out (465 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 106 in → 123 out (112 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.1-flash-lite-preview:medium PASS 100% 49 in → 349 out (345 reasoning)
git clean -fx
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 50 in → 175 out (161 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 49 in → 454 out (450 reasoning)
git clean -fx
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 106 in → 526 out (515 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.1-pro-preview:high PASS 100% 49 in → 396 out (392 reasoning)
git clean -fx
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 106 in → 335 out (326 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-pro-preview:low PASS 100% 49 in → 319 out (315 reasoning)
git clean -fx
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 106 in → 296 out (287 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-pro-preview:medium PASS 100% 49 in → 316 out (312 reasoning)
git clean -fx
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 106 in → 187 out (178 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 49 in → 448 out (444 reasoning)
git clean -fx
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 106 in → 269 out (260 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.5-flash-lite:high PASS 100% 50 in → 601 out (597 reasoning)
git clean -fx
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 50 in → 422 out (411 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.5-flash-lite:max PASS 100% 50 in → 300 out (296 reasoning)
git clean -fx
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 106 in → 450 out (439 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.5-flash-lite:medium PASS 100% 49 in → 396 out (392 reasoning)
git clean -fx
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 106 in → 460 out (450 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 49 in → 630 out (626 reasoning)
git clean -xf
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 106 in → 379 out (369 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
google/gemini-3.5-flash:high PASS 100% 49 in → 478 out (474 reasoning)
git clean -fx
google/gemini-3.5-flash:high__json_schema PASS 100% 106 in → 460 out (451 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.5-flash:low PASS 100% 49 in → 348 out (344 reasoning)
git clean -fx
google/gemini-3.5-flash:low__json_schema PASS 100% 106 in → 159 out (145 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemini-3.5-flash:medium PASS 100% 49 in → 411 out (407 reasoning)
git clean -fx
google/gemini-3.5-flash:medium__json_schema PASS 100% 106 in → 315 out (306 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.5-flash:xhigh PASS 100% 49 in → 360 out (356 reasoning)
git clean -fx
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 106 in → 498 out (489 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.6-flash:high PASS 100% 50 in → 520 out (516 reasoning)
git clean -fx
google/gemini-3.6-flash:high__json_schema PASS 100% 106 in → 382 out (366 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
google/gemini-3.6-flash:low PASS 100% 50 in → 226 out (222 reasoning)
git clean -fx
google/gemini-3.6-flash:max PASS 100% 49 in → 515 out (511 reasoning)
git clean -fx
google/gemini-3.6-flash:max__json_schema PASS 100% 50 in → 300 out (292 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3.6-flash:medium PASS 100% 50 in → 366 out (362 reasoning)
git clean -fx
google/gemini-3.6-flash:medium__json_schema PASS 100% 106 in → 305 out (297 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3.6-flash:xhigh PASS 100% 49 in → 455 out (451 reasoning)
git clean -fx
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 106 in → 304 out (296 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3.8-flash:high PASS 100% 49 in → 413 out (409 reasoning)
git clean -fx
google/gemini-3.8-flash:high__json_schema PASS 100% 106 in → 475 out (467 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3.8-flash:low PASS 100% 49 in → 6 out (0 reasoning)
git clean -f -x
google/gemini-3.8-flash:low__json_schema PASS 100% 106 in → 11 out (0 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.8-flash:max PASS 100% 49 in → 285 out (281 reasoning)
git clean -fx
google/gemini-3.8-flash:max__json_schema PASS 100% 106 in → 395 out (387 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3.8-flash:medium PASS 100% 49 in → 326 out (322 reasoning)
git clean -fx
google/gemini-3.8-flash:medium__json_schema PASS 100% 50 in → 310 out (301 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.8-flash:xhigh PASS 100% 49 in → 348 out (344 reasoning)
git clean -fx
google/gemini-3.8-flash:xhigh__json_schema PASS 100% 106 in → 438 out (430 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemma-4-26b-a4b-it:high PASS 100% 65 in → 289 out (251 reasoning)
git clean -fx
google/gemma-4-26b-a4b-it:high__json_schema PASS 100% 65 in → 239 out (200 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-26b-a4b-it:low PASS 100% 65 in → 303 out (267 reasoning)
git clean -fx
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 65 in → 292 out (255 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-26b-a4b-it:medium PASS 100% 64 in → 243 out (212 reasoning)
git clean -fx
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 64 in → 1,176 out (1,082 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-26b-a4b-it:xhigh PASS 100% 64 in → 299 out (265 reasoning)
git clean -fx
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 64 in → 356 out (321 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-31b-it:high PASS 100% 65 in → 197 out (171 reasoning)
git clean -fx
google/gemma-4-31b-it:high__json_schema PASS 100% 65 in → 235 out (207 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-31b-it:low PASS 100% 65 in → 214 out (190 reasoning)
git clean -fx
google/gemma-4-31b-it:low__json_schema PASS 100% 64 in → 225 out (195 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-31b-it:medium PASS 100% 65 in → 553 out (494 reasoning)
git clean -fx
google/gemma-4-31b-it:medium__json_schema PASS 100% 68 in → 227 out (217 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemma-4-31b-it:xhigh PASS 100% 65 in → 242 out (1 reasoning)
git clean -fx
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 65 in → 224 out (189 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
ibm-granite/granite-4.1-8b PASS 100% 59 in → 7 out
git clean -f -x
ibm-granite/granite-4.2-8b:high PASS 100% 66 in → 3,230 out (3,268 reasoning)
git clean -f -x
ibm-granite/granite-4.2-8b:low PASS 100% 74 in → 241 out (248 reasoning)
git clean -dfx
ibm-granite/granite-4.2-8b:max PASS 100% 66 in → 2,128 out (2,134 reasoning)
git clean -f -x
ibm-granite/granite-4.2-8b:xhigh PASS 100% 66 in → 1,779 out (1,796 reasoning)
git clean -fx
inception/mercury-2.5:high PASS 100% 41 in → 1,157 out (1,148 reasoning)
git clean -fx
inception/mercury-2.5:high__json_schema PASS 100% 241 in → 978 out (907 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
inception/mercury-2.5:low PASS 100% 41 in → 267 out (257 reasoning)
git clean -fx
inception/mercury-2.5:low__json_schema PASS 100% 246 in → 487 out (264 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
inception/mercury-2.5:medium PASS 100% 41 in → 723 out (714 reasoning)
git clean -fx
inception/mercury-2.5:medium__json_schema PASS 100% 242 in → 1,871 out (1,795 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
inception/mercury-2.5:none__json_schema PASS 100% 244 in → 192 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
inception/mercury-2.5:xhigh PASS 100% 41 in → 756 out (746 reasoning)
git clean -fx
inception/mercury-2.5:xhigh__json_schema PASS 100% 241 in → 1,321 out (1,253 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
meta/muse-spark-1.1:high PASS 100% 48 in → 1,010 out (996 reasoning)
git clean -fx
meta/muse-spark-1.1:high__json_schema PASS 100% 48 in → 664 out (643 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
meta/muse-spark-1.1:low PASS 100% 48 in → 481 out (467 reasoning)
git clean -fx
meta/muse-spark-1.1:low__json_schema PASS 100% 48 in → 514 out (493 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
meta/muse-spark-1.1:max PASS 100% 48 in → 1,314 out (1,298 reasoning)
git clean -f -x
meta/muse-spark-1.1:max__json_schema PASS 100% 48 in → 929 out (906 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
meta/muse-spark-1.1:medium PASS 100% 48 in → 523 out (507 reasoning)
git clean -f -x
meta/muse-spark-1.1:medium__json_schema PASS 100% 48 in → 646 out (622 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
meta/muse-spark-1.1:xhigh PASS 100% 48 in → 767 out (751 reasoning)
git clean -f -x
meta/muse-spark-1.1:xhigh__json_schema PASS 100% 48 in → 1,382 out (1,359 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
meta/muse-spark-1.3-contributor:high PASS 100% 48 in → 615 out (580 reasoning)
git clean -f -x
meta/muse-spark-1.3-contributor:high__json_schema PASS 100% 48 in → 1,058 out (996 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
meta/muse-spark-1.3-contributor:low PASS 100% 48 in → 449 out (433 reasoning)
git clean -f -x
meta/muse-spark-1.3-contributor:low__json_schema PASS 100% 48 in → 664 out (604 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
meta/muse-spark-1.3-contributor:medium PASS 100% 48 in → 856 out (800 reasoning)
git clean -f -x
meta/muse-spark-1.3-contributor:medium__json_schema PASS 100% 48 in → 921 out (854 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
meta/muse-spark-1.3-contributor:xhigh PASS 100% 48 in → 1,130 out (1,076 reasoning)
git clean -f -x
meta/muse-spark-1.3-contributor:xhigh__json_schema PASS 100% 48 in → 1,159 out (1,094 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
minimax/minimax-m2.5:high PASS 100% 89 in → 267 out (261 reasoning)
git clean -fx
minimax/minimax-m2.5:high__json_schema PASS 100% 78 in → 604 out (630 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
minimax/minimax-m2.5:low PASS 100% 78 in → 636 out (683 reasoning)
git clean -fx
minimax/minimax-m2.5:medium PASS 100% 78 in → 746 out (820 reasoning)
git clean -fx
minimax/minimax-m2.5:medium__json_schema PASS 100% 78 in → 851 out (846 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 78 in → 750 out (785 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
minimax/minimax-m2.7:high PASS 100% 78 in → 695 out (688 reasoning)
git clean -fx
minimax/minimax-m2.7:high__json_schema PASS 100% 210 in → 1,133 out (1,121 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
minimax/minimax-m2.7:low PASS 100% 80 in → 634 out (627 reasoning)
git clean -f -x
minimax/minimax-m2.7:low__json_schema PASS 100% 210 in → 758 out (746 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
minimax/minimax-m2.7:medium PASS 100% 78 in → 720 out (752 reasoning)
git clean -f -x
minimax/minimax-m2.7:medium__json_schema PASS 100% 210 in → 1,829 out (1,817 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
minimax/minimax-m2.7:xhigh PASS 100% 80 in → 628 out (621 reasoning)
git clean -f -x
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 210 in → 675 out (663 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
minimax/minimax-m3:high PASS 100% 216 in → 268 out (295 reasoning)
git clean -fx
minimax/minimax-m3:low PASS 100% 216 in → 240 out (230 reasoning)
`git clean -fx`
minimax/minimax-m3:medium PASS 100% 216 in → 257 out (258 reasoning)
`git clean -fx`
minimax/minimax-m3:xhigh PASS 100% 216 in → 198 out (215 reasoning)
git clean -fdx
mistralai/mistral-medium-3-5:high PASS 100% 58 in → 560 out (602 reasoning)
git clean -f -x
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 46 in → 535 out (561 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
mistralai/mistral-medium-3-5:low PASS 100% 58 in → 644 out (664 reasoning)
git clean -f -x
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 46 in → 632 out (656 reasoning)
git clean -f -x --no-dry-run
JSON Schema Structured Output
(raw) {"command": "git clean -f -x --no-dry-run"}
mistralai/mistral-medium-3-5:medium PASS 100% 58 in → 1,038 out (1,133 reasoning)
git clean -f -x
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 46 in → 433 out (453 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 58 in → 730 out (781 reasoning)
git clean -fx
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 46 in → 385 out (421 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k2.6:high PASS 100% 50 in → 779 out (771 reasoning)
git clean -f -x
moonshotai/kimi-k2.6:high__json_schema PASS 100% 50 in → 1,019 out (1,090 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
moonshotai/kimi-k2.6:low PASS 100% 50 in → 1,941 out (1,935 reasoning)
git clean -fx
moonshotai/kimi-k2.6:low__json_schema PASS 100% 49 in → 986 out (1,070 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k2.6:medium PASS 100% 50 in → 1,074 out (1,120 reasoning)
git clean -f -x
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 49 in → 790 out (711 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
moonshotai/kimi-k2.6:xhigh PASS 100% 50 in → 1,636 out (1,630 reasoning)
git clean -fx
moonshotai/kimi-k2.6:xhigh__json_schema PASS 100% 50 in → 433 out (424 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
moonshotai/kimi-k2.7-code:high PASS 100% 50 in → 236 out (255 reasoning)
git clean -fx
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 50 in → 320 out (309 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k2.7-code:low PASS 100% 49 in → 220 out (214 reasoning)
git clean -fx
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 50 in → 369 out (380 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
moonshotai/kimi-k2.7-code:medium PASS 100% 50 in → 556 out (624 reasoning)
git clean -fx
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 50 in → 503 out (510 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k2.7-code:xhigh PASS 100% 49 in → 270 out (264 reasoning)
git clean -fx
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 133 in → 157 out (146 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k3:high PASS 100% 127 in → 133 out (111 reasoning)
``` git clean -fx ```
moonshotai/kimi-k3:high__json_schema PASS 100% 127 in → 115 out (96 reasoning)
git clean -fx
moonshotai/kimi-k3:low PASS 100% 127 in → 139 out (120 reasoning)
git clean -fx
moonshotai/kimi-k3:low__json_schema PASS 100% 127 in → 135 out (116 reasoning)
git clean -fx
moonshotai/kimi-k3:max PASS 100% 127 in → 165 out (146 reasoning)
git clean -fx
moonshotai/kimi-k3:max__json_schema PASS 100% 127 in → 162 out (143 reasoning)
git clean -fx
moonshotai/kimi-k3:medium PASS 100% 127 in → 140 out (121 reasoning)
git clean -fx
moonshotai/kimi-k3:medium__json_schema PASS 100% 127 in → 269 out (250 reasoning)
git clean -fx
moonshotai/kimi-k3:xhigh PASS 100% 127 in → 268 out (249 reasoning)
git clean -fx
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 223 in → 255 out (232 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 59 in → 780 out (817 reasoning)
git clean -f -x .
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 59 in → 1,050 out (1,120 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) { "command": "git clean -fdx" }
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 59 in → 2,356 out (2,461 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 59 in → 735 out (756 reasoning)
git clean -f -x
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 59 in → 1,532 out (1,593 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 59 in → 248 out (234 reasoning)
git clean -fx
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 59 in → 262 out (237 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 59 in → 218 out (204 reasoning)
git clean -fx
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 59 in → 283 out (260 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 59 in → 617 out (582 reasoning)
git clean -fx
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 59 in → 590 out (555 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 59 in → 388 out (410 reasoning)
git clean -f -x
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 59 in → 455 out (421 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
openai/gpt-5.4-mini:high PASS 100% 46 in → 207 out (195 reasoning)
git clean -f -x
openai/gpt-5.4-mini:high__json_schema PASS 100% 81 in → 179 out (161 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4-mini:low PASS 100% 46 in → 96 out (84 reasoning)
git clean -f -x
openai/gpt-5.4-mini:low__json_schema PASS 100% 81 in → 128 out (108 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.4-mini:medium PASS 100% 46 in → 175 out (163 reasoning)
git clean -f -x
openai/gpt-5.4-mini:medium__json_schema PASS 100% 81 in → 213 out (193 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.4-mini:xhigh PASS 100% 46 in → 228 out (218 reasoning)
git clean -fx
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 81 in → 315 out (295 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.4-nano:high__json_schema PASS 100% 81 in → 178 out (160 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4-nano:xhigh PASS 100% 46 in → 473 out (463 reasoning)
git clean -fx
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 81 in → 460 out (442 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4:high PASS 100% 46 in → 273 out (263 reasoning)
git clean -fx
openai/gpt-5.4:high__json_schema PASS 100% 81 in → 185 out (167 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4:low PASS 100% 46 in → 91 out (79 reasoning)
git clean -f -x
openai/gpt-5.4:low__json_schema PASS 100% 81 in → 167 out (147 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.4:medium PASS 100% 46 in → 184 out (174 reasoning)
git clean -fx
openai/gpt-5.4:medium__json_schema PASS 100% 81 in → 117 out (99 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4:none PASS 100% 46 in → 17 out (0 reasoning)
git clean -fX; git clean -f -- notes.txt
openai/gpt-5.4:xhigh PASS 100% 46 in → 526 out (516 reasoning)
git clean -fx
openai/gpt-5.4:xhigh__json_schema PASS 100% 81 in → 2,611 out (2,588 reasoning)
git clean -fx -- notes.txt debug.log
JSON Schema Structured Output
(raw) {"command":"git clean -fx -- notes.txt debug.log"}
openai/gpt-5.5:high PASS 100% 46 in → 275 out (263 reasoning)
git clean -f -x
openai/gpt-5.5:high__json_schema PASS 100% 81 in → 133 out (113 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.5:low PASS 100% 46 in → 100 out (88 reasoning)
git clean -f -x
openai/gpt-5.5:low__json_schema PASS 100% 81 in → 97 out (77 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.5:medium PASS 100% 46 in → 209 out (197 reasoning)
git clean -f -x
openai/gpt-5.5:medium__json_schema PASS 100% 81 in → 176 out (156 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.5:none__json_schema PASS 100% 81 in → 22 out (0 reasoning)
git clean -fX && git clean -f
JSON Schema Structured Output
(raw) {"command":"git clean -fX && git clean -f"}
openai/gpt-5.5:xhigh PASS 100% 46 in → 526 out (516 reasoning)
git clean -fx
openai/gpt-5.5:xhigh__json_schema PASS 100% 81 in → 235 out (215 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:high PASS 100% 46 in → 100 out (88 reasoning)
git clean -f -x
openai/gpt-5.6-luna:high__json_schema PASS 100% 81 in → 208 out (188 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:low PASS 100% 46 in → 67 out (55 reasoning)
git clean -f -x
openai/gpt-5.6-luna:low__json_schema PASS 100% 81 in → 97 out (77 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:max PASS 100% 46 in → 147 out (135 reasoning)
git clean -f -x
openai/gpt-5.6-luna:max__json_schema PASS 100% 81 in → 536 out (516 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:medium PASS 100% 46 in → 69 out (57 reasoning)
git clean -f -x
openai/gpt-5.6-luna:medium__json_schema PASS 100% 81 in → 82 out (62 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:xhigh PASS 100% 46 in → 105 out (95 reasoning)
git clean -fx
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 81 in → 493 out (473 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-sol:high PASS 100% 46 in → 144 out (134 reasoning)
git clean -fx
openai/gpt-5.6-sol:high__json_schema PASS 100% 81 in → 147 out (129 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-sol:low PASS 100% 46 in → 75 out (65 reasoning)
git clean -fx
openai/gpt-5.6-sol:low__json_schema PASS 100% 81 in → 85 out (67 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-sol:max PASS 100% 46 in → 145 out (135 reasoning)
git clean -fx
openai/gpt-5.6-sol:max__json_schema PASS 100% 81 in → 336 out (316 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-sol:medium PASS 100% 46 in → 98 out (88 reasoning)
git clean -fx
openai/gpt-5.6-sol:medium__json_schema PASS 100% 81 in → 85 out (67 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-sol:none PASS 100% 46 in → 17 out (0 reasoning)
git clean -fX && git clean -f -- notes.txt
openai/gpt-5.6-sol:none__json_schema PASS 100% 81 in → 22 out (0 reasoning)
git clean -fX && git clean -f
JSON Schema Structured Output
(raw) {"command":"git clean -fX && git clean -f"}
openai/gpt-5.6-sol:xhigh PASS 100% 46 in → 206 out (196 reasoning)
git clean -fx
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 81 in → 197 out (179 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-terra:high PASS 100% 46 in → 89 out (79 reasoning)
git clean -fx
openai/gpt-5.6-terra:high__json_schema PASS 100% 81 in → 84 out (66 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-terra:low PASS 100% 46 in → 143 out (131 reasoning)
git clean -f -x
openai/gpt-5.6-terra:low__json_schema PASS 100% 81 in → 107 out (89 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-terra:max PASS 100% 46 in → 302 out (290 reasoning)
git clean -f -x
openai/gpt-5.6-terra:max__json_schema PASS 100% 81 in → 260 out (240 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-terra:medium PASS 100% 46 in → 63 out (51 reasoning)
git clean -f -x
openai/gpt-5.6-terra:medium__json_schema PASS 100% 81 in → 105 out (85 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-terra:none PASS 100% 46 in → 14 out (0 reasoning)
git clean -fX && git clean -f
openai/gpt-5.6-terra:none__json_schema PASS 100% 81 in → 22 out (0 reasoning)
git clean -fX; git clean -f
JSON Schema Structured Output
(raw) {"command":"git clean -fX; git clean -f"}
openai/gpt-5.6-terra:xhigh PASS 100% 46 in → 85 out (73 reasoning)
git clean -f -x
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 81 in → 95 out (75 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-6-astra:high PASS 100% 46 in → 50 out (40 reasoning)
git clean -fx
openai/gpt-6-astra:high__json_schema PASS 100% 81 in → 105 out (87 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-astra:low PASS 100% 46 in → 42 out (32 reasoning)
git clean -fx
openai/gpt-6-astra:low__json_schema PASS 100% 81 in → 53 out (35 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-astra:max PASS 100% 46 in → 168 out (158 reasoning)
git clean -fx
openai/gpt-6-astra:max__json_schema PASS 100% 81 in → 210 out (192 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-astra:medium PASS 100% 46 in → 43 out (33 reasoning)
git clean -fx
openai/gpt-6-astra:medium__json_schema PASS 100% 81 in → 90 out (72 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-astra:xhigh PASS 100% 46 in → 129 out (119 reasoning)
git clean -fx
openai/gpt-6-astra:xhigh__json_schema PASS 100% 81 in → 182 out (164 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-luna:high PASS 100% 46 in → 219 out (209 reasoning)
git clean -fx
openai/gpt-6-luna:high__json_schema PASS 100% 81 in → 204 out (184 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-6-luna:low PASS 100% 46 in → 117 out (107 reasoning)
git clean -fx
openai/gpt-6-luna:low__json_schema PASS 100% 81 in → 79 out (59 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-6-luna:max PASS 100% 46 in → 331 out (321 reasoning)
git clean -fx
openai/gpt-6-luna:max__json_schema PASS 100% 81 in → 186 out (166 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-6-luna:medium PASS 100% 46 in → 158 out (146 reasoning)
git clean -f -x
openai/gpt-6-luna:medium__json_schema PASS 100% 81 in → 164 out (146 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-luna:xhigh PASS 100% 46 in → 367 out (355 reasoning)
git clean -f -x
openai/gpt-6-luna:xhigh__json_schema PASS 100% 81 in → 251 out (231 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-6-sol:high PASS 100% 46 in → 340 out (328 reasoning)
git clean -f -x
openai/gpt-6-sol:high__json_schema PASS 100% 81 in → 265 out (245 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-6-sol:low PASS 100% 46 in → 84 out (72 reasoning)
git clean -f -x
openai/gpt-6-sol:low__json_schema PASS 100% 81 in → 86 out (68 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-sol:max PASS 100% 46 in → 526 out (516 reasoning)
git clean -fx
openai/gpt-6-sol:max__json_schema PASS 100% 81 in → 1,052 out (1,034 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-sol:medium PASS 100% 46 in → 222 out (210 reasoning)
git clean -f -x
openai/gpt-6-sol:medium__json_schema PASS 100% 81 in → 172 out (154 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-6-sol:xhigh PASS 100% 46 in → 427 out (415 reasoning)
git clean -f -x
openai/gpt-6-sol:xhigh__json_schema PASS 100% 81 in → 1,458 out (1,438 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-oss-120b:high PASS 100% 105 in → 765 out (783 reasoning)
git clean -f -x
openai/gpt-oss-120b:high__json_schema PASS 100% 105 in → 448 out (428 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-oss-120b:low PASS 100% 94 in → 134 out (118 reasoning)
git clean -f -x
openai/gpt-oss-120b:low__json_schema PASS 100% 107 in → 282 out (259 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
openai/gpt-oss-120b:medium PASS 100% 94 in → 302 out (283 reasoning)
git clean -f -x
openai/gpt-oss-120b:medium__json_schema PASS 100% 107 in → 233 out (214 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-oss-120b:xhigh PASS 100% 94 in → 775 out (834 reasoning)
git clean -f -x
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 94 in → 629 out (658 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-oss-20b:high PASS 100% 106 in → 558 out (574 reasoning)
git clean -f -x
openai/gpt-oss-20b:low PASS 100% 94 in → 218 out (223 reasoning)
git clean -f -x
openai/gpt-oss-20b:medium PASS 100% 107 in → 581 out (626 reasoning)
git clean -f -x
openai/gpt-oss-20b:medium__json_schema PASS 100% 107 in → 603 out (598 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-oss-20b:xhigh PASS 100% 109 in → 652 out (652 reasoning)
git clean -f -x
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 105 in → 538 out (565 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
poolside/laguna-m.1:high PASS 100% 58 in → 258 out (251 reasoning)
git clean -fx
poolside/laguna-m.1:high__json_schema PASS 100% 58 in → 413 out (389 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command" : "git clean -fx" }
poolside/laguna-m.1:low PASS 100% 58 in → 292 out (285 reasoning)
git clean -fx
poolside/laguna-m.1:low__json_schema PASS 100% 58 in → 1,097 out (1,086 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
poolside/laguna-m.1:medium PASS 100% 58 in → 1,049 out (1,042 reasoning)
git clean -fx
poolside/laguna-m.1:medium__json_schema PASS 100% 58 in → 577 out (566 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
poolside/laguna-m.1:none PASS 100% 58 in → 6 out (0 reasoning)
git clean -fx
poolside/laguna-m.1:none__json_schema PASS 100% 58 in → 16 out (0 reasoning)
git clean -fdX && git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fdX && git clean -fx"}
poolside/laguna-m.1:xhigh PASS 100% 58 in → 514 out (507 reasoning)
git clean -fx
poolside/laguna-xs-2.1:high PASS 100% 58 in → 776 out (769 reasoning)
git clean -x -f
poolside/laguna-xs-2.1:high__json_schema PASS 100% 58 in → 473 out (460 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
poolside/laguna-xs-2.1:low PASS 100% 58 in → 1,137 out (1,130 reasoning)
git clean -f -x
poolside/laguna-xs-2.1:low__json_schema PASS 100% 58 in → 479 out (462 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
poolside/laguna-xs-2.1:medium PASS 100% 58 in → 422 out (415 reasoning)
git clean -f -x
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 58 in → 701 out (688 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
poolside/laguna-xs-2.1:xhigh PASS 100% 58 in → 1,137 out (1,130 reasoning)
git clean -f -x
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 58 in → 681 out (670 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
poolside/laguna-xs.2:high PASS 100% 95 in → 280 out (273 reasoning)
git clean -fx
poolside/laguna-xs.2:high__json_schema PASS 100% 95 in → 216 out (203 reasoning)
git clean -x -f
JSON Schema Structured Output
(raw) {"command": "git clean -x -f"}
poolside/laguna-xs.2:low PASS 100% 95 in → 399 out (392 reasoning)
git clean -fx
poolside/laguna-xs.2:low__json_schema PASS 100% 95 in → 399 out (386 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
poolside/laguna-xs.2:medium PASS 100% 95 in → 296 out (289 reasoning)
git clean -fx
poolside/laguna-xs.2:medium__json_schema PASS 100% 95 in → 293 out (282 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
poolside/laguna-xs.2:xhigh PASS 100% 95 in → 336 out (329 reasoning)
git clean -fx
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 95 in → 172 out (159 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
prism-ml/ternary-bonsai-2-27b:high__json_schema PASS 100% 148 in → 343 out (330 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
prism-ml/ternary-bonsai-2-27b:low PASS 100% 54 in → 314 out (307 reasoning)
git clean -fx
prism-ml/ternary-bonsai-2-27b:low__json_schema PASS 100% 148 in → 331 out (318 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
prism-ml/ternary-bonsai-2-27b:max PASS 100% 96 in → 622 out (613 reasoning)
git clean -f -x
prism-ml/ternary-bonsai-2-27b:max__json_schema PASS 100% 186 in → 1,097 out (1,084 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
prism-ml/ternary-bonsai-2-27b:medium PASS 100% 54 in → 601 out (590 reasoning)
``` git clean -fx ```
prism-ml/ternary-bonsai-2-27b:medium__json_schema PASS 100% 148 in → 558 out (545 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
prism-ml/ternary-bonsai-2-27b:xhigh PASS 100% 96 in → 1,033 out (1,026 reasoning)
git clean -fx
qwen/qwen3.6-27b:high PASS 100% 54 in → 1,049 out (1,040 reasoning)
git clean -fx
qwen/qwen3.6-27b:low PASS 100% 54 in → 1,383 out (1,348 reasoning)
git clean -fx
qwen/qwen3.6-27b:medium PASS 100% 54 in → 1,446 out (1,383 reasoning)
git clean -fx
qwen/qwen3.6-27b:medium__json_schema PASS 100% 54 in → 1,263 out (1 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-27b:xhigh PASS 100% 54 in → 1,234 out (1,210 reasoning)
git clean -fx
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 54 in → 753 out (1 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-35b-a3b:high PASS 100% 54 in → 1,414 out (1,401 reasoning)
git clean -fx
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 54 in → 1,477 out (1,401 reasoning)
git clean -xf
JSON Schema Structured Output
(raw) { "command": "git clean -xf" }
qwen/qwen3.6-35b-a3b:low PASS 100% 54 in → 2,196 out (2,161 reasoning)
git clean -fx
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 54 in → 1,301 out (1,258 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 54 in → 1,864 out (1,830 reasoning)
git clean -fx
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 54 in → 1,382 out (1,366 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 54 in → 1,160 out (1,110 reasoning)
git clean -fx
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 54 in → 1,379 out (1,364 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-flash:high PASS 100% 54 in → 1,564 out (1,555 reasoning)
git clean -xf
qwen/qwen3.6-flash:low PASS 100% 54 in → 2,147 out (2,138 reasoning)
git clean -xf
qwen/qwen3.6-flash:medium PASS 100% 54 in → 1,576 out (1,567 reasoning)
git clean -fx
qwen/qwen3.6-flash:xhigh PASS 100% 54 in → 1,392 out (1,383 reasoning)
git clean -fx
qwen/qwen3.7-flash:high PASS 100% 54 in → 1,380 out (1,371 reasoning)
git clean -fx
qwen/qwen3.7-flash:low PASS 100% 54 in → 2,054 out (2,045 reasoning)
git clean -fx
qwen/qwen3.7-flash:max PASS 100% 54 in → 1,390 out (1,381 reasoning)
git clean -fx
qwen/qwen3.7-flash:medium PASS 100% 54 in → 1,105 out (1,096 reasoning)
git clean -fx
qwen/qwen3.7-flash:xhigh PASS 100% 54 in → 1,427 out (1,418 reasoning)
git clean -fx
qwen/qwen3.7-max:high PASS 100% 54 in → 761 out (752 reasoning)
git clean -fx
qwen/qwen3.7-max:low PASS 100% 54 in → 778 out (769 reasoning)
git clean -fx
qwen/qwen3.7-max:medium PASS 100% 54 in → 386 out (377 reasoning)
git clean -fx
qwen/qwen3.7-max:xhigh PASS 100% 54 in → 647 out (638 reasoning)
git clean -fx
qwen/qwen3.7-plus:high PASS 100% 54 in → 760 out (751 reasoning)
git clean -fx
qwen/qwen3.7-plus:low PASS 100% 54 in → 1,025 out (1,014 reasoning)
git clean -f -x
qwen/qwen3.7-plus:medium PASS 100% 54 in → 619 out (610 reasoning)
git clean -fx
qwen/qwen3.7-plus:xhigh PASS 100% 54 in → 1,145 out (1,136 reasoning)
git clean -fx
qwen/qwen3.8-flash:high PASS 100% 105 in → 291 out (282 reasoning)
git clean -f -x
qwen/qwen3.8-flash:high__json_schema PASS 100% 107 in → 410 out (389 reasoning)
git clean -fx notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -fx notes.txt debug.log" }
qwen/qwen3.8-flash:low PASS 100% 105 in → 343 out (336 reasoning)
git clean -fx
qwen/qwen3.8-flash:low__json_schema PASS 100% 107 in → 335 out (317 reasoning)
git clean -fX && git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fX && git clean -fx"}
qwen/qwen3.8-flash:max PASS 100% 105 in → 373 out (366 reasoning)
git clean -fx
qwen/qwen3.8-flash:max__json_schema PASS 100% 107 in → 242 out (224 reasoning)
git clean -x -f notes.txt debug.log
JSON Schema Structured Output
(raw) {"command": "git clean -x -f notes.txt debug.log"}
qwen/qwen3.8-flash:medium PASS 100% 105 in → 182 out (175 reasoning)
git clean -xf
qwen/qwen3.8-flash:medium__json_schema PASS 100% 107 in → 625 out (528 reasoning)
git clean -f -X; git clean -f -e 'debug.log' -x --dry-run | awk '/^Would remove/{print $3}' | while read f; do if [ -f "$f" ]; then rm "$f"; fi; done; echo 'Cleaned untracked files (notes.txt) and ignored files (debug.log) without removing directories.'; git status --short
JSON Schema Structured Output
(raw) { "command": "git clean -f -X; git clean -f -e 'debug.log' -x --dry-run | awk '/^Would remove/{print $3}' | while read f; do if [ -f \"$f\" ]; then rm \"$f\"; fi; done; echo 'Cleaned untracked files (notes.txt) and ignored files (debug.log) without removing directories.'; git status --short" }
qwen/qwen3.8-flash:xhigh PASS 100% 105 in → 165 out (158 reasoning)
git clean -fx
qwen/qwen3.8-max:high PASS 100% 92 in → 266 out (257 reasoning)
git clean -fx
qwen/qwen3.8-max:low PASS 100% 80 in → 141 out (130 reasoning)
`git clean -fx`
qwen/qwen3.8-max:max PASS 100% 92 in → 203 out (194 reasoning)
git clean -fx
qwen/qwen3.8-max:max__json_schema PASS 100% 94 in → 242 out (219 reasoning)
git clean -fx -- notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -fx -- notes.txt debug.log" }
qwen/qwen3.8-max:medium PASS 100% 54 in → 177 out (168 reasoning)
git clean -fx
qwen/qwen3.8-max:xhigh PASS 100% 92 in → 232 out (223 reasoning)
git clean -fx
sakana/fugu-max:high PASS 100% 123 in → 76 out (64 reasoning)
git clean -f -x
sakana/fugu-max:high__json_schema PASS 100% 158 in → 118 out (98 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
sakana/fugu-max:low PASS 100% 123 in → 70 out (58 reasoning)
git clean -f -x
sakana/fugu-max:low__json_schema PASS 100% 158 in → 165 out (145 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
sakana/fugu-max:max PASS 100% 123 in → 262 out (250 reasoning)
git clean -f -x
sakana/fugu-max:max__json_schema PASS 100% 158 in → 206 out (186 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
sakana/fugu-max:medium PASS 100% 123 in → 82 out (70 reasoning)
git clean -f -x
sakana/fugu-max:medium__json_schema PASS 100% 158 in → 140 out (120 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
sakana/fugu-max:xhigh PASS 100% 123 in → 129 out (117 reasoning)
git clean -f -x
sakana/fugu-max:xhigh__json_schema PASS 100% 158 in → 315 out (295 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
stealth/ox-alpha:high PASS 100% 128 in → 143 out (0 reasoning)
git clean -fx
stealth/ox-alpha:max PASS 100% 128 in → 135 out (0 reasoning)
```bash git clean -fx ```
tencent/hy3:high PASS 100% 53 in → 636 out (630 reasoning)
git clean -fx
tencent/hy3:high__json_schema PASS 100% 53 in → 1,128 out (1,169 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
tencent/hy3:low PASS 100% 53 in → 664 out (654 reasoning)
git clean -fx
tencent/hy3:low__json_schema PASS 100% 53 in → 686 out (701 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
tencent/hy3:medium PASS 100% 53 in → 677 out (716 reasoning)
git clean -fx
tencent/hy3:medium__json_schema PASS 100% 53 in → 457 out (458 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
tencent/hy3:xhigh PASS 100% 53 in → 1,244 out (1,272 reasoning)
git clean -fx
tencent/hy3:xhigh__json_schema PASS 100% 53 in → 1,732 out (1,752 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
thinkingmachines/inkling-small:high PASS 100% 55 in → 220 out (210 reasoning)
git clean -fx
thinkingmachines/inkling-small:high__json_schema PASS 100% 55 in → 267 out (248 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
thinkingmachines/inkling-small:low PASS 100% 55 in → 87 out (81 reasoning)
git clean -fx
thinkingmachines/inkling-small:low__json_schema PASS 100% 55 in → 104 out (87 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
thinkingmachines/inkling-small:max PASS 100% 55 in → 224 out (229 reasoning)
git clean -fx
thinkingmachines/inkling-small:max__json_schema PASS 100% 55 in → 274 out (257 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
thinkingmachines/inkling-small:medium PASS 100% 55 in → 194 out (185 reasoning)
git clean -fx
thinkingmachines/inkling-small:medium__json_schema PASS 100% 55 in → 186 out (169 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
thinkingmachines/inkling-small:none PASS 100% 53 in → 9 out (0 reasoning)
git clean -fd -x
thinkingmachines/inkling-small:xhigh PASS 100% 55 in → 187 out (197 reasoning)
git clean -fx
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 55 in → 233 out (219 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
thinkingmachines/inkling:high PASS 100% 55 in → 232 out (238 reasoning)
git clean -fx
thinkingmachines/inkling:low PASS 100% 55 in → 80 out (69 reasoning)
git clean -f -x
thinkingmachines/inkling:max PASS 100% 55 in → 395 out (384 reasoning)
git clean -fx
thinkingmachines/inkling:max__json_schema PASS 100% 55 in → 287 out (274 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
thinkingmachines/inkling:medium PASS 100% 55 in → 187 out (189 reasoning)
git clean -fx
thinkingmachines/inkling:xhigh PASS 100% 55 in → 249 out (238 reasoning)
git clean -fx
thinkingmachines/inkling:xhigh__json_schema PASS 100% 55 in → 357 out (340 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
x-ai/grok-4.3:high PASS 100% 225 in → 481 out (475 reasoning)
git clean -f -x
x-ai/grok-4.3:high__json_schema PASS 100% 281 in → 741 out (733 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.3:low PASS 100% 231 in → 406 out (402 reasoning)
git clean -fx
x-ai/grok-4.3:low__json_schema PASS 100% 287 in → 404 out (396 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.3:max PASS 100% 225 in → 451 out (445 reasoning)
git clean -f -x
x-ai/grok-4.3:max__json_schema PASS 100% 281 in → 982 out (974 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.3:medium PASS 100% 231 in → 689 out (630 reasoning)
git clean -fx The command uses `-f` (force, required to actually delete) and `-x` (remove both untracked files and ignored files). Omitting `-d` ensures directories are left untouched, matching the request exactly. No other flags or sub-commands are needed.
x-ai/grok-4.3:medium__json_schema PASS 100% 287 in → 843 out (831 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
x-ai/grok-4.3:xhigh PASS 100% 225 in → 426 out (422 reasoning)
git clean -xf
x-ai/grok-4.3:xhigh__json_schema PASS 100% 281 in → 1,184 out (1,176 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.5:high PASS 100% 246 in → 369 out (361 reasoning)
``` git clean -fx ```
x-ai/grok-4.5:high__json_schema PASS 100% 312 in → 482 out (473 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.5:low PASS 100% 246 in → 220 out (212 reasoning)
``` git clean -fx ```
x-ai/grok-4.5:low__json_schema PASS 100% 312 in → 355 out (346 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.5:max PASS 100% 246 in → 564 out (560 reasoning)
git clean -fx
x-ai/grok-4.5:max__json_schema PASS 100% 312 in → 553 out (544 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
x-ai/grok-4.5:medium PASS 100% 246 in → 753 out (749 reasoning)
git clean -fx
x-ai/grok-4.5:medium__json_schema PASS 100% 312 in → 697 out (688 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.5:xhigh PASS 100% 246 in → 312 out (308 reasoning)
git clean -fx
x-ai/grok-4.5:xhigh__json_schema PASS 100% 312 in → 590 out (581 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.7:high PASS 100% 1,282 in → 464 out (460 reasoning)
git clean -fx
x-ai/grok-4.7:high__json_schema PASS 100% 1,348 in → 650 out (641 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.7:low PASS 100% 1,282 in → 218 out (214 reasoning)
git clean -fx
x-ai/grok-4.7:low__json_schema PASS 100% 1,348 in → 253 out (244 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.7:max PASS 100% 1,283 in → 480 out (476 reasoning)
git clean -fx
x-ai/grok-4.7:max__json_schema PASS 100% 1,349 in → 496 out (487 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.7:medium PASS 100% 1,282 in → 277 out (273 reasoning)
git clean -fx
x-ai/grok-4.7:medium__json_schema PASS 100% 1,348 in → 305 out (296 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.7:xhigh PASS 100% 1,283 in → 539 out (535 reasoning)
git clean -fx
x-ai/grok-4.7:xhigh__json_schema PASS 100% 1,349 in → 292 out (283 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
xiaomi/mimo-v2.6-flash:high PASS 100% 48 in → 29 out (17 reasoning)
``` git clean -f -x ```
xiaomi/mimo-v2.6-flash:high__json_schema PASS 100% 48 in → 102 out (86 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
xiaomi/mimo-v2.6-flash:low PASS 100% 48 in → 104 out (98 reasoning)
git clean -fx
xiaomi/mimo-v2.6-flash:low__json_schema PASS 100% 48 in → 236 out (224 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
xiaomi/mimo-v2.6-flash:max PASS 100% 48 in → 80 out (18 reasoning)
git clean -f -x -d is for dirs... but to exclude directories: git clean -f -x Wait — `git clean -f -x` by default only removes untracked files (not directories) unless `-d` is added. So: git clean -f -x
xiaomi/mimo-v2.6-flash:max__json_schema PASS 100% 48 in → 80 out (66 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
xiaomi/mimo-v2.6-flash:medium PASS 100% 48 in → 82 out (70 reasoning)
``` git clean -f -x ```
xiaomi/mimo-v2.6-flash:medium__json_schema PASS 100% 48 in → 78 out (64 reasoning)
git clean -xf
JSON Schema Structured Output
(raw) { "command": "git clean -xf" }
xiaomi/mimo-v2.6-flash:none__json_schema PASS 100% 50 in → 15 out (0 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
xiaomi/mimo-v2.6-flash:xhigh PASS 100% 48 in → 553 out (543 reasoning)
``` git clean -fx ```
xiaomi/mimo-v2.6-flash:xhigh__json_schema PASS 100% 48 in → 120 out (106 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
xiaomi/mimo-v2.6-pro:high PASS 100% 48 in → 477 out (469 reasoning)
`git clean -fx`
xiaomi/mimo-v2.6-pro:high__json_schema PASS 100% 48 in → 166 out (149 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
xiaomi/mimo-v2.6-pro:low PASS 100% 48 in → 125 out (117 reasoning)
`git clean -fx`
xiaomi/mimo-v2.6-pro:low__json_schema PASS 100% 48 in → 453 out (439 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
xiaomi/mimo-v2.6-pro:max PASS 100% 48 in → 582 out (572 reasoning)
`git clean -f -x`
xiaomi/mimo-v2.6-pro:max__json_schema PASS 100% 48 in → 65 out (51 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
xiaomi/mimo-v2.6-pro:medium PASS 100% 48 in → 439 out (429 reasoning)
``` git clean -fx ```
xiaomi/mimo-v2.6-pro:medium__json_schema PASS 100% 48 in → 100 out (83 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
xiaomi/mimo-v2.6-pro:xhigh PASS 100% 48 in → 92 out (84 reasoning)
`git clean -fx`
xiaomi/mimo-v2.6-pro:xhigh__json_schema PASS 100% 48 in → 400 out (383 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
z-ai/glm-4.7-flash:high PASS 100% 46 in → 457 out (427 reasoning)
git clean -fx
z-ai/glm-4.7-flash:low PASS 100% 46 in → 1,902 out (1,994 reasoning)
git clean -xf
z-ai/glm-4.7-flash:medium PASS 100% 46 in → 1,868 out (1,961 reasoning)
git clean -fx
z-ai/glm-4.7-flash:none PASS 100% 46 in → 5 out (0 reasoning)
git clean -fdx
z-ai/glm-4.7-flash:none__json_schema PASS 100% 46 in → 11 out (0 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) {"command": "git clean -fdx"}
z-ai/glm-4.7-flash:xhigh PASS 100% 46 in → 965 out (978 reasoning)
git clean -fx
z-ai/glm-5.2:high PASS 100% 53 in → 389 out (383 reasoning)
git clean -fx
z-ai/glm-5.2:low PASS 100% 53 in → 724 out (718 reasoning)
git clean -xf
z-ai/glm-5.2:low__json_schema PASS 100% 55 in → 252 out (233 reasoning)
git clean -f -X -e notes.txt
JSON Schema Structured Output
(raw) { "command": "git clean -f -X -e notes.txt" }
z-ai/glm-5.2:medium PASS 100% 53 in → 342 out (336 reasoning)
git clean -fx
z-ai/glm-5.2:medium__json_schema PASS 100% 228 in → 360 out (349 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
z-ai/glm-5.2:none PASS 100% 47 in → 6 out (0 reasoning)
git clean -fdx
z-ai/glm-5.2:xhigh PASS 100% 53 in → 728 out (722 reasoning)
git clean -fx
z-ai/glm-5.2:xhigh__json_schema PASS 100% 46 in → 340 out (312 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
z-ai/glm-5.3-flash:high PASS 100% 53 in → 62 out (51 reasoning)
```bash git clean -fx ```
z-ai/glm-5.3-flash:high__json_schema PASS 100% 53 in → 192 out (179 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
z-ai/glm-5.3-flash:low PASS 100% 53 in → 53 out (39 reasoning)
`git clean -f -x notes.txt debug.log`
z-ai/glm-5.3-flash:low__json_schema PASS 100% 53 in → 39 out (20 reasoning)
git clean -f -x notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -f -x notes.txt debug.log" }
z-ai/glm-5.3-flash:max PASS 100% 53 in → 179 out (169 reasoning)
``` git clean -fx ```
z-ai/glm-5.3-flash:max__json_schema PASS 100% 53 in → 479 out (515 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
z-ai/glm-5.3-flash:medium PASS 100% 53 in → 43 out (37 reasoning)
``` git clean -fx ```
z-ai/glm-5.3-flash:medium__json_schema PASS 100% 53 in → 232 out (0 reasoning)
git clean -f -X -- ':(literal)**/)*' ':(literal)*' ':(literal)*/*' ':(literal)*/*/*' ':(literal)*/*/*/*' ':(literal)*/*/*/*/*' ':(literal)*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*/*/*/*/*' 2>/dev/null || (git ls-files --others --ignored --exclude-standard -z | xargs -0 -r rm -f -- && git ls-files --others --exclude-standard -z | xargs -0 -r rm -f --) ; git ls-files --others --ignored --exclude-standard -z | xargs -0 -r rm -f -- ; git ls-files --others --exclude-standard -z | xargs -0 -r rm -f --
JSON Schema Structured Output
(raw) { "command": "git clean -f -X -- ':(literal)**/)*' ':(literal)*' ':(literal)*/*' ':(literal)*/*/*' ':(literal)*/*/*/*' ':(literal)*/*/*/*/*' ':(literal)*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*/*/*/*' ':(literal)*/*/*/*/*/*/*/*/*/*/*' 2>/dev/null || (git ls-files --others --ignored --exclude-standard -z | xargs -0 -r rm -f -- && git ls-files --others --exclude-standard -z | xargs -0 -r rm -f --) ; git ls-files --others --ignored --exclude-standard -z | xargs -0 -r rm -f -- ; git ls-files --others --exclude-standard -z | xargs -0 -r rm -f --" }
z-ai/glm-5.3-flash:xhigh PASS 100% 53 in → 57 out (42 reasoning)
```bash git clean -fx notes.txt debug.log ```
z-ai/glm-5.3-flash:xhigh__json_schema PASS 100% 53 in → 92 out (75 reasoning)
git clean -fx notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -fx notes.txt debug.log" }
anthropic/claude-fable-5.1:high__json_schema FAIL 75% 288 in → 17 out (0 reasoning)
git clean -fX -f
JSON Schema Structured Output
(raw) {"command": "git clean -fX -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-haiku-4.5:none FAIL 75% 59 in → 11 out (0 reasoning)
``` git clean -f ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
anthropic/claude-haiku-4.5:none__json_schema FAIL 75% 221 in → 12 out (0 reasoning)
git clean -f
JSON Schema Structured Output
(raw) {"command": "git clean -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
anthropic/claude-sonnet-4.6:low__json_schema FAIL 75% 222 in → 18 out (0 reasoning)
git clean -fX notes.txt debug.log
JSON Schema Structured Output
(raw) {"command":"git clean -fX notes.txt debug.log"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-4.6:medium__json_schema FAIL 75% 222 in → 23 out (0 reasoning)
git clean -fX notes.txt && git clean -f notes.txt
JSON Schema Structured Output
(raw) {"command":"git clean -fX notes.txt && git clean -f notes.txt"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
anthropic/claude-sonnet-4.6:none__json_schema FAIL 75% 222 in → 18 out (0 reasoning)
git clean -fX notes.txt debug.log
JSON Schema Structured Output
(raw) {"command":"git clean -fX notes.txt debug.log"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-5:low FAIL 75% 76 in → 12 out (0 reasoning)
``` git clean -fX ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-5:medium__json_schema FAIL 75% 286 in → 15 out (0 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) {"command":"git clean -fX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-5:xhigh FAIL 75% 76 in → 12 out (0 reasoning)
``` git clean -fX ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
arcee-ai/trinity-mini:high__json_schema FAIL 75% 50 in → 501 out (555 reasoning)
git clean -f
JSON Schema Structured Output
(raw) { "command": "git clean -f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
deepseek/deepseek-v4-flash-0731:none FAIL 75% 47 in → 11 out (0 reasoning)
git clean -f -X notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash-0731:none__json_schema FAIL 75% 47 in → 16 out (0 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) { "command": "git clean -fX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:low__json_schema FAIL 75% 49 in → 366 out (351 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) { "command": "git clean -fX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:medium__json_schema FAIL 75% 49 in → 409 out (392 reasoning)
git clean -fX -q
JSON Schema Structured Output
(raw) { "command": "git clean -fX -q" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:none FAIL 75% 47 in → 7 out (0 reasoning)
git clean -f -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:none__json_schema FAIL 75% 47 in → 18 out (0 reasoning)
git clean -f -X notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -f -X notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-pro:none FAIL 75% 47 in → 7 out (0 reasoning)
git clean -f -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-pro:xhigh__json_schema FAIL 75% 128 in → 1,007 out (991 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) { "command": "git clean -f -X" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4.1-flash:none FAIL 75% 47 in → 6 out (0 reasoning)
git clean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemini-3.1-flash-lite-preview:low FAIL 75% 49 in → 119 out (114 reasoning)
git clean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemini-3.5-flash-lite:low FAIL 75% 50 in → 6 out (0 reasoning)
`git clean -f`
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
google/gemini-3.5-flash-lite:low__json_schema FAIL 75% 50 in → 9 out (0 reasoning)
git clean -f
JSON Schema Structured Output
(raw) {"command": "git clean -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
google/gemini-3.6-flash:low__json_schema FAIL 75% 50 in → 10 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemma-4-26b-a4b-it:none FAIL 75% 62 in → 5 out (0 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
google/gemma-4-26b-a4b-it:none__json_schema FAIL 75% 62 in → 15 out (0 reasoning)
git clean -f
JSON Schema Structured Output
(raw) { "command": "git clean -f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
git clean -f -x --exclude='debug.log'
JSON Schema Structured Output
(raw) { "command": "git clean -f -x --exclude='debug.log'" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
inception/mercury-2.5:max FAIL 75% 41 in → 717 out (707 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
inception/mercury-2.5:none FAIL 75% 42 in → 7 out (0 reasoning)
git clean -ff
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
inclusionai/ling-2.6-flash FAIL 75% 66 in → 14 out
```sh git clean -f notes.txt debug.log ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
minimax/minimax-m2.5:low__json_schema FAIL 75% 89 in → 231 out (242 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) { "command": "git clean -fX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m2.5:xhigh FAIL 75% 78 in → 869 out (975 reasoning)
git clean -f -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m3:high__json_schema FAIL 75% 203 in → 14 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) { "command": "git clean -f -X" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m3:low__json_schema FAIL 75% 203 in → 15 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) { "command": "git clean -f -X" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m3:medium__json_schema FAIL 75% 203 in → 18 out (0 reasoning)
git clean -f -X notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -f -X notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m3:xhigh__json_schema FAIL 75% 203 in → 21 out (0 reasoning)
git clean -f -X notes.txt && git clean -f notes.txt
JSON Schema Structured Output
(raw) {"command": "git clean -f -X notes.txt && git clean -f notes.txt"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
mistralai/devstral-2512 FAIL 75% 46 in → 10 out
```bash git clean -f ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
mistralai/devstral-2512__json_schema FAIL 75% 46 in → 12 out
git clean -f -X
JSON Schema Structured Output
(raw) {"command": "git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-nano-30b-a3b:medium FAIL 75% 59 in → 752 out (798 reasoning)
git clean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-nano-30b-a3b:none__json_schema FAIL 75% 59 in → 26 out (0 reasoning)
git clean -X -f --dry-run && git clean -X -f
JSON Schema Structured Output
(raw) { "command": "git clean -X -f --dry-run && git clean -X -f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-super-120b-a12b:none FAIL 75% 59 in → 1,041 out (0 reasoning)
git clean -f -X -n -- *.txt *.log | grep -v '/' | sed 's/^Would remove //' | xargs -r rm Wait — the user said: "Output ONLY the git command, nothing else." And they want to remove untracked and ignored files (not directories), based on the status showing: - notes.txt (untracked) - debug.log (ignored) We must output ONLY the git command — no explanations, no extra text. Important: `git clean` removes untracked files. To remove ignored files too, we need `-X` (only ignored) or `-x` (ignored and untracked). Since they want both untracked AND ignored, we use `-x`. But: they said “not directories” — so we must avoid removing directories. `git clean` by default does not recurse into directories unless forced with `-d`, but we are not using `-d`, so it’s safe for files only. However, to be precise and ensure we don’t accidentally remove directories (even if `-d` is not used, it’s safe), we can rely on default behavior. But note: `git clean -x` removes ignored and untracked files. It does not remove directories unless `-d` is used. So the correct command is: `git clean -f -x` But wait: `-f` is force (required to actually remove, not just dry-run). They want to remove, so `-f`. However, the user said: “Output ONLY the git command, nothing else.” So we must output exactly: `git clean -f -x` But let’s double-check: does this remove only files? Yes, because `-d` is not included, so directories are untouched. Also, note: `-x` removes ignored files (as per `.gitignore`) AND untracked files. `-X` removes only ignored files. We want both, so `-x` is correct. The status shows: - notes.txt: untracked (`??`) - debug.log: ignored (listed under Ignored files) Both should be removed by `git clean -f -x`. We must NOT output anything else — no explanation, no markdown, no extra spaces or lines. Final answer: `git clean -f -x` But wait: is there a risk of removing files we don’t want? The user gave specific status, so we assume they want to remove exactly those. The command is correct for their intent. Alternative: some might argue to use `-e` to exclude certain patterns, but no — they want to remove all untracked and ignored files, per the status. Thus, the only git command to output is: `git clean -f -x` Let’s confirm with git docs: - `-x`: Don’t use the standard ignore rules read from `.gitignore` (as the sole mechanism), but still remove files that are ignored according to `.gitignore` and also untracked files. Actually, wait — let me recall: From `git-clean` man page: > -x > Don’t use the standard ignore rules read from .gitignore (as the sole mechanism), but still remove files that are ignored according to .gitignore and also untracked files. This is useful for removing all built files, and possibly other temporary files such as those made by vim or Emacs, but not removing any files tracked by git. Use with caution. Wait — that’s confusing. Actually, the man page says: > -x > Don’t use the standard ignore rules read from .gitignore (as the sole mechanism), but still remove files that are ignored according to .gitignore and also untracked files. That seems contradictory. Let me clarify: Actually, the correct interpretation: - Without `-x` or `-X`: `git clean` removes only untracked files (not ignored). - `-X`: Remove only files ignored by Git (i.e., those that would be ignored by `git status --ignored`). - `-x`: Remove both untracked files AND ignored files (i.e., all files not tracked by Git). Yes — that’s standard. For example, Atlassian docs: “Use `git clean -f -x` to remove both untracked and ignored files.” So `-x` is correct. And `-f` is required to actually perform the removal (not just dry-run). No `-d` — so directories are safe. Therefore, the command is: `git clean -f -x` We must output ONLY that — nothing else. So final output: git clean -f -x But note: the user said “Output ONLY the git command, nothing else.” So no quotes, no backticks, no extra text. Just: git clean -f -x Let’s make sure there’s no trailing space or newline issue — but in text output, it’s fine. We output exactly that string. git clean -f -x
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-super-120b-a12b:none__json_schema FAIL 75% 59 in → 13 out (0 reasoning)
git clean -f
JSON Schema Structured Output
(raw) { "command": "git clean -f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
openai/gpt-5.4-mini:none FAIL 75% 46 in → 9 out (0 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
openai/gpt-5.4-mini:none__json_schema FAIL 75% 81 in → 17 out (0 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) {"command":"git clean -fX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:low FAIL 75% 46 in → 23 out (0 reasoning)
git clean -fdX --dry-run && git clean -fdX -- notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:low__json_schema FAIL 75% 81 in → 26 out (0 reasoning)
git clean -fdX --dry-run && git clean -fdX
JSON Schema Structured Output
(raw) {"command":"git clean -fdX --dry-run && git clean -fdX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:medium FAIL 75% 46 in → 13 out (0 reasoning)
git clean -fdX notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:medium__json_schema FAIL 75% 81 in → 18 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:none FAIL 75% 46 in → 18 out (0 reasoning)
git clean -fdX --dry-run && git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:none__json_schema FAIL 75% 81 in → 27 out (0 reasoning)
git clean -f -X -n && git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X -n && git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4:none__json_schema FAIL 75% 81 in → 19 out (0 reasoning)
git clean -fX -f
JSON Schema Structured Output
(raw) {"command":"git clean -fX -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.5:none FAIL 75% 46 in → 15 out (0 reasoning)
git clean -fX -f notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.6-luna:none FAIL 75% 46 in → 10 out (0 reasoning)
git clean -f -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.6-luna:none__json_schema FAIL 75% 81 in → 18 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-oss-20b:high__json_schema FAIL 75% 107 in → 11 out (0 reasoning)
git clean -fdX
JSON Schema Structured Output
(raw) {"command":"git clean -fdX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-oss-20b:low__json_schema FAIL 75% 107 in → 261 out (237 reasoning)
git clean -f -X .
JSON Schema Structured Output
(raw) { "command": "git clean -f -X ." }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
poolside/laguna-m.1:xhigh__json_schema FAIL 75% 58 in → 4,283 out (4,256 reasoning)
git clean -fdX
JSON Schema Structured Output
(raw) { "command": "git clean -fdX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
poolside/laguna-xs-2.1:none FAIL 75% 58 in → 4 out (0 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
poolside/laguna-xs-2.1:none__json_schema FAIL 75% 58 in → 63 out (0 reasoning)
git clean -f $(git clean -nd | grep -v '^Would remove' | cut -d' ' -f2- | tr '\n' ' ' | sed 's/ $//') 2>/dev/null || git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -f $(git clean -nd | grep -v '^Would remove' | cut -d' ' -f2- | tr '\\n' ' ' | sed 's/ $//') 2>/dev/null || git clean -fd" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
poolside/laguna-xs.2:none FAIL 75% 95 in → 6 out (0 reasoning)
git clean -fd
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
poolside/laguna-xs.2:none__json_schema FAIL 75% 95 in → 12 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command": "git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
prism-ml/ternary-bonsai-2-27b:high FAIL 75% 54 in → 380 out (373 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
qwen/qwen3.6-27b:none FAIL 75% 56 in → 6 out (0 reasoning)
git clean -Xf
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.6-27b:none__json_schema FAIL 75% 56 in → 16 out (0 reasoning)
git clean -fdX
JSON Schema Structured Output
(raw) { "command": "git clean -fdX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.6-35b-a3b:none FAIL 75% 56 in → 5 out (0 reasoning)
git clean -fd
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
qwen/qwen3.6-flash:none FAIL 75% 56 in → 5 out (0 reasoning)
git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.7-flash:none FAIL 75% 56 in → 5 out (0 reasoning)
git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.7-max:none FAIL 75% 56 in → 4 out (0 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
qwen/qwen3.7-plus:none FAIL 75% 56 in → 5 out (0 reasoning)
git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.8-flash:xhigh__json_schema FAIL 75% 107 in → 201 out (189 reasoning)
git clean -fd
JSON Schema Structured Output
(raw) {"command": "git clean -fd"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
qwen/qwen3.8-max:high__json_schema FAIL 75% 94 in → 333 out (309 reasoning)
git clean -fX -- notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -fX -- notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.8-max:low__json_schema FAIL 75% 82 in → 136 out (123 reasoning)
git clean -f
JSON Schema Structured Output
(raw) {"command": "git clean -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
qwen/qwen3.8-max:medium__json_schema FAIL 75% 56 in → 239 out (215 reasoning)
git clean -fX -- notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -fX -- notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.8-max:xhigh__json_schema FAIL 75% 94 in → 237 out (214 reasoning)
git clean -fX notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -fX notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
stealth/ox-alpha:low FAIL 75% 128 in → 10 out (0 reasoning)
git clean -f notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
tencent/hy3:none FAIL 75% 56 in → 6 out (0 reasoning)
git clean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
thinkingmachines/inkling:none FAIL 75% 53 in → 11 out (0 reasoning)
git clean -f -d -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
thinkingmachines/inkling:none__json_schema FAIL 75% 53 in → 14 out (0 reasoning)
git clean -fdX
JSON Schema Structured Output
(raw) { "command": "git clean -fdX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
x-ai/grok-4.3:none FAIL 75% 223 in → 13 out (0 reasoning)
git clean -f -X -d --exclude='*/'
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
x-ai/grok-4.3:none__json_schema FAIL 75% 279 in → 10 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
xiaomi/mimo-v2.6-flash:none FAIL 75% 50 in → 10 out (0 reasoning)
```bash git clean -f ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
z-ai/glm-4.7-flash:high__json_schema FAIL 75% 46 in → 431 out (422 reasoning)
git clean -f
JSON Schema Structured Output
(raw) {"command": "git clean -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
z-ai/glm-4.7-flash:xhigh__json_schema FAIL 75% 46 in → 539 out (497 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) {"command": "git clean -fX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
z-ai/glm-5.2:none__json_schema FAIL 75% 47 in → 19 out (0 reasoning)
git clean -fdX -- notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -fdX -- notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-4.6:low FAIL 50% 59 in → 96 out (0 reasoning)
``` git clean -fX notes.txt debug.log ``` Wait, let me reconsider. `git clean -f` removes untracked files (not ignored). `git clean -fX` removes only ignored files. `git clean -fx` removes both untracked and ignored files. `-d` would include directories, so we omit it. ``` git clean -fx ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-4.6:medium FAIL 50% 59 in → 137 out (0 reasoning)
``` git clean -fX notes.txt debug.log ``` Wait, let me reconsider. The task is to remove all untracked and ignored files but not directories. ``` git clean -f -X && git clean -f ``` Hmm, let me think more carefully. - `git clean -f` removes untracked files (not directories, not ignored) - `git clean -fX` removes only ignored files (not directories) - `git clean -fx` removes both untracked and ignored files (not directories) ``` git clean -fx ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-4.6:none FAIL 50% 59 in → 52 out (0 reasoning)
``` git clean -fX notes.txt debug.log ``` Wait, let me reconsider. The task is to remove all untracked and ignored files but not directories. ``` git clean -fx ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
arcee-ai/trinity-mini:low__json_schema FAIL 50% 50 in → 646 out (733 reasoning)
git clean-f
JSON Schema Structured Output
(raw) { "command": "git clean-f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:medium FAIL 50% 47 in → 223 out (213 reasoning)
git clean-f -x
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemma-4-31b-it:none FAIL 50% 62 in → 12 out (0 reasoning)
git clean -dfx --exclude-dir=.*
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemma-4-31b-it:none__json_schema FAIL 50% 62 in → 11 out (0 reasoning)
,git clean -fX
JSON Schema Structured Output
(raw) {"command":",git clean -fX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
ibm-granite/granite-4.2-8b:high__json_schema FAIL 50% 66 in → 18 out (0 reasoning)
git rm --cached notes.txt
JSON Schema Structured Output
(raw) { "command": "git rm --cached notes.txt" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
ibm-granite/granite-4.2-8b:low__json_schema FAIL 50% 74 in → 22 out (0 reasoning)
git rm --cached --dry-run notes.txt
JSON Schema Structured Output
(raw) { "command": "git rm --cached --dry-run notes.txt" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
ibm-granite/granite-4.2-8b:max__json_schema FAIL 50% 66 in → 18 out (0 reasoning)
git rm --cached notes.txt
JSON Schema Structured Output
(raw) { "command": "git rm --cached notes.txt" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
ibm-granite/granite-4.2-8b:medium FAIL 50% 74 in → 356 out (311 reasoning)
git clean -fd --exclude=debug.log --exclude-dir=.
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
ibm-granite/granite-4.2-8b:medium__json_schema FAIL 50% 74 in → 22 out (0 reasoning)
git rm --cached notes.txt && git rm -r --cached debug.log
JSON Schema Structured Output
(raw) {"command":"git rm --cached notes.txt && git rm -r --cached debug.log"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
ibm-granite/granite-4.2-8b:none FAIL 50% 66 in → 3,497 out (0 reasoning)
git rm --cached notes.txt Note: The instruction says "Remove all untracked and ignored files (but not directories)", but "ignored files" cannot be removed by Git in the same way as untracked files—ignored files are just not tracked or staged. Typically, to remove untracked files, you use `git rm --cached` for files that are already tracked but you want to stop tracking, or `git clean` for untracked files. However, `git clean` also removes ignored files by default unless `-X` or `-x` is used. But the user says: "but not directories", and "output ONLY the git command, nothing else". - "Remove all untracked files" → `git clean -fd` would remove untracked files and empty directories, but `git clean -fd` removes untracked files and empty directories; however, `git clean -f` removes only files, not directories (but `git clean -fd` is safer for directories). But the user says "not directories", so we should avoid removing non-empty directories, but `git clean` only removes empty directories when using `-d`. However, the instruction is "remove all untracked files (but not directories)" — meaning don't remove directories at all, even if they are empty or not empty. But Git clean with `-d` removes empty directories, which might be considered "directories" being affected, so to strictly not remove directories, use `git clean -f` which only removes files (not directories). `git clean -f` removes untracked files only, not directories. - "ignored files" — ignored files are already ignored (e.g., debug.log), and they are not tracked, so they are untracked in effect. But Git doesn't have a direct "remove ignored files" command; ignored files are just not to be tracked, but they exist on disk. If you want to remove them from disk, you'd delete them manually, but Git commands can't "remove" ignored files in the sense of Git operations; `git clean -X` removes ignored files (not tracked), `git clean -x` removes all untracked including ignored. The status shows: - ?? notes.txt (untracked) - debug.log is ignored But "debug.log" is listed under "Ignored files", so it's ignored but may or may not be untracked? Typically, ignored files are untracked files that match ignore patterns. The instruction: "Remove all untracked and ignored files (but not directories)" - "untracked files" typically includes files not added to the index, regardless of ignore status. But "ignored files" might overlap: an ignored file is usually an untracked file that matches an ignore pattern. In the status: - "Untracked files: notes.txt" - "Ignored files: debug.log" — so debug.log might be ignored but could be tracked? No, if it's ignored, it's not tracked, so it's untracked. But Git status shows "Ignored" for files that match ignore patterns and are not tracked. Actually, in `git status`, ignored files are shown separately when using `--ignored`, but by default, ignored files are not shown in "Untracked files"; instead, they might be hidden or shown with "ignored" if you use `git status --ignored`. But in the given status: - "Status: ?? notes.txt" (meaning untracked) - "Untracked files: notes.txt" - "Ignored files: debug.log" — so debug.log is explicitly listed as ignored, likely meaning it's not tracked and matches an ignore pattern. The goal is to "remove all untracked and ignored files", but "but not directories" — so we need a Git command that removes untracked files (notes.txt) and ignored files (debug.log), without removing directories. - `git rm` is for removing tracked files from the index (i.e., stop tracking), but notes.txt is untracked, so `git rm notes.txt` would move it to the index (stage it), not remove it from disk? No: `git rm` without `--cached` removes the file from disk and stages the removal; `git rm --cached` removes from index but keeps disk. But for untracked files, to delete them from disk via Git, you need `git clean`. - `git clean` is used to remove untracked files and directories. `git clean -f` removes only files (untracked), not directories. `git clean -fd` removes untracked files and empty directories. But the instruction says "not directories", so to avoid removing any directories (even empty), use `git clean -f` which only removes files (untracked files), and `git clean -X` removes ignored files (not tracked), `git clean -x` removes all untracked including ignored. `git clean` options: - `-f`: force delete of untracked files/dirs (same as `-fd` for files and empty dirs) - `-x`: include ignored files (in addition to untracked) - `-X`: include ignored files but not untracked (but usually ignored = untracked for ignore patterns) - `-d`: recurse into directories and remove empty ones By default, `git clean -f` removes only untracked files (not directories), `git clean -fd` removes untracked files and empty directories. To remove ignored files, you need `-X` or `-x`. - `git clean -Xf`: remove ignored files (matching .gitignore) but not other untracked files? No: - `-X`: clean only ignored files (i.e., files matching ignore patterns), not all untracked. - `-x`: clean all untracked files and directories (including ignored). But the user says "remove all untracked and ignored files", so that includes both untracked (notes.txt) and ignored (debug.log). Since ignored files are typically untracked (if not tracked), the set might overlap, but in the status, they list "Untracked files" separately and "Ignored files", so likely ignored files are not listed as untracked (maybe because `git status` by default hides ignored files), so we need to clean both. Thus, to remove both untracked and ignored files, use `git clean -x` or `git clean -Xx`? But `git clean -x` removes all untracked files (including ignored), and `-X` removes only ignored. Since we want both untracked and ignored, `-x` should suffice, but `-x` also removes directories? `git clean -x` removes untracked files and directories (empty or not? No: `git clean` only removes empty directories when `-d` is used; `-x` does not imply `-d`, so `-x` removes only untracked files, not directories? Let's clarify: From `man git-clean`: - `-f`, `--force`: forcibly run - `-x`, `--ignored`: also remove ignored files (in addition to untracked files) - `-X`, `--ignored-only`: only remove ignored files (in addition to untracked? no: `-X` removes ignored files, not untracked; untracked might not be removed if not ignored) - `-d`, `--dirs`: also remove empty directories - `-df`, `--force-dirs`: force removal of empty directories - `-x` and `-X` can be combined with `-d` Default behavior of `git clean` (without flags) is to remove untracked files and empty directories. - `git clean -f` (default for `-f`): remove untracked files only (not directories) - `git clean -fd`: remove untracked files and empty directories - `git clean -x`: remove untracked files and ignored files (files matching .gitignore) - `git clean -xd`: remove untracked files, ignored files, and empty directories - `git clean -X`: remove only ignored files (not untracked) - `git clean -Xf`: remove only ignored files Since the user says "remove all untracked and ignored files", we need to remove: - Untracked files (notes.txt) - Ignored files (debug.log) Thus, use `git clean -x` to remove both, but `git clean -x` does not remove non-empty directories (only untracked files; directories are only removed if empty when `-d` is used). `git clean -x` alone removes untracked files (including ignored), but not directories (since no `-d`), which matches "but not directories" (i.e., don't remove directories; `git clean -x` without `-d` only removes files, not directories, because directories are not "untracked" in the sense of being files—they are tracked by Git if they contain changes, but empty directories might be removed only with `-d`). Yes: `git clean` without `-d` only removes files; `-d` adds removal of empty directories. So to avoid removing any directories, use `git clean` without `-d`, i.e., `git clean -x` (which removes untracked files and ignored files) or `git clean -f -x` but `-x` implies `-f`? `-f` is needed to force if there are untracked, but usually `-x` requires `-f` if safe mode. Actually, `git clean` by default is safe and doesn't delete if it would remove more than intended; `-f` is needed to force deletion. But the user probably wants to delete them. However, the instruction says "Output ONLY the git command, nothing else." Given the status: - notes.txt is untracked (shown as ??) - debug.log is ignored So to remove both, the command should be `git clean -x` because `-x` removes ignored files in addition to untracked. But `git clean -x` might remove other ignored files besides debug.log, which is fine since it says "all ignored files". `git clean -X` would only remove ignored, not untracked, so we need `-x` for both. Yes: - `-x`: clean all untracked files AND ignored files - `-X`: clean only ignored files (untracked files might remain if not ignored) Since notes.txt is untracked but may not be ignored (status shows ??, not ignored), we need to remove it, so `-x` is appropriate. `git clean -x` will remove notes.txt (untracked) and debug.log (ignored), and only files (no directories, since `-d` not used), which matches "but not directories". Is `git clean -x` safe? It will delete all untracked and ignored files, which is what we want. But `git clean` by default doesn't delete; you need `-f` for force. `git clean -xf` might be safer, but `-x` alone might prompt? No, `git clean` without `-f` is in dry-run mode? Let's recall: From docs: `git clean` by default does not perform any deletion; `-f` is required to force deletion. So to actually remove, need `git clean -f -x` or `git clean -xf`. `git clean -x` without `-f` might do a dry run? No, `git clean` without `-f` or `-d` only lists files to be removed; `-f` is to force removal. To remove them, use `git clean -xf` (force + ignore). But the user didn't specify safe mode, just "remove", so output the command to remove them. Typically, `git clean -xf` is used to delete untracked and ignored files. - `git clean -f` deletes untracked files only - `git clean -xf` deletes untracked and ignored files - `git clean -Xf` deletes only ignored files - `git clean -fd` deletes untracked files and empty directories - `git clean -xfd` deletes untracked, ignored, and empty directories Since we don't want to remove directories, avoid `-d`, so `git clean -xf` is correct. Yes: `-x` enables ignored, `-f` enables force (to actually delete, not dry-run). Default `git clean` shows what would be removed but doesn't delete; so to delete, need `-f`. Thus, the command should be `git clean -xf` But "but not directories" — `git clean -xf` without `-d` does not remove directories (only files), since `-d` is for directories. So `git clean -xf` removes only files (untracked and ignored), which matches. In the status, debug.log is listed as ignored, notes.txt as untracked, no mention of directories, so `git clean -xf` should remove both files. Now, the user said "Remove all untracked and ignored files (but not directories)", and `git clean -xf` does that. Is there a way with `git rm`? `git rm` can't remove ignored files directly; ignored files are not in the index, so `git rm` only affects tracked files. So `git rm` is not suitable for ignored or untracked files (except tracked ones). For untracked files, `git rm` would stage them but not delete; `git rm --cached` keeps disk, which is not "remove". The user likely means remove from disk, as "remove" in file context usually means delete. Given status shows file names, and "remove" in this context probably means delete the files from disk. Thus, `git clean -xf` is the correct command. But let's confirm with the given status: - Untracked: notes.txt → delete - Ignored: debug.log → delete `git clean -xf` will delete both. `git clean -x` alone might not delete (dry-run), so `git clean -xf` is better. The instruction says "Output ONLY the git command", so simplest that does the job is `git clean -xf` But maybe the user thinks "remove" as in "git rm" for tracked, but for untracked, Git doesn't have a direct "remove" except clean. Yes, standard is `git clean` for deleting untracked. Also, "ignored files" are handled by `-x`. Thus, the command is `git clean -xf` But `git clean -f` alone would only remove untracked, not ignored; `git clean -X` would only remove ignored, not untracked. Since we need both, `-x` is needed. Yes. So output: `git clean -xf` But is `-x` with `-f` redundant? `-xf` is fine. `git clean -f -x` also works, but `git clean -xf` is common. `man git-clean` says: `-x` or `--ignored` also remove ignored files; `-f` or `--force` to actually remove. Thus, `git clean -xf` is correct. Now, the user said "but not directories", and `-xf` without `-d` won't remove directories, so safe. Thus, the git command is `git clean -xf` But let's see if "ignored files" might be tracked? No, ignored files are by definition not tracked (they match ignore patterns, so they are not added to index). In the status, "Ignored files: debug.log" suggests it's not tracked. So yes. Therefore, output only: `git clean -xf` But the initial thought had `git rm --cached` but that's for tracked files only, not untracked/ignored, so incorrect. Thus, final answer: `git clean -xf` git clean -xf
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
ibm-granite/granite-4.2-8b:none__json_schema FAIL 50% 66 in → 20 out (0 reasoning)
git rm --cached --quiet notes.txt
JSON Schema Structured Output
(raw) { "command": "git rm --cached --quiet notes.txt" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
ibm-granite/granite-4.2-8b:xhigh__json_schema FAIL 50% 66 in → 31 out (0 reasoning)
git rm --cached notes.txt; git rm -r --ignore-untracked debug.log
JSON Schema Structured Output
(raw) { "command": "git rm --cached notes.txt; git rm -r --ignore-untracked debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
inception/mercury-2.5:max__json_schema FAIL 50% 246 in → 799 out (720 reasoning)
git clean -x
JSON Schema Structured Output
(raw) {"command": "git clean -x"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
git clean -f -- "(?!^$)(?!\\.git)" "(?!\\.git)" "^[^.].*" "^.*\\.[^.]*$" "^$(\\.([^G]|[^l]|[^i]|[^t]]|[^.]|[^c]|[^h])|\\.(?!git))"
JSON Schema Structured Output
(raw) {"command":"git clean -f -- \"(?!^$)(?!\\\\.git)\" \"(?!\\\\.git)\" \"^[^.].*\" \"^.*\\\\.[^.]*$\" \"^$(\\\\.([^G]|[^l]|[^i]|[^t]]|[^.]|[^c]|[^h])|\\\\.(?!git))\""}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
liquid/lfm-2-24b-a2b FAIL 50% 55 in → 10 out
git rm --ignore-unmatch notes.txt
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
mistralai/mistral-medium-3-5:none FAIL 50% 58 in → 9 out (0 reasoning)
git clean -f --exclude=*
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
mistralai/mistral-medium-3-5:none__json_schema FAIL 50% 46 in → 14 out (0 reasoning)
git clean -f --exclude-dirs
JSON Schema Structured Output
(raw) {"command": "git clean -f --exclude-dirs"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-nano-30b-a3b:low FAIL 50% 59 in → 1,129 out (1,192 reasoning)
gitclean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:high FAIL 50% 46 in → 22 out (0 reasoning)
git clean -fdX --dry-run && git clean -f -X -- notes.txt
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
prism-ml/ternary-bonsai-2-27b:none FAIL 50% 56 in → 34 out (0 reasoning)
git rm --cached -f notes.txt debug.log && git add -A .gitignore && git restore . && git clean -f -s -d --all
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
prism-ml/ternary-bonsai-2-27b:none__json_schema FAIL 50% 150 in → 14 out (0 reasoning)
git clean -f -x --notes.txt
JSON Schema Structured Output
(raw) {"command":"git clean -f -x --notes.txt"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
prism-ml/ternary-bonsai-2-27b:xhigh__json_schema FAIL 50% 186 in → 886 out (875 reasoning)
git clean -x
JSON Schema Structured Output
(raw) {"command":"git clean -x"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.6-35b-a3b:none__json_schema FAIL 50% 56 in → 20 out (0 reasoning)
git clean -fd --exclude=notes.txt
JSON Schema Structured Output
(raw) { "command": "git clean -fd --exclude=notes.txt" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
tencent/hy3:none__json_schema FAIL 50% 56 in → 27 out (0 reasoning)
git clean -fX --exclude='*/' --no-dirs --force
JSON Schema Structured Output
(raw) { "command": "git clean -fX --exclude='*/' --no-dirs --force" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
z-ai/glm-5.2:high__json_schema FAIL 50% 55 in → 235 out (213 reasoning)
git clean -f -x -e notes.txt -- notes.txt
JSON Schema Structured Output
(raw) { "command": "git clean -f -x -e notes.txt -- notes.txt" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fx
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git rm --ignore-unmatch notes.txt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
Failure: OpenAI-compatible response contained provider error: Provider returned error
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-c0c6ae6e-92f9-9c78-8ca1-fe9f0d7cc1c1","request_id":"c0c6ae6e-92f9-9c78-8ca1-fe9f0d7cc1c1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-34802e23-5dd1-997c-b800-0d9095df5dba","request_id":"34802e23-5dd1-997c-b800-0d9095df5dba"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-70cd2096-bcbd-93fb-a64c-6ffcc1279846","request_id":"70cd2096-bcbd-93fb-a64c-6ffcc1279846"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6c569c94-f2f6-9310-ae3a-d3dc21271a3f","request_id":"6c569c94-f2f6-9310-ae3a-d3dc21271a3f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-e248cb7b-059b-95bc-95cb-ef2d971a14d5","request_id":"e248cb7b-059b-95bc-95cb-ef2d971a14d5"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-f5697ebf-6489-9d36-8cef-75db81fb3f5e"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-594469c8-eaa2-91cd-a686-e74c78812da9"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-c67d0034-2eb7-9302-9829-dffd32e7aae5"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-7ed83fa0-2d9b-9bf0-88b0-223175cc0de1"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-1de0c0f9-965c-995c-92f4-2e931e64e357"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-1770038b-c553-9ad2-aa7f-fcce6e59801a"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-0f224992-2c3f-9114-bfb6-8870b5d13a66","request_id":"0f224992-2c3f-9114-bfb6-8870b5d13a66"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-fff288b2-74ee-9ac1-a5da-75e4ea7937ce","request_id":"fff288b2-74ee-9ac1-a5da-75e4ea7937ce"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-b5b18879-943c-92e5-ab27-2df342f7b1a8","request_id":"b5b18879-943c-92e5-ab27-2df342f7b1a8"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-dc047dbb-9a91-9da2-8205-1686dfe7c187","request_id":"dc047dbb-9a91-9da2-8205-1686dfe7c187"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-582c101c-5bba-90eb-92b9-24faa7125c34","request_id":"582c101c-5bba-90eb-92b9-24faa7125c34"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-aef855e4-1c9a-91fb-8ac4-fc331fbb9fd7","request_id":"aef855e4-1c9a-91fb-8ac4-fc331fbb9fd7"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-15fe6dd1-04e4-9f1f-acb7-c2f82e643884","request_id":"15fe6dd1-04e4-9f1f-acb7-c2f82e643884"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-4ea846d2-6e05-977a-8a22-3b6b9c461784","request_id":"4ea846d2-6e05-977a-8a22-3b6b9c461784"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-3a52e23d-d4b0-903b-987e-4bc67298b602","request_id":"3a52e23d-d4b0-903b-987e-4bc67298b602"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6df65850-d79d-9353-99a8-4a657ab9ab52","request_id":"6df65850-d79d-9353-99a8-4a657ab9ab52"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: ```bash git clean -fx ```
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fx
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: ``` git clean -fx ```
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -f -d --ignored --exclude="*/*"{ "command": "git clean -f -d --ignored --exclude='*/*'" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fx
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -f -x
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fx
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)