Remove all untracked and ignored files
Tests ability to remove both untracked and ignored files with git clean -fx. Evaluates comprehensive cleanup flags.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo '*.log' > .gitignore
  5. 05 echo 'tracked' > tracked.txt
  6. 06 git add .gitignore tracked.txt
  7. 07 git commit -m 'Initial commit'
  8. 08 echo 'data' > debug.log
  9. 09 echo 'untracked' > notes.txt
Prompt
Remove all untracked and ignored files (but not directories). Output ONLY the git command, nothing else.
Expected
git clean -f -x

Scoped model quality, cost, API time, and token usage for git_clean/f005.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 76 in → 49 out (32 reasoning)
git clean -fx
anthropic/claude-fable-5:high__json_schema PASS 100% 286 in → 44 out (45 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-fable-5:low PASS 100% 76 in → 26 out (32 reasoning)
git clean -f -x
anthropic/claude-fable-5:low__json_schema PASS 100% 286 in → 16 out (0 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-fable-5:max PASS 100% 76 in → 212 out (74 reasoning)
``` git clean -fx ```
anthropic/claude-fable-5:max__json_schema PASS 100% 286 in → 163 out (64 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-fable-5:medium PASS 100% 76 in → 41 out (33 reasoning)
``` git clean -f -x ```
anthropic/claude-fable-5:medium__json_schema PASS 100% 286 in → 46 out (34 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-fable-5:xhigh PASS 100% 76 in → 89 out (64 reasoning)
``` git clean -fx ```
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 286 in → 77 out (44 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-haiku-4.5:high PASS 100% 88 in → 1,298 out (720 reasoning)
``` git clean -f -x ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 251 in → 979 out (580 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-haiku-4.5:low PASS 100% 88 in → 347 out (319 reasoning)
``` git clean -f -x ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 251 in → 890 out (546 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-haiku-4.5:medium PASS 100% 88 in → 4,694 out (1,764 reasoning)
``` git clean -fx ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 251 in → 359 out (315 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 88 in → 609 out (522 reasoning)
``` git clean -fx ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 251 in → 348 out (324 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
anthropic/claude-opus-4.6:high PASS 100% 59 in → 12 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 222 in → 123 out (101 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:low PASS 100% 59 in → 11 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 222 in → 11 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:max PASS 100% 59 in → 217 out (185 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 222 in → 117 out (94 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:medium PASS 100% 59 in → 11 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 222 in → 11 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:none PASS 100% 59 in → 11 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 222 in → 11 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.6:xhigh PASS 100% 59 in → 157 out (134 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 222 in → 97 out (76 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:high PASS 100% 81 in → 12 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.7:high__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:low PASS 100% 81 in → 10 out (0 reasoning)
git clean -fx
anthropic/claude-opus-4.7:low__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:max PASS 100% 81 in → 15 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:medium PASS 100% 81 in → 12 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:none PASS 100% 81 in → 12 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.7:none__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.7:xhigh PASS 100% 81 in → 12 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 291 in → 17 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.8:high PASS 100% 76 in → 8 out (0 reasoning)
git clean -fx
anthropic/claude-opus-4.8:high__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-opus-4.8:low PASS 100% 76 in → 10 out (0 reasoning)
`git clean -fx`
anthropic/claude-opus-4.8:low__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.8:max PASS 100% 76 in → 321 out (74 reasoning)
`git clean -fx`
anthropic/claude-opus-4.8:max__json_schema PASS 100% 286 in → 206 out (61 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
anthropic/claude-opus-4.8:medium PASS 100% 76 in → 8 out (0 reasoning)
git clean -fx
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-opus-4.8:none PASS 100% 76 in → 12 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
anthropic/claude-opus-4.8:xhigh PASS 100% 76 in → 133 out (69 reasoning)
`git clean -fx`
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-4.6:high PASS 100% 59 in → 129 out (109 reasoning)
``` git clean -fx ```
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 222 in → 171 out (146 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-4.6:max PASS 100% 59 in → 289 out (217 reasoning)
``` git clean -fx ```
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 222 in → 147 out (122 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 59 in → 105 out (81 reasoning)
``` git clean -fx ```
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 222 in → 208 out (178 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-5:high PASS 100% 76 in → 13 out (0 reasoning)
``` git clean -x -f ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -xf
JSON Schema Structured Output
(raw) {"command": "git clean -xf"}
anthropic/claude-sonnet-5:low__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-5:medium PASS 100% 76 in → 12 out (0 reasoning)
``` git clean -xf ```
anthropic/claude-sonnet-5:none PASS 100% 76 in → 12 out (0 reasoning)
``` git clean -fx ```
anthropic/claude-sonnet-5:none__json_schema PASS 100% 286 in → 14 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 286 in → 15 out (0 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
arcee-ai/trinity-large-thinking:high PASS 100% 50 in → 738 out (734 reasoning)
git clean -xf
arcee-ai/trinity-large-thinking:low PASS 100% 50 in → 1,109 out (1,115 reasoning)
git clean -fx
arcee-ai/trinity-large-thinking:medium PASS 100% 50 in → 368 out (362 reasoning)
git clean -f -x
arcee-ai/trinity-large-thinking:xhigh PASS 100% 50 in → 964 out (963 reasoning)
git clean -fx
arcee-ai/trinity-mini:high PASS 100% 50 in → 329 out (350 reasoning)
git clean -f -x
arcee-ai/trinity-mini:low PASS 100% 50 in → 373 out (409 reasoning)
git clean -f -x
arcee-ai/trinity-mini:medium PASS 100% 50 in → 505 out (542 reasoning)
git clean -f -x
arcee-ai/trinity-mini:medium__json_schema PASS 100% 50 in → 1,254 out (1,290 reasoning)
git clean -x -f
JSON Schema Structured Output
(raw) { "command": "git clean -x -f" }
arcee-ai/trinity-mini:xhigh PASS 100% 50 in → 683 out (703 reasoning)
git clean -f -x
arcee-ai/trinity-mini:xhigh__json_schema PASS 100% 50 in → 371 out (375 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command":"git clean -f -x" }
deepseek/deepseek-v4-flash-0731:high PASS 100% 53 in → 356 out (348 reasoning)
git clean -f -x
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 126 in → 903 out (951 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
deepseek/deepseek-v4-flash-0731:low PASS 100% 47 in → 231 out (219 reasoning)
git clean -fx
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 47 in → 292 out (275 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
deepseek/deepseek-v4-flash-0731:max PASS 100% 126 in → 1,568 out (1,623 reasoning)
git clean -fx
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 126 in → 4,585 out (4,599 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 47 in → 320 out (314 reasoning)
git clean -fx
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 47 in → 277 out (268 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx"}
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 47 in → 374 out (403 reasoning)
git clean -fx
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 47 in → 354 out (331 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
deepseek/deepseek-v4-flash:high PASS 100% 47 in → 451 out (420 reasoning)
git clean -fx
deepseek/deepseek-v4-flash:low PASS 100% 47 in → 394 out (386 reasoning)
git clean -f -x
deepseek/deepseek-v4-flash:xhigh PASS 100% 126 in → 496 out (488 reasoning)
git clean -f -x
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 126 in → 777 out (775 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
deepseek/deepseek-v4-pro:high PASS 100% 47 in → 266 out (258 reasoning)
git clean -f -x
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 234 in → 227 out (217 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
deepseek/deepseek-v4-pro:low PASS 100% 47 in → 329 out (321 reasoning)
git clean -f -x
deepseek/deepseek-v4-pro:medium PASS 100% 47 in → 335 out (329 reasoning)
git clean -fx
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 234 in → 358 out (347 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 49 in → 12 out (0 reasoning)
rm -f notes.txt debug.log
JSON Schema Structured Output
(raw) {"command": "rm -f notes.txt debug.log"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 126 in → 1,228 out (1,223 reasoning)
git clean -fx
google/gemini-3-flash-preview:high PASS 100% 49 in → 210 out (206 reasoning)
git clean -fx
google/gemini-3-flash-preview:high__json_schema PASS 100% 106 in → 271 out (261 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
google/gemini-3-flash-preview:low PASS 100% 49 in → 229 out (225 reasoning)
git clean -fx
google/gemini-3-flash-preview:low__json_schema PASS 100% 106 in → 324 out (316 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3-flash-preview:medium PASS 100% 49 in → 228 out (224 reasoning)
git clean -fx
google/gemini-3-flash-preview:medium__json_schema PASS 100% 106 in → 328 out (320 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3-flash-preview:xhigh PASS 100% 49 in → 256 out (252 reasoning)
git clean -fx
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 106 in → 348 out (339 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 50 in → 359 out (355 reasoning)
git clean -xf
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 50 in → 474 out (465 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 106 in → 123 out (112 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.1-flash-lite-preview:medium PASS 100% 49 in → 349 out (345 reasoning)
git clean -fx
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 50 in → 175 out (161 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 49 in → 454 out (450 reasoning)
git clean -fx
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 106 in → 526 out (515 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.1-pro-preview:high PASS 100% 49 in → 396 out (392 reasoning)
git clean -fx
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 106 in → 335 out (326 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-pro-preview:low PASS 100% 49 in → 319 out (315 reasoning)
git clean -fx
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 106 in → 296 out (287 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-pro-preview:medium PASS 100% 49 in → 316 out (312 reasoning)
git clean -fx
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 106 in → 187 out (178 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 49 in → 448 out (444 reasoning)
git clean -fx
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 106 in → 269 out (260 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.5-flash-lite:high PASS 100% 50 in → 601 out (597 reasoning)
git clean -fx
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 50 in → 422 out (411 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.5-flash-lite:max PASS 100% 50 in → 300 out (296 reasoning)
git clean -fx
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 106 in → 450 out (439 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
google/gemini-3.5-flash-lite:medium PASS 100% 49 in → 396 out (392 reasoning)
git clean -fx
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 106 in → 460 out (450 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 49 in → 630 out (626 reasoning)
git clean -xf
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 106 in → 379 out (369 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
google/gemini-3.5-flash:high PASS 100% 49 in → 478 out (474 reasoning)
git clean -fx
google/gemini-3.5-flash:high__json_schema PASS 100% 106 in → 460 out (451 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.5-flash:low PASS 100% 49 in → 348 out (344 reasoning)
git clean -fx
google/gemini-3.5-flash:low__json_schema PASS 100% 106 in → 159 out (145 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemini-3.5-flash:medium PASS 100% 49 in → 411 out (407 reasoning)
git clean -fx
google/gemini-3.5-flash:medium__json_schema PASS 100% 106 in → 315 out (306 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.5-flash:xhigh PASS 100% 49 in → 360 out (356 reasoning)
git clean -fx
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 106 in → 498 out (489 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
google/gemini-3.6-flash:high PASS 100% 50 in → 520 out (516 reasoning)
git clean -fx
google/gemini-3.6-flash:high__json_schema PASS 100% 106 in → 382 out (366 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
google/gemini-3.6-flash:low PASS 100% 50 in → 226 out (222 reasoning)
git clean -fx
google/gemini-3.6-flash:max PASS 100% 49 in → 515 out (511 reasoning)
git clean -fx
google/gemini-3.6-flash:max__json_schema PASS 100% 50 in → 300 out (292 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3.6-flash:medium PASS 100% 50 in → 366 out (362 reasoning)
git clean -fx
google/gemini-3.6-flash:medium__json_schema PASS 100% 106 in → 305 out (297 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemini-3.6-flash:xhigh PASS 100% 49 in → 455 out (451 reasoning)
git clean -fx
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 106 in → 304 out (296 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemma-4-26b-a4b-it:high PASS 100% 65 in → 289 out (251 reasoning)
git clean -fx
google/gemma-4-26b-a4b-it:high__json_schema PASS 100% 65 in → 239 out (200 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-26b-a4b-it:low PASS 100% 65 in → 303 out (267 reasoning)
git clean -fx
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 65 in → 292 out (255 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-26b-a4b-it:medium PASS 100% 64 in → 243 out (212 reasoning)
git clean -fx
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 64 in → 1,176 out (1,082 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-26b-a4b-it:xhigh PASS 100% 64 in → 299 out (265 reasoning)
git clean -fx
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 64 in → 356 out (321 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-31b-it:high PASS 100% 65 in → 197 out (171 reasoning)
git clean -fx
google/gemma-4-31b-it:high__json_schema PASS 100% 65 in → 235 out (207 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-31b-it:low PASS 100% 65 in → 214 out (190 reasoning)
git clean -fx
google/gemma-4-31b-it:low__json_schema PASS 100% 64 in → 225 out (195 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
google/gemma-4-31b-it:medium PASS 100% 65 in → 553 out (494 reasoning)
git clean -fx
google/gemma-4-31b-it:medium__json_schema PASS 100% 68 in → 227 out (217 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
google/gemma-4-31b-it:xhigh PASS 100% 65 in → 242 out (1 reasoning)
git clean -fx
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 65 in → 224 out (189 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
ibm-granite/granite-4.1-8b PASS 100% 59 in → 7 out
git clean -f -x
minimax/minimax-m2.5:high PASS 100% 89 in → 267 out (261 reasoning)
git clean -fx
minimax/minimax-m2.5:high__json_schema PASS 100% 78 in → 604 out (630 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
minimax/minimax-m2.5:low PASS 100% 78 in → 636 out (683 reasoning)
git clean -fx
minimax/minimax-m2.5:medium PASS 100% 78 in → 746 out (820 reasoning)
git clean -fx
minimax/minimax-m2.5:medium__json_schema PASS 100% 78 in → 851 out (846 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 78 in → 750 out (785 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
minimax/minimax-m2.7:high PASS 100% 78 in → 695 out (688 reasoning)
git clean -fx
minimax/minimax-m2.7:high__json_schema PASS 100% 210 in → 1,133 out (1,121 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
minimax/minimax-m2.7:low PASS 100% 80 in → 634 out (627 reasoning)
git clean -f -x
minimax/minimax-m2.7:low__json_schema PASS 100% 210 in → 758 out (746 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
minimax/minimax-m2.7:medium PASS 100% 78 in → 720 out (752 reasoning)
git clean -f -x
minimax/minimax-m2.7:medium__json_schema PASS 100% 210 in → 1,829 out (1,817 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
minimax/minimax-m2.7:xhigh PASS 100% 80 in → 628 out (621 reasoning)
git clean -f -x
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 210 in → 675 out (663 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
minimax/minimax-m3:high PASS 100% 216 in → 268 out (295 reasoning)
git clean -fx
minimax/minimax-m3:low PASS 100% 216 in → 240 out (230 reasoning)
`git clean -fx`
minimax/minimax-m3:medium PASS 100% 216 in → 257 out (258 reasoning)
`git clean -fx`
minimax/minimax-m3:xhigh PASS 100% 216 in → 198 out (215 reasoning)
git clean -fdx
mistralai/mistral-medium-3-5:high PASS 100% 58 in → 560 out (602 reasoning)
git clean -f -x
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 46 in → 535 out (561 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
mistralai/mistral-medium-3-5:low PASS 100% 58 in → 644 out (664 reasoning)
git clean -f -x
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 46 in → 632 out (656 reasoning)
git clean -f -x --no-dry-run
JSON Schema Structured Output
(raw) {"command": "git clean -f -x --no-dry-run"}
mistralai/mistral-medium-3-5:medium PASS 100% 58 in → 1,038 out (1,133 reasoning)
git clean -f -x
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 46 in → 433 out (453 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 58 in → 730 out (781 reasoning)
git clean -fx
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 46 in → 385 out (421 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k2.6:high PASS 100% 50 in → 779 out (771 reasoning)
git clean -f -x
moonshotai/kimi-k2.6:high__json_schema PASS 100% 50 in → 1,019 out (1,090 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
moonshotai/kimi-k2.6:low PASS 100% 50 in → 1,941 out (1,935 reasoning)
git clean -fx
moonshotai/kimi-k2.6:low__json_schema PASS 100% 49 in → 986 out (1,070 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k2.6:medium PASS 100% 50 in → 1,074 out (1,120 reasoning)
git clean -f -x
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 49 in → 790 out (711 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
moonshotai/kimi-k2.6:xhigh PASS 100% 50 in → 1,636 out (1,630 reasoning)
git clean -fx
moonshotai/kimi-k2.6:xhigh__json_schema PASS 100% 50 in → 433 out (424 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
moonshotai/kimi-k2.7-code:high PASS 100% 50 in → 236 out (255 reasoning)
git clean -fx
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 50 in → 320 out (309 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k2.7-code:low PASS 100% 49 in → 220 out (214 reasoning)
git clean -fx
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 50 in → 369 out (380 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
moonshotai/kimi-k2.7-code:medium PASS 100% 50 in → 556 out (624 reasoning)
git clean -fx
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 50 in → 503 out (510 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k2.7-code:xhigh PASS 100% 49 in → 270 out (264 reasoning)
git clean -fx
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 133 in → 157 out (146 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
moonshotai/kimi-k3:high PASS 100% 127 in → 133 out (111 reasoning)
``` git clean -fx ```
moonshotai/kimi-k3:high__json_schema PASS 100% 127 in → 115 out (96 reasoning)
git clean -fx
moonshotai/kimi-k3:low PASS 100% 127 in → 139 out (120 reasoning)
git clean -fx
moonshotai/kimi-k3:low__json_schema PASS 100% 127 in → 135 out (116 reasoning)
git clean -fx
moonshotai/kimi-k3:max PASS 100% 127 in → 165 out (146 reasoning)
git clean -fx
moonshotai/kimi-k3:max__json_schema PASS 100% 127 in → 162 out (143 reasoning)
git clean -fx
moonshotai/kimi-k3:medium PASS 100% 127 in → 140 out (121 reasoning)
git clean -fx
moonshotai/kimi-k3:medium__json_schema PASS 100% 127 in → 269 out (250 reasoning)
git clean -fx
moonshotai/kimi-k3:xhigh PASS 100% 127 in → 268 out (249 reasoning)
git clean -fx
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 223 in → 255 out (232 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 59 in → 780 out (817 reasoning)
git clean -f -x .
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 59 in → 1,050 out (1,120 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) { "command": "git clean -fdx" }
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 59 in → 2,356 out (2,461 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 59 in → 735 out (756 reasoning)
git clean -f -x
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 59 in → 1,532 out (1,593 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 59 in → 248 out (234 reasoning)
git clean -fx
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 59 in → 262 out (237 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 59 in → 218 out (204 reasoning)
git clean -fx
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 59 in → 283 out (260 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 59 in → 617 out (582 reasoning)
git clean -fx
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 59 in → 590 out (555 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 59 in → 388 out (410 reasoning)
git clean -f -x
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 59 in → 455 out (421 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
openai/gpt-5.4-mini:high PASS 100% 46 in → 207 out (195 reasoning)
git clean -f -x
openai/gpt-5.4-mini:high__json_schema PASS 100% 81 in → 179 out (161 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4-mini:low PASS 100% 46 in → 96 out (84 reasoning)
git clean -f -x
openai/gpt-5.4-mini:low__json_schema PASS 100% 81 in → 128 out (108 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.4-mini:medium PASS 100% 46 in → 175 out (163 reasoning)
git clean -f -x
openai/gpt-5.4-mini:medium__json_schema PASS 100% 81 in → 213 out (193 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.4-mini:xhigh PASS 100% 46 in → 228 out (218 reasoning)
git clean -fx
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 81 in → 315 out (295 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.4-nano:high__json_schema PASS 100% 81 in → 178 out (160 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4-nano:xhigh PASS 100% 46 in → 473 out (463 reasoning)
git clean -fx
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 81 in → 460 out (442 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4:high PASS 100% 46 in → 273 out (263 reasoning)
git clean -fx
openai/gpt-5.4:high__json_schema PASS 100% 81 in → 185 out (167 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4:low PASS 100% 46 in → 91 out (79 reasoning)
git clean -f -x
openai/gpt-5.4:low__json_schema PASS 100% 81 in → 167 out (147 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.4:medium PASS 100% 46 in → 184 out (174 reasoning)
git clean -fx
openai/gpt-5.4:medium__json_schema PASS 100% 81 in → 117 out (99 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.4:none PASS 100% 46 in → 17 out (0 reasoning)
git clean -fX; git clean -f -- notes.txt
openai/gpt-5.4:xhigh PASS 100% 46 in → 526 out (516 reasoning)
git clean -fx
openai/gpt-5.4:xhigh__json_schema PASS 100% 81 in → 2,611 out (2,588 reasoning)
git clean -fx -- notes.txt debug.log
JSON Schema Structured Output
(raw) {"command":"git clean -fx -- notes.txt debug.log"}
openai/gpt-5.5:high PASS 100% 46 in → 275 out (263 reasoning)
git clean -f -x
openai/gpt-5.5:high__json_schema PASS 100% 81 in → 133 out (113 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.5:low PASS 100% 46 in → 100 out (88 reasoning)
git clean -f -x
openai/gpt-5.5:low__json_schema PASS 100% 81 in → 97 out (77 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.5:medium PASS 100% 46 in → 209 out (197 reasoning)
git clean -f -x
openai/gpt-5.5:medium__json_schema PASS 100% 81 in → 176 out (156 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.5:none__json_schema PASS 100% 81 in → 22 out (0 reasoning)
git clean -fX && git clean -f
JSON Schema Structured Output
(raw) {"command":"git clean -fX && git clean -f"}
openai/gpt-5.5:xhigh PASS 100% 46 in → 526 out (516 reasoning)
git clean -fx
openai/gpt-5.5:xhigh__json_schema PASS 100% 81 in → 235 out (215 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:high PASS 100% 46 in → 100 out (88 reasoning)
git clean -f -x
openai/gpt-5.6-luna:high__json_schema PASS 100% 81 in → 208 out (188 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:low PASS 100% 46 in → 67 out (55 reasoning)
git clean -f -x
openai/gpt-5.6-luna:low__json_schema PASS 100% 81 in → 97 out (77 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:max PASS 100% 46 in → 147 out (135 reasoning)
git clean -f -x
openai/gpt-5.6-luna:max__json_schema PASS 100% 81 in → 536 out (516 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:medium PASS 100% 46 in → 69 out (57 reasoning)
git clean -f -x
openai/gpt-5.6-luna:medium__json_schema PASS 100% 81 in → 82 out (62 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-luna:xhigh PASS 100% 46 in → 105 out (95 reasoning)
git clean -fx
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 81 in → 493 out (473 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-sol:high PASS 100% 46 in → 144 out (134 reasoning)
git clean -fx
openai/gpt-5.6-sol:high__json_schema PASS 100% 81 in → 147 out (129 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-sol:low PASS 100% 46 in → 75 out (65 reasoning)
git clean -fx
openai/gpt-5.6-sol:low__json_schema PASS 100% 81 in → 85 out (67 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-sol:max PASS 100% 46 in → 145 out (135 reasoning)
git clean -fx
openai/gpt-5.6-sol:max__json_schema PASS 100% 81 in → 336 out (316 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-sol:medium PASS 100% 46 in → 98 out (88 reasoning)
git clean -fx
openai/gpt-5.6-sol:medium__json_schema PASS 100% 81 in → 85 out (67 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-sol:none PASS 100% 46 in → 17 out (0 reasoning)
git clean -fX && git clean -f -- notes.txt
openai/gpt-5.6-sol:none__json_schema PASS 100% 81 in → 22 out (0 reasoning)
git clean -fX && git clean -f
JSON Schema Structured Output
(raw) {"command":"git clean -fX && git clean -f"}
openai/gpt-5.6-sol:xhigh PASS 100% 46 in → 206 out (196 reasoning)
git clean -fx
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 81 in → 197 out (179 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-terra:high PASS 100% 46 in → 89 out (79 reasoning)
git clean -fx
openai/gpt-5.6-terra:high__json_schema PASS 100% 81 in → 84 out (66 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-terra:low PASS 100% 46 in → 143 out (131 reasoning)
git clean -f -x
openai/gpt-5.6-terra:low__json_schema PASS 100% 81 in → 107 out (89 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-5.6-terra:max PASS 100% 46 in → 302 out (290 reasoning)
git clean -f -x
openai/gpt-5.6-terra:max__json_schema PASS 100% 81 in → 260 out (240 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-terra:medium PASS 100% 46 in → 63 out (51 reasoning)
git clean -f -x
openai/gpt-5.6-terra:medium__json_schema PASS 100% 81 in → 105 out (85 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-5.6-terra:none PASS 100% 46 in → 14 out (0 reasoning)
git clean -fX && git clean -f
openai/gpt-5.6-terra:none__json_schema PASS 100% 81 in → 22 out (0 reasoning)
git clean -fX; git clean -f
JSON Schema Structured Output
(raw) {"command":"git clean -fX; git clean -f"}
openai/gpt-5.6-terra:xhigh PASS 100% 46 in → 85 out (73 reasoning)
git clean -f -x
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 81 in → 95 out (75 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-oss-120b:high PASS 100% 105 in → 765 out (783 reasoning)
git clean -f -x
openai/gpt-oss-120b:high__json_schema PASS 100% 105 in → 448 out (428 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-oss-120b:low PASS 100% 94 in → 134 out (118 reasoning)
git clean -f -x
openai/gpt-oss-120b:low__json_schema PASS 100% 107 in → 282 out (259 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
openai/gpt-oss-120b:medium PASS 100% 94 in → 302 out (283 reasoning)
git clean -f -x
openai/gpt-oss-120b:medium__json_schema PASS 100% 107 in → 233 out (214 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-oss-120b:xhigh PASS 100% 94 in → 775 out (834 reasoning)
git clean -f -x
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 94 in → 629 out (658 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
openai/gpt-oss-20b:high PASS 100% 106 in → 558 out (574 reasoning)
git clean -f -x
openai/gpt-oss-20b:low PASS 100% 94 in → 218 out (223 reasoning)
git clean -f -x
openai/gpt-oss-20b:medium PASS 100% 107 in → 581 out (626 reasoning)
git clean -f -x
openai/gpt-oss-20b:medium__json_schema PASS 100% 107 in → 603 out (598 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command":"git clean -f -x"}
openai/gpt-oss-20b:xhigh PASS 100% 109 in → 652 out (652 reasoning)
git clean -f -x
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 105 in → 538 out (565 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
poolside/laguna-m.1:high PASS 100% 58 in → 258 out (251 reasoning)
git clean -fx
poolside/laguna-m.1:high__json_schema PASS 100% 58 in → 413 out (389 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command" : "git clean -fx" }
poolside/laguna-m.1:low PASS 100% 58 in → 292 out (285 reasoning)
git clean -fx
poolside/laguna-m.1:low__json_schema PASS 100% 58 in → 1,097 out (1,086 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
poolside/laguna-m.1:medium PASS 100% 58 in → 1,049 out (1,042 reasoning)
git clean -fx
poolside/laguna-m.1:medium__json_schema PASS 100% 58 in → 577 out (566 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
poolside/laguna-m.1:none PASS 100% 58 in → 6 out (0 reasoning)
git clean -fx
poolside/laguna-m.1:none__json_schema PASS 100% 58 in → 16 out (0 reasoning)
git clean -fdX && git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fdX && git clean -fx"}
poolside/laguna-m.1:xhigh PASS 100% 58 in → 514 out (507 reasoning)
git clean -fx
poolside/laguna-xs-2.1:high PASS 100% 58 in → 776 out (769 reasoning)
git clean -x -f
poolside/laguna-xs-2.1:high__json_schema PASS 100% 58 in → 473 out (460 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
poolside/laguna-xs-2.1:low PASS 100% 58 in → 1,137 out (1,130 reasoning)
git clean -f -x
poolside/laguna-xs-2.1:low__json_schema PASS 100% 58 in → 479 out (462 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
poolside/laguna-xs-2.1:medium PASS 100% 58 in → 422 out (415 reasoning)
git clean -f -x
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 58 in → 701 out (688 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
poolside/laguna-xs-2.1:xhigh PASS 100% 58 in → 1,137 out (1,130 reasoning)
git clean -f -x
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 58 in → 681 out (670 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
poolside/laguna-xs.2:high PASS 100% 95 in → 280 out (273 reasoning)
git clean -fx
poolside/laguna-xs.2:high__json_schema PASS 100% 95 in → 216 out (203 reasoning)
git clean -x -f
JSON Schema Structured Output
(raw) {"command": "git clean -x -f"}
poolside/laguna-xs.2:low PASS 100% 95 in → 399 out (392 reasoning)
git clean -fx
poolside/laguna-xs.2:low__json_schema PASS 100% 95 in → 399 out (386 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
poolside/laguna-xs.2:medium PASS 100% 95 in → 296 out (289 reasoning)
git clean -fx
poolside/laguna-xs.2:medium__json_schema PASS 100% 95 in → 293 out (282 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
poolside/laguna-xs.2:xhigh PASS 100% 95 in → 336 out (329 reasoning)
git clean -fx
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 95 in → 172 out (159 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) {"command": "git clean -f -x"}
qwen/qwen3.6-27b:high PASS 100% 54 in → 1,049 out (1,040 reasoning)
git clean -fx
qwen/qwen3.6-27b:low PASS 100% 54 in → 1,383 out (1,348 reasoning)
git clean -fx
qwen/qwen3.6-27b:medium PASS 100% 54 in → 1,446 out (1,383 reasoning)
git clean -fx
qwen/qwen3.6-27b:medium__json_schema PASS 100% 54 in → 1,263 out (1 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-27b:xhigh PASS 100% 54 in → 1,234 out (1,210 reasoning)
git clean -fx
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 54 in → 753 out (1 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-35b-a3b:high PASS 100% 54 in → 1,414 out (1,401 reasoning)
git clean -fx
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 54 in → 1,477 out (1,401 reasoning)
git clean -xf
JSON Schema Structured Output
(raw) { "command": "git clean -xf" }
qwen/qwen3.6-35b-a3b:low PASS 100% 54 in → 2,196 out (2,161 reasoning)
git clean -fx
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 54 in → 1,301 out (1,258 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 54 in → 1,864 out (1,830 reasoning)
git clean -fx
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 54 in → 1,382 out (1,366 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 54 in → 1,160 out (1,110 reasoning)
git clean -fx
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 54 in → 1,379 out (1,364 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
qwen/qwen3.6-flash:high PASS 100% 54 in → 1,564 out (1,555 reasoning)
git clean -xf
qwen/qwen3.6-flash:low PASS 100% 54 in → 2,147 out (2,138 reasoning)
git clean -xf
qwen/qwen3.6-flash:medium PASS 100% 54 in → 1,576 out (1,567 reasoning)
git clean -fx
qwen/qwen3.6-flash:xhigh PASS 100% 54 in → 1,392 out (1,383 reasoning)
git clean -fx
qwen/qwen3.7-flash:high PASS 100% 54 in → 1,380 out (1,371 reasoning)
git clean -fx
qwen/qwen3.7-flash:low PASS 100% 54 in → 2,054 out (2,045 reasoning)
git clean -fx
qwen/qwen3.7-flash:max PASS 100% 54 in → 1,390 out (1,381 reasoning)
git clean -fx
qwen/qwen3.7-flash:medium PASS 100% 54 in → 1,105 out (1,096 reasoning)
git clean -fx
qwen/qwen3.7-flash:xhigh PASS 100% 54 in → 1,427 out (1,418 reasoning)
git clean -fx
qwen/qwen3.7-max:high PASS 100% 54 in → 761 out (752 reasoning)
git clean -fx
qwen/qwen3.7-max:low PASS 100% 54 in → 778 out (769 reasoning)
git clean -fx
qwen/qwen3.7-max:medium PASS 100% 54 in → 386 out (377 reasoning)
git clean -fx
qwen/qwen3.7-max:xhigh PASS 100% 54 in → 647 out (638 reasoning)
git clean -fx
qwen/qwen3.7-plus:high PASS 100% 54 in → 760 out (751 reasoning)
git clean -fx
qwen/qwen3.7-plus:low PASS 100% 54 in → 1,025 out (1,014 reasoning)
git clean -f -x
qwen/qwen3.7-plus:medium PASS 100% 54 in → 619 out (610 reasoning)
git clean -fx
qwen/qwen3.7-plus:xhigh PASS 100% 54 in → 1,145 out (1,136 reasoning)
git clean -fx
tencent/hy3:high PASS 100% 53 in → 636 out (630 reasoning)
git clean -fx
tencent/hy3:high__json_schema PASS 100% 53 in → 1,128 out (1,169 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
tencent/hy3:low PASS 100% 53 in → 664 out (654 reasoning)
git clean -fx
tencent/hy3:low__json_schema PASS 100% 53 in → 686 out (701 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
tencent/hy3:medium PASS 100% 53 in → 677 out (716 reasoning)
git clean -fx
tencent/hy3:medium__json_schema PASS 100% 53 in → 457 out (458 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
tencent/hy3:xhigh PASS 100% 53 in → 1,244 out (1,272 reasoning)
git clean -fx
tencent/hy3:xhigh__json_schema PASS 100% 53 in → 1,732 out (1,752 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
thinkingmachines/inkling-small:high PASS 100% 55 in → 220 out (210 reasoning)
git clean -fx
thinkingmachines/inkling-small:high__json_schema PASS 100% 55 in → 267 out (248 reasoning)
git clean -f -x
JSON Schema Structured Output
(raw) { "command": "git clean -f -x" }
thinkingmachines/inkling-small:low PASS 100% 55 in → 87 out (81 reasoning)
git clean -fx
thinkingmachines/inkling-small:low__json_schema PASS 100% 55 in → 104 out (87 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
thinkingmachines/inkling-small:max PASS 100% 55 in → 224 out (229 reasoning)
git clean -fx
thinkingmachines/inkling-small:max__json_schema PASS 100% 55 in → 274 out (257 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
thinkingmachines/inkling-small:medium PASS 100% 55 in → 194 out (185 reasoning)
git clean -fx
thinkingmachines/inkling-small:medium__json_schema PASS 100% 55 in → 186 out (169 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
thinkingmachines/inkling-small:none PASS 100% 53 in → 9 out (0 reasoning)
git clean -fd -x
thinkingmachines/inkling-small:xhigh PASS 100% 55 in → 187 out (197 reasoning)
git clean -fx
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 55 in → 233 out (219 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
thinkingmachines/inkling:high PASS 100% 55 in → 232 out (238 reasoning)
git clean -fx
thinkingmachines/inkling:low PASS 100% 55 in → 80 out (69 reasoning)
git clean -f -x
thinkingmachines/inkling:max PASS 100% 55 in → 395 out (384 reasoning)
git clean -fx
thinkingmachines/inkling:max__json_schema PASS 100% 55 in → 287 out (274 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
thinkingmachines/inkling:medium PASS 100% 55 in → 187 out (189 reasoning)
git clean -fx
thinkingmachines/inkling:xhigh PASS 100% 55 in → 249 out (238 reasoning)
git clean -fx
thinkingmachines/inkling:xhigh__json_schema PASS 100% 55 in → 357 out (340 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
x-ai/grok-4.3:high PASS 100% 225 in → 481 out (475 reasoning)
git clean -f -x
x-ai/grok-4.3:high__json_schema PASS 100% 281 in → 741 out (733 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.3:low PASS 100% 231 in → 406 out (402 reasoning)
git clean -fx
x-ai/grok-4.3:low__json_schema PASS 100% 287 in → 404 out (396 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.3:max PASS 100% 225 in → 451 out (445 reasoning)
git clean -f -x
x-ai/grok-4.3:max__json_schema PASS 100% 281 in → 982 out (974 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.3:medium PASS 100% 231 in → 689 out (630 reasoning)
git clean -fx The command uses `-f` (force, required to actually delete) and `-x` (remove both untracked files and ignored files). Omitting `-d` ensures directories are left untouched, matching the request exactly. No other flags or sub-commands are needed.
x-ai/grok-4.3:medium__json_schema PASS 100% 287 in → 843 out (831 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
x-ai/grok-4.3:xhigh PASS 100% 225 in → 426 out (422 reasoning)
git clean -xf
x-ai/grok-4.3:xhigh__json_schema PASS 100% 281 in → 1,184 out (1,176 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.5:high PASS 100% 246 in → 369 out (361 reasoning)
``` git clean -fx ```
x-ai/grok-4.5:high__json_schema PASS 100% 312 in → 482 out (473 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.5:low PASS 100% 246 in → 220 out (212 reasoning)
``` git clean -fx ```
x-ai/grok-4.5:low__json_schema PASS 100% 312 in → 355 out (346 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.5:max PASS 100% 246 in → 564 out (560 reasoning)
git clean -fx
x-ai/grok-4.5:max__json_schema PASS 100% 312 in → 553 out (544 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
x-ai/grok-4.5:medium PASS 100% 246 in → 753 out (749 reasoning)
git clean -fx
x-ai/grok-4.5:medium__json_schema PASS 100% 312 in → 697 out (688 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
x-ai/grok-4.5:xhigh PASS 100% 246 in → 312 out (308 reasoning)
git clean -fx
x-ai/grok-4.5:xhigh__json_schema PASS 100% 312 in → 590 out (581 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command":"git clean -fx"}
z-ai/glm-4.7-flash:high PASS 100% 46 in → 457 out (427 reasoning)
git clean -fx
z-ai/glm-4.7-flash:low PASS 100% 46 in → 1,902 out (1,994 reasoning)
git clean -xf
z-ai/glm-4.7-flash:medium PASS 100% 46 in → 1,868 out (1,961 reasoning)
git clean -fx
z-ai/glm-4.7-flash:none PASS 100% 46 in → 5 out (0 reasoning)
git clean -fdx
z-ai/glm-4.7-flash:none__json_schema PASS 100% 46 in → 11 out (0 reasoning)
git clean -fdx
JSON Schema Structured Output
(raw) {"command": "git clean -fdx"}
z-ai/glm-4.7-flash:xhigh PASS 100% 46 in → 965 out (978 reasoning)
git clean -fx
z-ai/glm-5.2:high PASS 100% 53 in → 389 out (383 reasoning)
git clean -fx
z-ai/glm-5.2:low PASS 100% 53 in → 724 out (718 reasoning)
git clean -xf
z-ai/glm-5.2:low__json_schema PASS 100% 55 in → 252 out (233 reasoning)
git clean -f -X -e notes.txt
JSON Schema Structured Output
(raw) { "command": "git clean -f -X -e notes.txt" }
z-ai/glm-5.2:medium PASS 100% 53 in → 342 out (336 reasoning)
git clean -fx
z-ai/glm-5.2:medium__json_schema PASS 100% 228 in → 360 out (349 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) {"command": "git clean -fx"}
z-ai/glm-5.2:none PASS 100% 47 in → 6 out (0 reasoning)
git clean -fdx
z-ai/glm-5.2:xhigh PASS 100% 53 in → 728 out (722 reasoning)
git clean -fx
z-ai/glm-5.2:xhigh__json_schema PASS 100% 46 in → 340 out (312 reasoning)
git clean -fx
JSON Schema Structured Output
(raw) { "command": "git clean -fx" }
anthropic/claude-haiku-4.5:none FAIL 75% 59 in → 11 out (0 reasoning)
``` git clean -f ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
anthropic/claude-haiku-4.5:none__json_schema FAIL 75% 221 in → 12 out (0 reasoning)
git clean -f
JSON Schema Structured Output
(raw) {"command": "git clean -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
anthropic/claude-sonnet-4.6:low__json_schema FAIL 75% 222 in → 18 out (0 reasoning)
git clean -fX notes.txt debug.log
JSON Schema Structured Output
(raw) {"command":"git clean -fX notes.txt debug.log"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-4.6:medium__json_schema FAIL 75% 222 in → 23 out (0 reasoning)
git clean -fX notes.txt && git clean -f notes.txt
JSON Schema Structured Output
(raw) {"command":"git clean -fX notes.txt && git clean -f notes.txt"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
anthropic/claude-sonnet-4.6:none__json_schema FAIL 75% 222 in → 18 out (0 reasoning)
git clean -fX notes.txt debug.log
JSON Schema Structured Output
(raw) {"command":"git clean -fX notes.txt debug.log"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-5:low FAIL 75% 76 in → 12 out (0 reasoning)
``` git clean -fX ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-5:medium__json_schema FAIL 75% 286 in → 15 out (0 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) {"command":"git clean -fX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-5:xhigh FAIL 75% 76 in → 12 out (0 reasoning)
``` git clean -fX ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
arcee-ai/trinity-mini:high__json_schema FAIL 75% 50 in → 501 out (555 reasoning)
git clean -f
JSON Schema Structured Output
(raw) { "command": "git clean -f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
deepseek/deepseek-v4-flash-0731:none FAIL 75% 47 in → 11 out (0 reasoning)
git clean -f -X notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash-0731:none__json_schema FAIL 75% 47 in → 16 out (0 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) { "command": "git clean -fX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:low__json_schema FAIL 75% 49 in → 366 out (351 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) { "command": "git clean -fX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:medium__json_schema FAIL 75% 49 in → 409 out (392 reasoning)
git clean -fX -q
JSON Schema Structured Output
(raw) { "command": "git clean -fX -q" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:none FAIL 75% 47 in → 7 out (0 reasoning)
git clean -f -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:none__json_schema FAIL 75% 47 in → 18 out (0 reasoning)
git clean -f -X notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -f -X notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-pro:none FAIL 75% 47 in → 7 out (0 reasoning)
git clean -f -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-pro:xhigh__json_schema FAIL 75% 128 in → 1,007 out (991 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) { "command": "git clean -f -X" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemini-3.1-flash-lite-preview:low FAIL 75% 49 in → 119 out (114 reasoning)
git clean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemini-3.5-flash-lite:low FAIL 75% 50 in → 6 out (0 reasoning)
`git clean -f`
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
google/gemini-3.5-flash-lite:low__json_schema FAIL 75% 50 in → 9 out (0 reasoning)
git clean -f
JSON Schema Structured Output
(raw) {"command": "git clean -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
google/gemini-3.6-flash:low__json_schema FAIL 75% 50 in → 10 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemma-4-26b-a4b-it:none FAIL 75% 62 in → 5 out (0 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
google/gemma-4-26b-a4b-it:none__json_schema FAIL 75% 62 in → 15 out (0 reasoning)
git clean -f
JSON Schema Structured Output
(raw) { "command": "git clean -f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
git clean -f -x --exclude='debug.log'
JSON Schema Structured Output
(raw) { "command": "git clean -f -x --exclude='debug.log'" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
inclusionai/ling-2.6-flash FAIL 75% 66 in → 14 out
```sh git clean -f notes.txt debug.log ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
minimax/minimax-m2.5:low__json_schema FAIL 75% 89 in → 231 out (242 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) { "command": "git clean -fX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m2.5:xhigh FAIL 75% 78 in → 869 out (975 reasoning)
git clean -f -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m3:high__json_schema FAIL 75% 203 in → 14 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) { "command": "git clean -f -X" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m3:low__json_schema FAIL 75% 203 in → 15 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) { "command": "git clean -f -X" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m3:medium__json_schema FAIL 75% 203 in → 18 out (0 reasoning)
git clean -f -X notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -f -X notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
minimax/minimax-m3:xhigh__json_schema FAIL 75% 203 in → 21 out (0 reasoning)
git clean -f -X notes.txt && git clean -f notes.txt
JSON Schema Structured Output
(raw) {"command": "git clean -f -X notes.txt && git clean -f notes.txt"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
mistralai/devstral-2512 FAIL 75% 46 in → 10 out
```bash git clean -f ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
mistralai/devstral-2512__json_schema FAIL 75% 46 in → 12 out
git clean -f -X
JSON Schema Structured Output
(raw) {"command": "git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-nano-30b-a3b:medium FAIL 75% 59 in → 752 out (798 reasoning)
git clean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-nano-30b-a3b:none__json_schema FAIL 75% 59 in → 26 out (0 reasoning)
git clean -X -f --dry-run && git clean -X -f
JSON Schema Structured Output
(raw) { "command": "git clean -X -f --dry-run && git clean -X -f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-super-120b-a12b:none FAIL 75% 59 in → 1,041 out (0 reasoning)
git clean -f -X -n -- *.txt *.log | grep -v '/' | sed 's/^Would remove //' | xargs -r rm Wait — the user said: "Output ONLY the git command, nothing else." And they want to remove untracked and ignored files (not directories), based on the status showing: - notes.txt (untracked) - debug.log (ignored) We must output ONLY the git command — no explanations, no extra text. Important: `git clean` removes untracked files. To remove ignored files too, we need `-X` (only ignored) or `-x` (ignored and untracked). Since they want both untracked AND ignored, we use `-x`. But: they said “not directories” — so we must avoid removing directories. `git clean` by default does not recurse into directories unless forced with `-d`, but we are not using `-d`, so it’s safe for files only. However, to be precise and ensure we don’t accidentally remove directories (even if `-d` is not used, it’s safe), we can rely on default behavior. But note: `git clean -x` removes ignored and untracked files. It does not remove directories unless `-d` is used. So the correct command is: `git clean -f -x` But wait: `-f` is force (required to actually remove, not just dry-run). They want to remove, so `-f`. However, the user said: “Output ONLY the git command, nothing else.” So we must output exactly: `git clean -f -x` But let’s double-check: does this remove only files? Yes, because `-d` is not included, so directories are untouched. Also, note: `-x` removes ignored files (as per `.gitignore`) AND untracked files. `-X` removes only ignored files. We want both, so `-x` is correct. The status shows: - notes.txt: untracked (`??`) - debug.log: ignored (listed under Ignored files) Both should be removed by `git clean -f -x`. We must NOT output anything else — no explanation, no markdown, no extra spaces or lines. Final answer: `git clean -f -x` But wait: is there a risk of removing files we don’t want? The user gave specific status, so we assume they want to remove exactly those. The command is correct for their intent. Alternative: some might argue to use `-e` to exclude certain patterns, but no — they want to remove all untracked and ignored files, per the status. Thus, the only git command to output is: `git clean -f -x` Let’s confirm with git docs: - `-x`: Don’t use the standard ignore rules read from `.gitignore` (as the sole mechanism), but still remove files that are ignored according to `.gitignore` and also untracked files. Actually, wait — let me recall: From `git-clean` man page: > -x > Don’t use the standard ignore rules read from .gitignore (as the sole mechanism), but still remove files that are ignored according to .gitignore and also untracked files. This is useful for removing all built files, and possibly other temporary files such as those made by vim or Emacs, but not removing any files tracked by git. Use with caution. Wait — that’s confusing. Actually, the man page says: > -x > Don’t use the standard ignore rules read from .gitignore (as the sole mechanism), but still remove files that are ignored according to .gitignore and also untracked files. That seems contradictory. Let me clarify: Actually, the correct interpretation: - Without `-x` or `-X`: `git clean` removes only untracked files (not ignored). - `-X`: Remove only files ignored by Git (i.e., those that would be ignored by `git status --ignored`). - `-x`: Remove both untracked files AND ignored files (i.e., all files not tracked by Git). Yes — that’s standard. For example, Atlassian docs: “Use `git clean -f -x` to remove both untracked and ignored files.” So `-x` is correct. And `-f` is required to actually perform the removal (not just dry-run). No `-d` — so directories are safe. Therefore, the command is: `git clean -f -x` We must output ONLY that — nothing else. So final output: git clean -f -x But note: the user said “Output ONLY the git command, nothing else.” So no quotes, no backticks, no extra text. Just: git clean -f -x Let’s make sure there’s no trailing space or newline issue — but in text output, it’s fine. We output exactly that string. git clean -f -x
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-super-120b-a12b:none__json_schema FAIL 75% 59 in → 13 out (0 reasoning)
git clean -f
JSON Schema Structured Output
(raw) { "command": "git clean -f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
openai/gpt-5.4-mini:none FAIL 75% 46 in → 9 out (0 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
openai/gpt-5.4-mini:none__json_schema FAIL 75% 81 in → 17 out (0 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) {"command":"git clean -fX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:low FAIL 75% 46 in → 23 out (0 reasoning)
git clean -fdX --dry-run && git clean -fdX -- notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:low__json_schema FAIL 75% 81 in → 26 out (0 reasoning)
git clean -fdX --dry-run && git clean -fdX
JSON Schema Structured Output
(raw) {"command":"git clean -fdX --dry-run && git clean -fdX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:medium FAIL 75% 46 in → 13 out (0 reasoning)
git clean -fdX notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:medium__json_schema FAIL 75% 81 in → 18 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:none FAIL 75% 46 in → 18 out (0 reasoning)
git clean -fdX --dry-run && git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:none__json_schema FAIL 75% 81 in → 27 out (0 reasoning)
git clean -f -X -n && git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X -n && git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4:none__json_schema FAIL 75% 81 in → 19 out (0 reasoning)
git clean -fX -f
JSON Schema Structured Output
(raw) {"command":"git clean -fX -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.5:none FAIL 75% 46 in → 15 out (0 reasoning)
git clean -fX -f notes.txt debug.log
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.6-luna:none FAIL 75% 46 in → 10 out (0 reasoning)
git clean -f -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.6-luna:none__json_schema FAIL 75% 81 in → 18 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-oss-20b:high__json_schema FAIL 75% 107 in → 11 out (0 reasoning)
git clean -fdX
JSON Schema Structured Output
(raw) {"command":"git clean -fdX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-oss-20b:low__json_schema FAIL 75% 107 in → 261 out (237 reasoning)
git clean -f -X .
JSON Schema Structured Output
(raw) { "command": "git clean -f -X ." }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
poolside/laguna-m.1:xhigh__json_schema FAIL 75% 58 in → 4,283 out (4,256 reasoning)
git clean -fdX
JSON Schema Structured Output
(raw) { "command": "git clean -fdX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
poolside/laguna-xs-2.1:none FAIL 75% 58 in → 4 out (0 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
poolside/laguna-xs-2.1:none__json_schema FAIL 75% 58 in → 63 out (0 reasoning)
git clean -f $(git clean -nd | grep -v '^Would remove' | cut -d' ' -f2- | tr '\n' ' ' | sed 's/ $//') 2>/dev/null || git clean -fd
JSON Schema Structured Output
(raw) { "command": "git clean -f $(git clean -nd | grep -v '^Would remove' | cut -d' ' -f2- | tr '\\n' ' ' | sed 's/ $//') 2>/dev/null || git clean -fd" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
poolside/laguna-xs.2:none FAIL 75% 95 in → 6 out (0 reasoning)
git clean -fd
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
poolside/laguna-xs.2:none__json_schema FAIL 75% 95 in → 12 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command": "git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.6-27b:none FAIL 75% 56 in → 6 out (0 reasoning)
git clean -Xf
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.6-27b:none__json_schema FAIL 75% 56 in → 16 out (0 reasoning)
git clean -fdX
JSON Schema Structured Output
(raw) { "command": "git clean -fdX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.6-35b-a3b:none FAIL 75% 56 in → 5 out (0 reasoning)
git clean -fd
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
qwen/qwen3.6-flash:none FAIL 75% 56 in → 5 out (0 reasoning)
git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.7-flash:none FAIL 75% 56 in → 5 out (0 reasoning)
git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.7-max:none FAIL 75% 56 in → 4 out (0 reasoning)
git clean -f
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
qwen/qwen3.7-plus:none FAIL 75% 56 in → 5 out (0 reasoning)
git clean -fdX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
tencent/hy3:none FAIL 75% 56 in → 6 out (0 reasoning)
git clean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
thinkingmachines/inkling:none FAIL 75% 53 in → 11 out (0 reasoning)
git clean -f -d -X
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
thinkingmachines/inkling:none__json_schema FAIL 75% 53 in → 14 out (0 reasoning)
git clean -fdX
JSON Schema Structured Output
(raw) { "command": "git clean -fdX" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
x-ai/grok-4.3:none FAIL 75% 223 in → 13 out (0 reasoning)
git clean -f -X -d --exclude='*/'
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
x-ai/grok-4.3:none__json_schema FAIL 75% 279 in → 10 out (0 reasoning)
git clean -f -X
JSON Schema Structured Output
(raw) {"command":"git clean -f -X"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
z-ai/glm-4.7-flash:high__json_schema FAIL 75% 46 in → 431 out (422 reasoning)
git clean -f
JSON Schema Structured Output
(raw) {"command": "git clean -f"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}]
z-ai/glm-4.7-flash:xhigh__json_schema FAIL 75% 46 in → 539 out (497 reasoning)
git clean -fX
JSON Schema Structured Output
(raw) {"command": "git clean -fX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
z-ai/glm-5.2:none__json_schema FAIL 75% 47 in → 19 out (0 reasoning)
git clean -fdX -- notes.txt debug.log
JSON Schema Structured Output
(raw) { "command": "git clean -fdX -- notes.txt debug.log" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-4.6:low FAIL 50% 59 in → 96 out (0 reasoning)
``` git clean -fX notes.txt debug.log ``` Wait, let me reconsider. `git clean -f` removes untracked files (not ignored). `git clean -fX` removes only ignored files. `git clean -fx` removes both untracked and ignored files. `-d` would include directories, so we omit it. ``` git clean -fx ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-4.6:medium FAIL 50% 59 in → 137 out (0 reasoning)
``` git clean -fX notes.txt debug.log ``` Wait, let me reconsider. The task is to remove all untracked and ignored files but not directories. ``` git clean -f -X && git clean -f ``` Hmm, let me think more carefully. - `git clean -f` removes untracked files (not directories, not ignored) - `git clean -fX` removes only ignored files (not directories) - `git clean -fx` removes both untracked and ignored files (not directories) ``` git clean -fx ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
anthropic/claude-sonnet-4.6:none FAIL 50% 59 in → 52 out (0 reasoning)
``` git clean -fX notes.txt debug.log ``` Wait, let me reconsider. The task is to remove all untracked and ignored files but not directories. ``` git clean -fx ```
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
arcee-ai/trinity-mini:low__json_schema FAIL 50% 50 in → 646 out (733 reasoning)
git clean-f
JSON Schema Structured Output
(raw) { "command": "git clean-f" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
deepseek/deepseek-v4-flash:medium FAIL 50% 47 in → 223 out (213 reasoning)
git clean-f -x
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemma-4-31b-it:none FAIL 50% 62 in → 12 out (0 reasoning)
git clean -dfx --exclude-dir=.*
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
google/gemma-4-31b-it:none__json_schema FAIL 50% 62 in → 11 out (0 reasoning)
,git clean -fX
JSON Schema Structured Output
(raw) {"command":",git clean -fX"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
git clean -f -- "(?!^$)(?!\\.git)" "(?!\\.git)" "^[^.].*" "^.*\\.[^.]*$" "^$(\\.([^G]|[^l]|[^i]|[^t]]|[^.]|[^c]|[^h])|\\.(?!git))"
JSON Schema Structured Output
(raw) {"command":"git clean -f -- \"(?!^$)(?!\\\\.git)\" \"(?!\\\\.git)\" \"^[^.].*\" \"^.*\\\\.[^.]*$\" \"^$(\\\\.([^G]|[^l]|[^i]|[^t]]|[^.]|[^c]|[^h])|\\\\.(?!git))\""}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
liquid/lfm-2-24b-a2b FAIL 50% 55 in → 10 out
git rm --ignore-unmatch notes.txt
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
mistralai/mistral-medium-3-5:none FAIL 50% 58 in → 9 out (0 reasoning)
git clean -f --exclude=*
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
mistralai/mistral-medium-3-5:none__json_schema FAIL 50% 46 in → 14 out (0 reasoning)
git clean -f --exclude-dirs
JSON Schema Structured Output
(raw) {"command": "git clean -f --exclude-dirs"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
nvidia/nemotron-3-nano-30b-a3b:low FAIL 50% 59 in → 1,129 out (1,192 reasoning)
gitclean -fX
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
openai/gpt-5.4-nano:high FAIL 50% 46 in → 22 out (0 reasoning)
git clean -fdX --dry-run && git clean -f -X -- notes.txt
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
qwen/qwen3.6-35b-a3b:none__json_schema FAIL 50% 56 in → 20 out (0 reasoning)
git clean -fd --exclude=notes.txt
JSON Schema Structured Output
(raw) { "command": "git clean -fd --exclude=notes.txt" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
tencent/hy3:none__json_schema FAIL 50% 56 in → 27 out (0 reasoning)
git clean -fX --exclude='*/' --no-dirs --force
JSON Schema Structured Output
(raw) { "command": "git clean -fX --exclude='*/' --no-dirs --force" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
z-ai/glm-5.2:high__json_schema FAIL 50% 55 in → 235 out (213 reasoning)
git clean -f -x -e notes.txt -- notes.txt
JSON Schema Structured Output
(raw) { "command": "git clean -f -x -e notes.txt -- notes.txt" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'debug.log'}, {'type': 'file_not_exists', 'path': 'notes.txt'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fx
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git rm --ignore-unmatch notes.txt
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
Failure: OpenAI-compatible response contained provider error: Provider returned error
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-c0c6ae6e-92f9-9c78-8ca1-fe9f0d7cc1c1","request_id":"c0c6ae6e-92f9-9c78-8ca1-fe9f0d7cc1c1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-34802e23-5dd1-997c-b800-0d9095df5dba","request_id":"34802e23-5dd1-997c-b800-0d9095df5dba"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-70cd2096-bcbd-93fb-a64c-6ffcc1279846","request_id":"70cd2096-bcbd-93fb-a64c-6ffcc1279846"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6c569c94-f2f6-9310-ae3a-d3dc21271a3f","request_id":"6c569c94-f2f6-9310-ae3a-d3dc21271a3f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-e248cb7b-059b-95bc-95cb-ef2d971a14d5","request_id":"e248cb7b-059b-95bc-95cb-ef2d971a14d5"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-f5697ebf-6489-9d36-8cef-75db81fb3f5e"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-594469c8-eaa2-91cd-a686-e74c78812da9"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-c67d0034-2eb7-9302-9829-dffd32e7aae5"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-7ed83fa0-2d9b-9bf0-88b0-223175cc0de1"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-1de0c0f9-965c-995c-92f4-2e931e64e357"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-1770038b-c553-9ad2-aa7f-fcce6e59801a"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-0f224992-2c3f-9114-bfb6-8870b5d13a66","request_id":"0f224992-2c3f-9114-bfb6-8870b5d13a66"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-fff288b2-74ee-9ac1-a5da-75e4ea7937ce","request_id":"fff288b2-74ee-9ac1-a5da-75e4ea7937ce"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-b5b18879-943c-92e5-ab27-2df342f7b1a8","request_id":"b5b18879-943c-92e5-ab27-2df342f7b1a8"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-dc047dbb-9a91-9da2-8205-1686dfe7c187","request_id":"dc047dbb-9a91-9da2-8205-1686dfe7c187"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-582c101c-5bba-90eb-92b9-24faa7125c34","request_id":"582c101c-5bba-90eb-92b9-24faa7125c34"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-aef855e4-1c9a-91fb-8ac4-fc331fbb9fd7","request_id":"aef855e4-1c9a-91fb-8ac4-fc331fbb9fd7"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-15fe6dd1-04e4-9f1f-acb7-c2f82e643884","request_id":"15fe6dd1-04e4-9f1f-acb7-c2f82e643884"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-4ea846d2-6e05-977a-8a22-3b6b9c461784","request_id":"4ea846d2-6e05-977a-8a22-3b6b9c461784"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-3a52e23d-d4b0-903b-987e-4bc67298b602","request_id":"3a52e23d-d4b0-903b-987e-4bc67298b602"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6df65850-d79d-9353-99a8-4a657ab9ab52","request_id":"6df65850-d79d-9353-99a8-4a657ab9ab52"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: git clean -f -d --ignored --exclude="*/*"{ "command": "git clean -f -d --ignored --exclude='*/*'" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fx
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -f -x
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fx
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)