Clean untracked files from a subdirectory only
Tests ability to clean untracked files from a subdirectory only. Evaluates path-limited cleanup scoping.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 mkdir -p frontend/dist backend/dist
  5. 05 echo 'index' > frontend/index.html
  6. 06 git add frontend backend
  7. 07 git commit -m 'Initial commit'
  8. 08 echo 'bundle' > frontend/dist/bundle.js
  9. 09 echo 'binary' > backend/dist/app
  10. 10 echo 'root' > scratch.txt
Prompt
Clean only the frontend/dist directory of untracked files. Output ONLY the git command, nothing else.
Expected
git clean -f frontend/dist/

Scoped model quality, cost, API time, and token usage for git_clean/f009.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 115 in → 17 out (0 reasoning)
``` git clean -f frontend/dist ```
anthropic/claude-fable-5:high__json_schema PASS 100% 325 in → 20 out (0 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist"}
anthropic/claude-fable-5:low PASS 100% 115 in → 18 out (0 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-fable-5:low__json_schema PASS 100% 325 in → 21 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
anthropic/claude-fable-5:max PASS 100% 115 in → 1,326 out (157 reasoning)
git clean -fd frontend/dist/
anthropic/claude-fable-5:max__json_schema PASS 100% 325 in → 259 out (90 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
anthropic/claude-fable-5:medium PASS 100% 115 in → 17 out (0 reasoning)
``` git clean -f frontend/dist ```
anthropic/claude-fable-5:medium__json_schema PASS 100% 325 in → 21 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
anthropic/claude-fable-5:xhigh PASS 100% 115 in → 50 out (25 reasoning)
git clean -fd frontend/dist
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 325 in → 100 out (42 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
anthropic/claude-haiku-4.5:high PASS 100% 114 in → 275 out (257 reasoning)
``` git clean -fd frontend/dist/ ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 277 in → 500 out (488 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
anthropic/claude-haiku-4.5:low PASS 100% 114 in → 272 out (262 reasoning)
``` git clean -fd frontend/dist/ ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 277 in → 327 out (301 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
anthropic/claude-haiku-4.5:medium PASS 100% 114 in → 1,897 out (878 reasoning)
``` git clean -fd frontend/dist/ ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 277 in → 383 out (352 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
anthropic/claude-haiku-4.5:none PASS 100% 85 in → 16 out (0 reasoning)
```bash git clean -fd frontend/dist/ ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 247 in → 16 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 114 in → 377 out (367 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 277 in → 416 out (394 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
anthropic/claude-opus-4.6:high PASS 100% 85 in → 16 out (0 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 248 in → 76 out (47 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
anthropic/claude-opus-4.6:low PASS 100% 85 in → 11 out (0 reasoning)
git clean -f frontend/dist/
anthropic/claude-opus-4.6:low__json_schema PASS 100% 248 in → 14 out (0 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist"}
anthropic/claude-opus-4.6:max PASS 100% 85 in → 103 out (76 reasoning)
``` git clean -fd frontend/dist/ ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 248 in → 89 out (67 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist"}
anthropic/claude-opus-4.6:medium PASS 100% 85 in → 15 out (0 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 248 in → 14 out (0 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist"}
anthropic/claude-opus-4.6:none PASS 100% 85 in → 15 out (0 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 248 in → 14 out (0 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist"}
anthropic/claude-opus-4.6:xhigh PASS 100% 85 in → 16 out (0 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 248 in → 83 out (56 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
anthropic/claude-opus-4.7:high PASS 100% 120 in → 19 out (0 reasoning)
`git clean -fd frontend/dist/`
anthropic/claude-opus-4.7:high__json_schema PASS 100% 330 in → 24 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.7:low PASS 100% 120 in → 16 out (0 reasoning)
git clean -f frontend/dist/
anthropic/claude-opus-4.7:low__json_schema PASS 100% 330 in → 24 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.7:max PASS 100% 120 in → 22 out (0 reasoning)
``` git clean -fd frontend/dist/ ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 330 in → 24 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.7:medium PASS 100% 120 in → 17 out (0 reasoning)
git clean -fd frontend/dist/
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 330 in → 25 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.7:none PASS 100% 120 in → 19 out (0 reasoning)
`git clean -fd frontend/dist/`
anthropic/claude-opus-4.7:none__json_schema PASS 100% 330 in → 24 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.7:xhigh PASS 100% 120 in → 18 out (0 reasoning)
`git clean -f frontend/dist/`
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 330 in → 24 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.8:high PASS 100% 115 in → 14 out (0 reasoning)
git clean -fd frontend/dist
anthropic/claude-opus-4.8:high__json_schema PASS 100% 325 in → 22 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.8:low PASS 100% 115 in → 19 out (0 reasoning)
``` git clean -fd frontend/dist/ ```
anthropic/claude-opus-4.8:low__json_schema PASS 100% 325 in → 21 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
anthropic/claude-opus-4.8:max PASS 100% 115 in → 15 out (0 reasoning)
git clean -fd frontend/dist/
anthropic/claude-opus-4.8:max__json_schema PASS 100% 325 in → 346 out (53 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
anthropic/claude-opus-4.8:medium PASS 100% 115 in → 19 out (0 reasoning)
``` git clean -fd frontend/dist/ ```
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 325 in → 22 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.8:none PASS 100% 115 in → 19 out (0 reasoning)
``` git clean -fd frontend/dist/ ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 325 in → 21 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-opus-4.8:xhigh PASS 100% 115 in → 14 out (0 reasoning)
git clean -fd frontend/dist
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 325 in → 21 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
anthropic/claude-sonnet-4.6:high PASS 100% 85 in → 114 out (86 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 248 in → 15 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-sonnet-4.6:low PASS 100% 85 in → 15 out (0 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 248 in → 15 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-sonnet-4.6:max PASS 100% 85 in → 163 out (136 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 248 in → 116 out (88 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
anthropic/claude-sonnet-4.6:medium PASS 100% 85 in → 49 out (22 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 248 in → 15 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
anthropic/claude-sonnet-4.6:none PASS 100% 85 in → 15 out (0 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 248 in → 15 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 85 in → 117 out (87 reasoning)
``` git clean -f frontend/dist/ ```
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 248 in → 15 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
anthropic/claude-sonnet-5:high PASS 100% 115 in → 18 out (0 reasoning)
``` git clean -fd frontend/dist ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 325 in → 21 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
anthropic/claude-sonnet-5:low PASS 100% 115 in → 14 out (0 reasoning)
git clean -fd frontend/dist
anthropic/claude-sonnet-5:low__json_schema PASS 100% 325 in → 22 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
anthropic/claude-sonnet-5:medium PASS 100% 115 in → 14 out (0 reasoning)
git clean -fd frontend/dist
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 325 in → 21 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
anthropic/claude-sonnet-5:none PASS 100% 115 in → 18 out (0 reasoning)
``` git clean -fd frontend/dist ```
anthropic/claude-sonnet-5:none__json_schema PASS 100% 325 in → 20 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
anthropic/claude-sonnet-5:xhigh PASS 100% 115 in → 18 out (0 reasoning)
``` git clean -fd frontend/dist ```
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 325 in → 20 out (0 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist"}
arcee-ai/trinity-large-thinking:high PASS 100% 65 in → 708 out (707 reasoning)
git clean -fd frontend/dist
arcee-ai/trinity-large-thinking:low PASS 100% 65 in → 1,009 out (1,014 reasoning)
git clean -fd frontend/dist/
arcee-ai/trinity-large-thinking:medium PASS 100% 65 in → 650 out (646 reasoning)
git clean -fd frontend/dist/
arcee-ai/trinity-large-thinking:xhigh PASS 100% 65 in → 2,300 out (2,309 reasoning)
git clean -f frontend/dist
arcee-ai/trinity-mini:high PASS 100% 65 in → 569 out (643 reasoning)
git clean -f frontend/dist
arcee-ai/trinity-mini:high__json_schema PASS 100% 65 in → 566 out (664 reasoning)
git clean -f frontend/dist/bundle.js
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/bundle.js" }
arcee-ai/trinity-mini:low__json_schema PASS 100% 65 in → 601 out (681 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) { "command":"git clean -f frontend/dist" }
arcee-ai/trinity-mini:medium PASS 100% 65 in → 1,141 out (1,254 reasoning)
git clean -f frontend/dist
arcee-ai/trinity-mini:medium__json_schema PASS 100% 65 in → 761 out (906 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) { "command":"git clean -f frontend/dist" }
arcee-ai/trinity-mini:xhigh PASS 100% 65 in → 400 out (469 reasoning)
git clean -f frontend/dist
arcee-ai/trinity-mini:xhigh__json_schema PASS 100% 65 in → 649 out (719 reasoning)
git clean -d -f frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -d -f frontend/dist" }
deepseek/deepseek-v4-flash-0731:high PASS 100% 146 in → 4,689 out (4,680 reasoning)
git clean -f frontend/dist/
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 146 in → 2,493 out (2,562 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
deepseek/deepseek-v4-flash-0731:low PASS 100% 67 in → 492 out (483 reasoning)
git clean -fd frontend/dist/
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 67 in → 484 out (488 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
deepseek/deepseek-v4-flash-0731:max PASS 100% 146 in → 9,734 out (9,837 reasoning)
git clean -f frontend/dist/
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 146 in → 2,903 out (2,948 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd -- frontend/dist" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 67 in → 1,328 out (1,319 reasoning)
git clean -fd frontend/dist/
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 67 in → 786 out (820 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
deepseek/deepseek-v4-flash-0731:none PASS 100% 67 in → 8 out (0 reasoning)
git clean -f frontend/dist/
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 67 in → 15 out (0 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist" }
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 146 in → 10,301 out (10,293 reasoning)
git clean -fd frontend/dist
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 146 in → 2,680 out (2,674 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
deepseek/deepseek-v4-flash:high PASS 100% 67 in → 749 out (739 reasoning)
git clean -f frontend/dist/
deepseek/deepseek-v4-flash:high__json_schema PASS 100% 69 in → 333 out (316 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
deepseek/deepseek-v4-flash:low PASS 100% 67 in → 1,303 out (1,293 reasoning)
git clean -fd frontend/dist/
deepseek/deepseek-v4-flash:low__json_schema PASS 100% 67 in → 200 out (185 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
deepseek/deepseek-v4-flash:medium PASS 100% 67 in → 178 out (188 reasoning)
git clean -fd frontend/dist/
deepseek/deepseek-v4-flash:medium__json_schema PASS 100% 67 in → 158 out (142 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
deepseek/deepseek-v4-flash:none PASS 100% 67 in → 9 out (0 reasoning)
git clean -f frontend/dist/
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 131 in → 14 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
deepseek/deepseek-v4-flash:xhigh PASS 100% 146 in → 640 out (630 reasoning)
git clean -f frontend/dist/
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 159 in → 14 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
deepseek/deepseek-v4-pro:high PASS 100% 67 in → 369 out (383 reasoning)
git clean -fd frontend/dist/
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 254 in → 451 out (436 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
deepseek/deepseek-v4-pro:low PASS 100% 67 in → 348 out (338 reasoning)
git clean -fd frontend/dist/
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 254 in → 434 out (421 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
deepseek/deepseek-v4-pro:medium PASS 100% 67 in → 626 out (617 reasoning)
git clean -fd frontend/dist/
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 69 in → 290 out (275 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
deepseek/deepseek-v4-pro:none PASS 100% 67 in → 9 out (0 reasoning)
git clean -f frontend/dist/
deepseek/deepseek-v4-pro:xhigh PASS 100% 146 in → 1,861 out (1,851 reasoning)
git clean -f -- frontend/dist/
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 332 in → 552 out (537 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemini-3-flash-preview:high PASS 100% 73 in → 227 out (219 reasoning)
git clean -fd frontend/dist/
google/gemini-3-flash-preview:high__json_schema PASS 100% 130 in → 302 out (289 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemini-3-flash-preview:low PASS 100% 73 in → 159 out (151 reasoning)
git clean -f frontend/dist/
google/gemini-3-flash-preview:low__json_schema PASS 100% 74 in → 279 out (266 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemini-3-flash-preview:medium PASS 100% 73 in → 287 out (279 reasoning)
git clean -f frontend/dist/
google/gemini-3-flash-preview:medium__json_schema PASS 100% 74 in → 394 out (381 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemini-3-flash-preview:xhigh PASS 100% 73 in → 207 out (199 reasoning)
git clean -fd frontend/dist/
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 74 in → 724 out (712 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 74 in → 299 out (292 reasoning)
git clean -fd frontend/dist
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 130 in → 1,409 out (1,392 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
google/gemini-3.1-flash-lite-preview:low PASS 100% 74 in → 127 out (119 reasoning)
git clean -fd frontend/dist/
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 74 in → 138 out (125 reasoning)
git clean -f -d frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -f -d frontend/dist"}
google/gemini-3.1-flash-lite-preview:medium PASS 100% 74 in → 238 out (230 reasoning)
git clean -fd frontend/dist/
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 74 in → 220 out (207 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 74 in → 431 out (424 reasoning)
git clean -fd frontend/dist
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 130 in → 235 out (223 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
google/gemini-3.1-pro-preview:high PASS 100% 73 in → 544 out (536 reasoning)
git clean -fd frontend/dist/
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 130 in → 398 out (384 reasoning)
git clean -f -d frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f -d frontend/dist/"}
google/gemini-3.1-pro-preview:low PASS 100% 73 in → 378 out (370 reasoning)
git clean -fd frontend/dist/
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 130 in → 132 out (120 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
google/gemini-3.1-pro-preview:medium PASS 100% 73 in → 325 out (317 reasoning)
git clean -fd frontend/dist/
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 130 in → 239 out (227 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 73 in → 414 out (406 reasoning)
git clean -fd frontend/dist/
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 130 in → 399 out (386 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemini-3.5-flash-lite:high PASS 100% 73 in → 328 out (321 reasoning)
git clean -fd frontend/dist
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 74 in → 301 out (289 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
google/gemini-3.5-flash-lite:low PASS 100% 73 in → 7 out (0 reasoning)
git clean -fd frontend/dist
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 74 in → 17 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
google/gemini-3.5-flash-lite:max PASS 100% 74 in → 260 out (253 reasoning)
git clean -fd frontend/dist
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 130 in → 471 out (459 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
google/gemini-3.5-flash-lite:medium PASS 100% 73 in → 215 out (208 reasoning)
git clean -fd frontend/dist
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 74 in → 261 out (249 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 73 in → 366 out (359 reasoning)
git clean -fd frontend/dist
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 130 in → 393 out (381 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
google/gemini-3.5-flash:high PASS 100% 73 in → 757 out (749 reasoning)
git clean -fd frontend/dist/
google/gemini-3.5-flash:high__json_schema PASS 100% 130 in → 596 out (584 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist"}
google/gemini-3.5-flash:low PASS 100% 73 in → 371 out (363 reasoning)
git clean -fd frontend/dist/
google/gemini-3.5-flash:low__json_schema PASS 100% 130 in → 157 out (140 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
google/gemini-3.5-flash:medium PASS 100% 73 in → 448 out (440 reasoning)
git clean -fd frontend/dist/
google/gemini-3.5-flash:medium__json_schema PASS 100% 130 in → 532 out (519 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemini-3.5-flash:xhigh PASS 100% 73 in → 682 out (674 reasoning)
git clean -fd frontend/dist/
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 130 in → 476 out (464 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
google/gemini-3.6-flash:high PASS 100% 74 in → 455 out (447 reasoning)
git clean -f frontend/dist/
google/gemini-3.6-flash:high__json_schema PASS 100% 74 in → 439 out (427 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
google/gemini-3.6-flash:low PASS 100% 74 in → 133 out (125 reasoning)
git clean -f frontend/dist/
google/gemini-3.6-flash:low__json_schema PASS 100% 130 in → 12 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
google/gemini-3.6-flash:max PASS 100% 74 in → 1,258 out (1,250 reasoning)
git clean -fd frontend/dist/
google/gemini-3.6-flash:max__json_schema PASS 100% 74 in → 305 out (293 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
google/gemini-3.6-flash:medium PASS 100% 74 in → 505 out (497 reasoning)
git clean -fd frontend/dist/
google/gemini-3.6-flash:medium__json_schema PASS 100% 130 in → 274 out (262 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
google/gemini-3.6-flash:xhigh PASS 100% 74 in → 885 out (877 reasoning)
git clean -fd frontend/dist/
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 74 in → 495 out (483 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist/"}
google/gemma-4-26b-a4b-it:high PASS 100% 88 in → 331 out (280 reasoning)
git clean -fd frontend/dist/
google/gemma-4-26b-a4b-it:low PASS 100% 89 in → 614 out (527 reasoning)
git clean -f frontend/dist/
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 88 in → 580 out (513 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
google/gemma-4-26b-a4b-it:medium PASS 100% 88 in → 643 out (577 reasoning)
git clean -fd frontend/dist/
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 88 in → 376 out (332 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemma-4-26b-a4b-it:none PASS 100% 86 in → 9 out (0 reasoning)
git clean -fd frontend/dist/
google/gemma-4-26b-a4b-it:none__json_schema PASS 100% 86 in → 14 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemma-4-26b-a4b-it:xhigh PASS 100% 89 in → 603 out (518 reasoning)
git clean -fd frontend/dist/
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 88 in → 338 out (289 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
google/gemma-4-31b-it:high PASS 100% 89 in → 231 out (186 reasoning)
git clean -fd frontend/dist/
google/gemma-4-31b-it:high__json_schema PASS 100% 88 in → 317 out (276 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
google/gemma-4-31b-it:low PASS 100% 89 in → 243 out (209 reasoning)
git clean -fd frontend/dist/
google/gemma-4-31b-it:low__json_schema PASS 100% 89 in → 260 out (224 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
google/gemma-4-31b-it:medium PASS 100% 92 in → 257 out (248 reasoning)
git clean -fd frontend/dist/
google/gemma-4-31b-it:medium__json_schema PASS 100% 88 in → 244 out (218 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
google/gemma-4-31b-it:none PASS 100% 86 in → 9 out (0 reasoning)
git clean -fd frontend/dist/
google/gemma-4-31b-it:none__json_schema PASS 100% 86 in → 14 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
google/gemma-4-31b-it:xhigh PASS 100% 88 in → 219 out (186 reasoning)
git clean -fd frontend/dist
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 88 in → 224 out (181 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
ibm-granite/granite-4.1-8b PASS 100% 82 in → 8 out
git clean -fd frontend/dist/
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
inclusionai/ling-2.6-flash PASS 100% 85 in → 12 out
```sh git clean -f frontend/dist ```
liquid/lfm-2-24b-a2b PASS 100% 80 in → 12 out
git clean -d -f frontend/dist/
minimax/minimax-m2.5:high PASS 100% 95 in → 103 out (92 reasoning)
git clean -fd -- frontend/dist/
minimax/minimax-m2.5:high__json_schema PASS 100% 95 in → 106 out (90 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
minimax/minimax-m2.5:low PASS 100% 95 in → 173 out (204 reasoning)
git clean -fd frontend/dist/
minimax/minimax-m2.5:low__json_schema PASS 100% 95 in → 106 out (92 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
minimax/minimax-m2.5:medium PASS 100% 95 in → 484 out (564 reasoning)
git clean -fd frontend/dist/
minimax/minimax-m2.5:medium__json_schema PASS 100% 95 in → 238 out (269 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
minimax/minimax-m2.5:xhigh PASS 100% 113 in → 242 out (233 reasoning)
git clean -fd frontend/dist/
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 95 in → 116 out (99 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
minimax/minimax-m2.7:high PASS 100% 95 in → 635 out (721 reasoning)
git clean -f frontend/dist/
minimax/minimax-m2.7:low PASS 100% 95 in → 288 out (322 reasoning)
git clean -fd frontend/dist/
minimax/minimax-m2.7:low__json_schema PASS 100% 227 in → 791 out (775 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist" }
minimax/minimax-m2.7:medium PASS 100% 95 in → 1,759 out (2,106 reasoning)
git clean -fd frontend/dist
minimax/minimax-m2.7:medium__json_schema PASS 100% 227 in → 280 out (264 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
minimax/minimax-m2.7:xhigh PASS 100% 95 in → 524 out (587 reasoning)
git clean -fd frontend/dist/
minimax/minimax-m2.7:xhigh__json_schema PASS 100% 227 in → 503 out (486 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd -- frontend/dist" }
minimax/minimax-m3:high PASS 100% 233 in → 118 out (128 reasoning)
`git clean -f frontend/dist/`
minimax/minimax-m3:high__json_schema PASS 100% 220 in → 14 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
minimax/minimax-m3:low PASS 100% 233 in → 209 out (244 reasoning)
git clean -fd frontend/dist
minimax/minimax-m3:low__json_schema PASS 100% 220 in → 14 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
minimax/minimax-m3:medium PASS 100% 233 in → 132 out (140 reasoning)
git clean -f frontend/dist/
minimax/minimax-m3:medium__json_schema PASS 100% 220 in → 14 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
minimax/minimax-m3:xhigh PASS 100% 233 in → 806 out (963 reasoning)
git clean -fd frontend/dist/
minimax/minimax-m3:xhigh__json_schema PASS 100% 220 in → 14 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
mistralai/devstral-2512 PASS 100% 63 in → 12 out
```bash git clean -fd frontend/dist/ ```
mistralai/devstral-2512__json_schema PASS 100% 63 in → 13 out
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
mistralai/mistral-medium-3-5:high PASS 100% 75 in → 1,405 out (1,595 reasoning)
git clean -fd frontend/dist
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 63 in → 1,196 out (1,355 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd -- frontend/dist"}
mistralai/mistral-medium-3-5:low PASS 100% 75 in → 511 out (563 reasoning)
git clean -fd frontend/dist/
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 63 in → 359 out (399 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd -- frontend/dist/"}
mistralai/mistral-medium-3-5:medium PASS 100% 75 in → 4,741 out (5,425 reasoning)
git clean -fd frontend/dist/
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 63 in → 701 out (786 reasoning)
git clean -df frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -df frontend/dist"}
mistralai/mistral-medium-3-5:none PASS 100% 75 in → 9 out (0 reasoning)
git clean -f -- frontend/dist/
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 63 in → 16 out (0 reasoning)
git clean -f -d -- frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f -d -- frontend/dist/"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 75 in → 396 out (444 reasoning)
git clean -fd frontend/dist/
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 63 in → 830 out (933 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd -- frontend/dist"}
moonshotai/kimi-k2.6:high PASS 100% 66 in → 1,112 out (1,104 reasoning)
git clean -fd frontend/dist
moonshotai/kimi-k2.6:high__json_schema PASS 100% 65 in → 2,921 out (2,824 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
moonshotai/kimi-k2.6:low PASS 100% 66 in → 4,292 out (4,284 reasoning)
git clean -fd frontend/dist
moonshotai/kimi-k2.6:low__json_schema PASS 100% 65 in → 2,784 out (3,100 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
moonshotai/kimi-k2.6:medium PASS 100% 65 in → 1,730 out (1,722 reasoning)
git clean -fd frontend/dist
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 65 in → 7,050 out (7,652 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
moonshotai/kimi-k2.6:xhigh PASS 100% 66 in → 2,573 out (2,564 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k2.6:xhigh__json_schema PASS 100% 66 in → 957 out (942 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
moonshotai/kimi-k2.7-code:high PASS 100% 66 in → 247 out (240 reasoning)
git clean -fd frontend/dist
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 66 in → 113 out (114 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
moonshotai/kimi-k2.7-code:low PASS 100% 66 in → 978 out (969 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 66 in → 189 out (187 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
moonshotai/kimi-k2.7-code:medium PASS 100% 66 in → 769 out (760 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 66 in → 486 out (471 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
moonshotai/kimi-k2.7-code:xhigh PASS 100% 66 in → 176 out (167 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 66 in → 156 out (141 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
moonshotai/kimi-k3:high PASS 100% 143 in → 252 out (230 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k3:high__json_schema PASS 100% 143 in → 925 out (903 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k3:low PASS 100% 143 in → 882 out (860 reasoning)
git clean -f frontend/dist/
moonshotai/kimi-k3:low__json_schema PASS 100% 143 in → 776 out (754 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k3:max PASS 100% 143 in → 248 out (226 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k3:max__json_schema PASS 100% 143 in → 169 out (145 reasoning)
``` git clean -fd frontend/dist ```
moonshotai/kimi-k3:medium PASS 100% 143 in → 573 out (547 reasoning)
```bash git clean -fd frontend/dist/ ```
moonshotai/kimi-k3:medium__json_schema PASS 100% 143 in → 189 out (165 reasoning)
``` git clean -fd frontend/dist/ ```
moonshotai/kimi-k3:xhigh PASS 100% 143 in → 158 out (136 reasoning)
git clean -fd frontend/dist/
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 143 in → 261 out (239 reasoning)
git clean -fd frontend/dist/
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 76 in → 296 out (316 reasoning)
git clean -f frontend/dist/*
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 76 in → 299 out (302 reasoning)
git clean -f -- frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -f -- frontend/dist" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 76 in → 287 out (315 reasoning)
git clean -f -- frontend/dist
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 76 in → 444 out (508 reasoning)
git clean -fd frontend/dist/
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 76 in → 289 out (298 reasoning)
git clean -fdx frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fdx frontend/dist" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 76 in → 211 out (224 reasoning)
git clean -fd -- frontend/dist
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 76 in → 466 out (506 reasoning)
git clean -f -- frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -f -- frontend/dist" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 76 in → 118 out (122 reasoning)
git clean -f frontend/dist/
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 76 in → 154 out (137 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 76 in → 1,476 out (1,436 reasoning)
git clean -f frontend/dist/
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 76 in → 124 out (104 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 76 in → 475 out (445 reasoning)
git clean -f frontend/dist
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 76 in → 212 out (189 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 76 in → 8 out (0 reasoning)
git clean -fd frontend/dist/
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 76 in → 15 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 76 in → 139 out (124 reasoning)
git clean -f frontend/dist/
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 76 in → 164 out (140 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
openai/gpt-5.4-mini:high PASS 100% 62 in → 192 out (178 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-mini:high__json_schema PASS 100% 97 in → 492 out (470 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.4-mini:low PASS 100% 62 in → 87 out (73 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-mini:low__json_schema PASS 100% 97 in → 96 out (74 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.4-mini:medium PASS 100% 62 in → 165 out (151 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-mini:medium__json_schema PASS 100% 97 in → 294 out (272 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.4-mini:none PASS 100% 62 in → 18 out (0 reasoning)
git clean -f -d -e backend/ -e scratch.txt
openai/gpt-5.4-mini:none__json_schema PASS 100% 97 in → 25 out (0 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.4-mini:xhigh PASS 100% 62 in → 439 out (425 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 97 in → 1,574 out (1,552 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.4-nano:high PASS 100% 62 in → 54 out (40 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-nano:high__json_schema PASS 100% 97 in → 19 out (0 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.4-nano:low PASS 100% 62 in → 12 out (0 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-nano:low__json_schema PASS 100% 97 in → 19 out (0 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.4-nano:medium PASS 100% 62 in → 67 out (53 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-nano:medium__json_schema PASS 100% 97 in → 19 out (0 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.4-nano:none PASS 100% 62 in → 12 out (0 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-nano:none__json_schema PASS 100% 97 in → 28 out (0 reasoning)
git clean -fdn -- frontend/dist && git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fdn -- frontend/dist && git clean -fd -- frontend/dist"}
openai/gpt-5.4-nano:xhigh PASS 100% 62 in → 213 out (199 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 97 in → 470 out (448 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.4:high PASS 100% 62 in → 226 out (212 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4:high__json_schema PASS 100% 97 in → 207 out (186 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.4:low PASS 100% 62 in → 78 out (65 reasoning)
git clean -fd -- frontend/dist
openai/gpt-5.4:low__json_schema PASS 100% 97 in → 108 out (87 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.4:medium PASS 100% 62 in → 124 out (110 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4:medium__json_schema PASS 100% 97 in → 129 out (108 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.4:none PASS 100% 62 in → 12 out (0 reasoning)
git clean -f -- frontend/dist/
openai/gpt-5.4:none__json_schema PASS 100% 97 in → 20 out (0 reasoning)
git clean -f -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f -- frontend/dist/"}
openai/gpt-5.4:xhigh PASS 100% 62 in → 1,679 out (1,665 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.4:xhigh__json_schema PASS 100% 97 in → 353 out (331 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.5:high PASS 100% 62 in → 111 out (97 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.5:high__json_schema PASS 100% 97 in → 177 out (155 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.5:low PASS 100% 62 in → 53 out (39 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.5:low__json_schema PASS 100% 97 in → 62 out (40 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.5:medium PASS 100% 62 in → 129 out (115 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.5:medium__json_schema PASS 100% 97 in → 94 out (72 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.5:none PASS 100% 62 in → 11 out (0 reasoning)
git clean -fd -- frontend/dist
openai/gpt-5.5:none__json_schema PASS 100% 97 in → 20 out (0 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.5:xhigh PASS 100% 62 in → 472 out (458 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.5:xhigh__json_schema PASS 100% 97 in → 296 out (274 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-luna:high PASS 100% 62 in → 178 out (164 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-luna:high__json_schema PASS 100% 97 in → 81 out (60 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.6-luna:low PASS 100% 62 in → 90 out (76 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-luna:low__json_schema PASS 100% 97 in → 85 out (64 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.6-luna:max PASS 100% 62 in → 144 out (131 reasoning)
git clean -fd -- frontend/dist
openai/gpt-5.6-luna:max__json_schema PASS 100% 97 in → 526 out (505 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.6-luna:medium PASS 100% 62 in → 92 out (78 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-luna:medium__json_schema PASS 100% 97 in → 80 out (59 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.6-luna:none PASS 100% 62 in → 12 out (0 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-luna:none__json_schema PASS 100% 97 in → 19 out (0 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.6-luna:xhigh PASS 100% 62 in → 193 out (179 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 97 in → 242 out (221 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
openai/gpt-5.6-sol:high PASS 100% 62 in → 64 out (50 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-sol:high__json_schema PASS 100% 97 in → 20 out (0 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-sol:low PASS 100% 62 in → 12 out (0 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-sol:low__json_schema PASS 100% 97 in → 20 out (0 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-sol:max PASS 100% 62 in → 89 out (75 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-sol:max__json_schema PASS 100% 97 in → 252 out (230 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-sol:medium PASS 100% 62 in → 12 out (0 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-sol:medium__json_schema PASS 100% 97 in → 20 out (0 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-sol:none PASS 100% 62 in → 12 out (0 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-sol:none__json_schema PASS 100% 97 in → 20 out (0 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-sol:xhigh PASS 100% 62 in → 108 out (94 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 97 in → 205 out (183 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-terra:high PASS 100% 62 in → 85 out (71 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-terra:high__json_schema PASS 100% 97 in → 154 out (132 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-terra:low PASS 100% 62 in → 60 out (46 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-terra:low__json_schema PASS 100% 97 in → 20 out (0 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-terra:max PASS 100% 62 in → 392 out (378 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-terra:max__json_schema PASS 100% 97 in → 172 out (150 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-terra:medium PASS 100% 62 in → 56 out (43 reasoning)
git clean -fd -- frontend/dist
openai/gpt-5.6-terra:medium__json_schema PASS 100% 97 in → 86 out (64 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-terra:none PASS 100% 62 in → 11 out (0 reasoning)
git clean -f frontend/dist/
openai/gpt-5.6-terra:none__json_schema PASS 100% 97 in → 20 out (0 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-5.6-terra:xhigh PASS 100% 62 in → 198 out (184 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 97 in → 151 out (129 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist/"}
openai/gpt-oss-120b:high PASS 100% 121 in → 2,001 out (2,244 reasoning)
git clean -fd -- 'frontend/dist/*'
openai/gpt-oss-120b:high__json_schema PASS 100% 123 in → 14 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
openai/gpt-oss-120b:low PASS 100% 123 in → 69 out (59 reasoning)
git clean -fd -- frontend/dist/
openai/gpt-oss-120b:medium PASS 100% 123 in → 118 out (121 reasoning)
git clean -fd frontend/dist/
openai/gpt-oss-120b:medium__json_schema PASS 100% 123 in → 15 out (0 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd -- frontend/dist" }
openai/gpt-oss-20b:high PASS 100% 123 in → 262 out (256 reasoning)
git clean -f frontend/dist
openai/gpt-oss-20b:high__json_schema PASS 100% 125 in → 800 out (939 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
openai/gpt-oss-20b:low PASS 100% 110 in → 85 out (73 reasoning)
git clean -fd frontend/dist
openai/gpt-oss-20b:low__json_schema PASS 100% 110 in → 98 out (70 reasoning)
git clean -f -d frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -f -d frontend/dist/"}
openai/gpt-oss-20b:medium PASS 100% 110 in → 377 out (417 reasoning)
git clean -fd frontend/dist/
openai/gpt-oss-20b:medium__json_schema PASS 100% 121 in → 193 out (186 reasoning)
git clean -f -d frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -f -d frontend/dist" }
openai/gpt-oss-20b:xhigh PASS 100% 123 in → 257 out (251 reasoning)
git clean -f frontend/dist
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 110 in → 5,496 out (6,339 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
poolside/laguna-m.1:high PASS 100% 76 in → 289 out (280 reasoning)
git clean -fd frontend/dist
poolside/laguna-m.1:high__json_schema PASS 100% 76 in → 434 out (416 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
poolside/laguna-m.1:low PASS 100% 76 in → 339 out (330 reasoning)
git clean -fd frontend/dist
poolside/laguna-m.1:low__json_schema PASS 100% 76 in → 782 out (764 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
poolside/laguna-m.1:medium PASS 100% 76 in → 749 out (739 reasoning)
git clean -fd frontend/dist/
poolside/laguna-m.1:medium__json_schema PASS 100% 76 in → 1,187 out (1,173 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
poolside/laguna-m.1:none PASS 100% 76 in → 9 out (0 reasoning)
git clean -fd frontend/dist/
poolside/laguna-m.1:none__json_schema PASS 100% 76 in → 13 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
poolside/laguna-m.1:xhigh PASS 100% 76 in → 385 out (375 reasoning)
git clean -fd frontend/dist/
poolside/laguna-m.1:xhigh__json_schema PASS 100% 76 in → 853 out (840 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
poolside/laguna-xs-2.1:high PASS 100% 76 in → 157 out (150 reasoning)
git clean -f frontend/dist
poolside/laguna-xs-2.1:high__json_schema PASS 100% 76 in → 432 out (419 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
poolside/laguna-xs-2.1:low PASS 100% 76 in → 293 out (286 reasoning)
git clean -fd frontend/dist
poolside/laguna-xs-2.1:low__json_schema PASS 100% 76 in → 329 out (311 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
poolside/laguna-xs-2.1:medium PASS 100% 76 in → 325 out (318 reasoning)
git clean -fd frontend/dist
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 76 in → 228 out (214 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
poolside/laguna-xs-2.1:none PASS 100% 76 in → 6 out (0 reasoning)
git clean -fd frontend/dist
poolside/laguna-xs-2.1:none__json_schema PASS 100% 76 in → 17 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
poolside/laguna-xs-2.1:xhigh PASS 100% 76 in → 220 out (212 reasoning)
git clean -f frontend/dist/
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 76 in → 473 out (459 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
poolside/laguna-xs.2:high PASS 100% 113 in → 190 out (180 reasoning)
git clean -f frontend/dist/
poolside/laguna-xs.2:high__json_schema PASS 100% 113 in → 137 out (123 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
poolside/laguna-xs.2:low PASS 100% 113 in → 120 out (110 reasoning)
git clean -f frontend/dist/
poolside/laguna-xs.2:low__json_schema PASS 100% 113 in → 145 out (131 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
poolside/laguna-xs.2:medium PASS 100% 113 in → 152 out (143 reasoning)
git clean -fd frontend/dist
poolside/laguna-xs.2:medium__json_schema PASS 100% 113 in → 181 out (163 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
poolside/laguna-xs.2:none PASS 100% 113 in → 8 out (0 reasoning)
git clean -f frontend/dist
poolside/laguna-xs.2:none__json_schema PASS 100% 113 in → 12 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
poolside/laguna-xs.2:xhigh PASS 100% 113 in → 166 out (156 reasoning)
git clean -f frontend/dist/
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 113 in → 121 out (107 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist/"}
qwen/qwen3.6-27b:high PASS 100% 73 in → 1,344 out (1,318 reasoning)
git clean -fd frontend/dist
qwen/qwen3.6-27b:high__json_schema PASS 100% 75 in → 18 out (0 reasoning)
git clean -f frontend/dist/**
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/**" }
qwen/qwen3.6-27b:low PASS 100% 73 in → 1,531 out (1,519 reasoning)
git clean -f frontend/dist/
qwen/qwen3.6-27b:low__json_schema PASS 100% 75 in → 14 out (0 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
qwen/qwen3.6-27b:medium PASS 100% 73 in → 496 out (508 reasoning)
git clean -f frontend/dist/
qwen/qwen3.6-27b:medium__json_schema PASS 100% 73 in → 1,121 out (1 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
qwen/qwen3.6-27b:none PASS 100% 75 in → 8 out (0 reasoning)
git clean -f frontend/dist/
qwen/qwen3.6-27b:none__json_schema PASS 100% 75 in → 14 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
qwen/qwen3.6-27b:xhigh PASS 100% 73 in → 2,417 out (2,339 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 73 in → 1,664 out (1,599 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
qwen/qwen3.6-35b-a3b:high PASS 100% 73 in → 1,020 out (997 reasoning)
git clean -df frontend/dist
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 73 in → 884 out (856 reasoning)
git clean -df frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -df frontend/dist/" }
qwen/qwen3.6-35b-a3b:low PASS 100% 73 in → 1,404 out (1,402 reasoning)
git clean -fd frontend/dist
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 73 in → 1,071 out (1,064 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 73 in → 1,204 out (1,192 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 73 in → 1,854 out (1,760 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
qwen/qwen3.6-35b-a3b:none PASS 100% 75 in → 8 out (0 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.6-35b-a3b:none__json_schema PASS 100% 75 in → 17 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 73 in → 1,875 out (1,848 reasoning)
git clean -fd -- frontend/dist
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 73 in → 1,281 out (1,253 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
qwen/qwen3.6-flash:high PASS 100% 73 in → 868 out (856 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.6-flash:low PASS 100% 73 in → 1,378 out (1,366 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.6-flash:medium PASS 100% 73 in → 1,331 out (1,320 reasoning)
git clean -fd frontend/dist
qwen/qwen3.6-flash:none PASS 100% 75 in → 6 out (0 reasoning)
git clean -fd frontend/dist
qwen/qwen3.6-flash:xhigh PASS 100% 73 in → 2,181 out (2,169 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.7-flash:high PASS 100% 73 in → 949 out (937 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.7-flash:low PASS 100% 73 in → 897 out (886 reasoning)
git clean -fd frontend/dist
qwen/qwen3.7-flash:max PASS 100% 73 in → 1,026 out (1,015 reasoning)
git clean -fd frontend/dist
qwen/qwen3.7-flash:medium PASS 100% 73 in → 531 out (519 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.7-flash:none PASS 100% 75 in → 6 out (0 reasoning)
git clean -fd frontend/dist
qwen/qwen3.7-flash:xhigh PASS 100% 73 in → 1,528 out (1,515 reasoning)
git clean -fd -- frontend/dist/
qwen/qwen3.7-max:high PASS 100% 73 in → 1,261 out (1,249 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.7-max:low PASS 100% 73 in → 276 out (265 reasoning)
git clean -fd frontend/dist
qwen/qwen3.7-max:medium PASS 100% 73 in → 868 out (857 reasoning)
git clean -f frontend/dist
qwen/qwen3.7-max:none PASS 100% 75 in → 7 out (0 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.7-max:xhigh PASS 100% 73 in → 1,129 out (1,118 reasoning)
git clean -fd frontend/dist
qwen/qwen3.7-plus:high PASS 100% 73 in → 1,250 out (1,238 reasoning)
git clean -f frontend/dist/
qwen/qwen3.7-plus:low PASS 100% 73 in → 1,001 out (990 reasoning)
git clean -fd frontend/dist
qwen/qwen3.7-plus:medium PASS 100% 73 in → 1,176 out (1,164 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.7-plus:none PASS 100% 75 in → 7 out (0 reasoning)
git clean -fd frontend/dist/
qwen/qwen3.7-plus:xhigh PASS 100% 73 in → 1,236 out (1,224 reasoning)
git clean -fd frontend/dist/
tencent/hy3:high PASS 100% 71 in → 963 out (955 reasoning)
git clean -fd frontend/dist
tencent/hy3:high__json_schema PASS 100% 71 in → 1,233 out (1,263 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
tencent/hy3:low PASS 100% 71 in → 848 out (840 reasoning)
git clean -fd frontend/dist
tencent/hy3:low__json_schema PASS 100% 71 in → 834 out (915 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
tencent/hy3:medium PASS 100% 71 in → 609 out (601 reasoning)
git clean -fd frontend/dist
tencent/hy3:medium__json_schema PASS 100% 71 in → 1,213 out (1,313 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
tencent/hy3:none PASS 100% 74 in → 7 out (0 reasoning)
git clean -f frontend/dist
tencent/hy3:none__json_schema PASS 100% 74 in → 17 out (0 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist" }
tencent/hy3:xhigh PASS 100% 71 in → 1,874 out (1,866 reasoning)
git clean -fd frontend/dist
tencent/hy3:xhigh__json_schema PASS 100% 71 in → 1,763 out (1,799 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
thinkingmachines/inkling-small:high PASS 100% 71 in → 179 out (196 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling-small:high__json_schema PASS 100% 71 in → 330 out (313 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
thinkingmachines/inkling-small:low PASS 100% 71 in → 126 out (114 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling-small:low__json_schema PASS 100% 71 in → 80 out (62 reasoning)
git clean -fd -- frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd -- frontend/dist/"}
thinkingmachines/inkling-small:max PASS 100% 71 in → 375 out (363 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling-small:max__json_schema PASS 100% 71 in → 439 out (419 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd -- frontend/dist" }
thinkingmachines/inkling-small:medium PASS 100% 71 in → 358 out (401 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling-small:medium__json_schema PASS 100% 71 in → 115 out (96 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
thinkingmachines/inkling-small:none PASS 100% 69 in → 9 out (0 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling-small:xhigh PASS 100% 71 in → 509 out (585 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 71 in → 163 out (145 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
thinkingmachines/inkling:high PASS 100% 71 in → 150 out (137 reasoning)
git clean -fd frontend/dist/
thinkingmachines/inkling:high__json_schema PASS 100% 71 in → 214 out (196 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
thinkingmachines/inkling:low PASS 100% 71 in → 32 out (20 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling:low__json_schema PASS 100% 71 in → 29 out (11 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
thinkingmachines/inkling:max PASS 100% 71 in → 278 out (266 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling:medium PASS 100% 71 in → 100 out (106 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling:medium__json_schema PASS 100% 71 in → 80 out (61 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
thinkingmachines/inkling:none PASS 100% 69 in → 9 out (0 reasoning)
git clean -fd frontend/dist
thinkingmachines/inkling:xhigh PASS 100% 71 in → 85 out (84 reasoning)
git clean -fd frontend/dist/
thinkingmachines/inkling:xhigh__json_schema PASS 100% 71 in → 380 out (362 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
x-ai/grok-4.3:high PASS 100% 240 in → 316 out (305 reasoning)
```bash git clean -fd frontend/dist ```
x-ai/grok-4.3:high__json_schema PASS 100% 296 in → 1,119 out (1,109 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist"}
x-ai/grok-4.3:low PASS 100% 246 in → 317 out (310 reasoning)
git clean -fd frontend/dist/
x-ai/grok-4.3:low__json_schema PASS 100% 302 in → 380 out (369 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist/"}
x-ai/grok-4.3:max PASS 100% 240 in → 558 out (552 reasoning)
git clean -fd frontend/dist
x-ai/grok-4.3:max__json_schema PASS 100% 296 in → 1,403 out (1,393 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
x-ai/grok-4.3:medium PASS 100% 246 in → 1,208 out (1,154 reasoning)
git clean -f frontend/dist The command targets only the specified path, forcing removal of untracked files (e.g. frontend/dist/bundle.js) while leaving every other untracked item untouched. No -d flag is required because the request mentions files, not directories.
x-ai/grok-4.3:medium__json_schema PASS 100% 302 in → 871 out (861 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
x-ai/grok-4.3:none PASS 100% 238 in → 7 out (0 reasoning)
git clean -f frontend/dist/
x-ai/grok-4.3:none__json_schema PASS 100% 294 in → 10 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
x-ai/grok-4.3:xhigh PASS 100% 240 in → 170 out (161 reasoning)
``` git clean -fd frontend/dist ```
x-ai/grok-4.3:xhigh__json_schema PASS 100% 296 in → 1,534 out (1,524 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
x-ai/grok-4.5:high PASS 100% 267 in → 838 out (829 reasoning)
git clean -fd -- frontend/dist/
x-ai/grok-4.5:high__json_schema PASS 100% 333 in → 848 out (836 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
x-ai/grok-4.5:low PASS 100% 267 in → 271 out (258 reasoning)
```git git clean -fd -- frontend/dist ```
x-ai/grok-4.5:low__json_schema PASS 100% 333 in → 340 out (327 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
x-ai/grok-4.5:max PASS 100% 267 in → 532 out (520 reasoning)
``` git clean -fd -- frontend/dist ```
x-ai/grok-4.5:max__json_schema PASS 100% 333 in → 770 out (757 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist/"}
x-ai/grok-4.5:medium PASS 100% 267 in → 632 out (625 reasoning)
git clean -fd frontend/dist
x-ai/grok-4.5:medium__json_schema PASS 100% 333 in → 998 out (986 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd frontend/dist"}
x-ai/grok-4.5:xhigh PASS 100% 267 in → 406 out (399 reasoning)
git clean -fd frontend/dist
x-ai/grok-4.5:xhigh__json_schema PASS 100% 333 in → 1,015 out (1,002 reasoning)
git clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -fd -- frontend/dist"}
z-ai/glm-4.7-flash:high PASS 100% 62 in → 575 out (612 reasoning)
git clean -fd frontend/dist
z-ai/glm-4.7-flash:low PASS 100% 62 in → 505 out (509 reasoning)
git clean -fd frontend/dist
z-ai/glm-4.7-flash:low__json_schema PASS 100% 62 in → 632 out (640 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -f frontend/dist"}
z-ai/glm-4.7-flash:medium PASS 100% 62 in → 488 out (486 reasoning)
git clean -fd frontend/dist/
z-ai/glm-4.7-flash:none PASS 100% 62 in → 7 out (0 reasoning)
git clean -fd frontend/dist
z-ai/glm-4.7-flash:none__json_schema PASS 100% 62 in → 12 out (0 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
z-ai/glm-4.7-flash:xhigh PASS 100% 62 in → 400 out (403 reasoning)
git clean -fd frontend/dist/
z-ai/glm-4.7-flash:xhigh__json_schema PASS 100% 62 in → 570 out (579 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
z-ai/glm-5.2:high PASS 100% 69 in → 349 out (340 reasoning)
git clean -f frontend/dist/
z-ai/glm-5.2:high__json_schema PASS 100% 69 in → 452 out (434 reasoning)
git clean -fd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/" }
z-ai/glm-5.2:low PASS 100% 69 in → 374 out (365 reasoning)
git clean -fd frontend/dist/
z-ai/glm-5.2:low__json_schema PASS 100% 244 in → 136 out (124 reasoning)
git clean -f frontend/dist
JSON Schema Structured Output
(raw) {"command":"git clean -f frontend/dist"}
z-ai/glm-5.2:medium PASS 100% 69 in → 505 out (498 reasoning)
git clean -f frontend/dist
z-ai/glm-5.2:medium__json_schema PASS 100% 69 in → 796 out (768 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist" }
z-ai/glm-5.2:none PASS 100% 63 in → 8 out (0 reasoning)
git clean -f frontend/dist/
z-ai/glm-5.2:none__json_schema PASS 100% 63 in → 14 out (0 reasoning)
git clean -f frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -f frontend/dist/" }
z-ai/glm-5.2:xhigh PASS 100% 69 in → 796 out (768 reasoning)
git clean -fd frontend/dist/
z-ai/glm-5.2:xhigh__json_schema PASS 100% 62 in → 644 out (614 reasoning)
git clean -fd frontend/dist
JSON Schema Structured Output
(raw) {"command": "git clean -fd frontend/dist"}
arcee-ai/trinity-mini:low FAIL 75% 65 in → 957 out (1,083 reasoning)
gitclean -f frontend/dist
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
deepseek/deepseek-v4-pro:none__json_schema FAIL 75% 67 in → 19 out (0 reasoning)
git clean -fd frontend/dist/ --dry-run
JSON Schema Structured Output
(raw) { "command": "git clean -fd frontend/dist/ --dry-run" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
git clean -ffrontend/dist/
JSON Schema Structured Output
(raw) {"command":"git clean -ffrontend/dist/"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
nvidia/nemotron-3-nano-30b-a3b:low__json_schema FAIL 75% 76 in → 164 out (180 reasoning)
git clean -Xf frontend/dist
JSON Schema Structured Output
(raw) { "command": "git clean -Xf frontend/dist" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
nvidia/nemotron-3-nano-30b-a3b:none FAIL 75% 76 in → 8 out (0 reasoning)
git clean -fdn frontend/dist
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
nvidia/nemotron-3-nano-30b-a3b:none__json_schema FAIL 75% 76 in → 16 out (0 reasoning)
git clean -Xd frontend/dist/
JSON Schema Structured Output
(raw) { "command": "git clean -Xd frontend/dist/" }
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
openai/gpt-oss-120b:low__json_schema FAIL 75% 123 in → 5 out (0 reasoning)
analysis
JSON Schema Structured Output
(raw) {"command":"analysis"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
openai/gpt-oss-120b:xhigh FAIL 75% 123 in → 611 out (594 reasoning)
git clean-fd -- frontend/dist
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
openai/gpt-oss-120b:xhigh__json_schema FAIL 75% 123 in → 506 out (592 reasoning)
finalgit clean -fd -- frontend/dist
JSON Schema Structured Output
(raw) {"command": "finalgit clean -fd -- frontend/dist"}
Failure: Failed assertions: [{'type': 'file_not_exists', 'path': 'frontend/dist/bundle.js'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -d -f frontend/dist/
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-02daa259-8b02-9fce-a406-164361af4071","request_id":"02daa259-8b02-9fce-a406-164361af4071"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-13beaec2-c66b-9cb2-89a2-3d95069e1efa","request_id":"13beaec2-c66b-9cb2-89a2-3d95069e1efa"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a4c9bc7c-9cb5-9e92-9f17-2bb2118a8e3d","request_id":"a4c9bc7c-9cb5-9e92-9f17-2bb2118a8e3d"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-ca3e03b6-88b4-9fb3-a7e7-fc46bfb63160","request_id":"ca3e03b6-88b4-9fb3-a7e7-fc46bfb63160"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f5bb2ec7-e381-9677-8671-de49a04d0264","request_id":"f5bb2ec7-e381-9677-8671-de49a04d0264"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-1d00ade0-1920-9b22-a0ef-385c04890274"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-d949b00f-9302-99ad-8b59-9862d9f056fe"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-2258b508-2b85-9b23-943b-8cb1a1d057e2"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-28ec0f13-8045-9964-aa57-d16f1bf23cad"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-a6a04057-0150-989d-8bf2-8fff80831a22"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-db3d05ab-481f-9fcc-9f0b-4868f0344b6e"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-20600760-3d7c-9aaa-ac49-77487907ec45","request_id":"20600760-3d7c-9aaa-ac49-77487907ec45"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-5d058e5a-659a-9375-a73a-52ddf737c33e","request_id":"5d058e5a-659a-9375-a73a-52ddf737c33e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-e927b096-ca76-98ca-a03d-36f67351cb05","request_id":"e927b096-ca76-98ca-a03d-36f67351cb05"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-b6e86602-daab-9559-a793-587ec2234054","request_id":"b6e86602-daab-9559-a793-587ec2234054"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-03f74307-fc73-9e62-a343-f40a37216847","request_id":"03f74307-fc73-9e62-a343-f40a37216847"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-0bc2c4d0-aa85-9fb1-955f-477c42045b36","request_id":"0bc2c4d0-aa85-9fb1-955f-477c42045b36"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d3e73f3a-fd6a-9745-a853-68e62c6f0edb","request_id":"d3e73f3a-fd6a-9745-a853-68e62c6f0edb"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-309ac964-4a0b-9044-9d0a-f71c8ae7ec44","request_id":"309ac964-4a0b-9044-9d0a-f71c8ae7ec44"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-71db33fc-bdc3-9cdc-a09f-c4367ca757b2","request_id":"71db33fc-bdc3-9cdc-a09f-c4367ca757b2"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-2eb1f521-6a55-937a-a11b-b5ece5bee8fa","request_id":"2eb1f521-6a55-937a-a11b-b5ece5bee8fa"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: git clean -f -d frontend/dist{ "command": "git clean -f -d frontend/dist" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fd frontend/dist
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git clean -fd frontend/dist/{ "command": "git clean -f -d frontend/dist/" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)