List tags sorted by version
Tests ability to list tags sorted by version order. Evaluates version-sorted tag enumeration.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo 'v1' > app.txt
  5. 05 git add app.txt
  6. 06 git commit -m 'v1'
  7. 07 git tag v1.0
  8. 08 echo 'v2' > app.txt
  9. 09 git add app.txt
  10. 10 git commit -m 'v2'
  11. 11 git tag v10.0
  12. 12 echo 'v3' > app.txt
  13. 13 git add app.txt
  14. 14 git commit -m 'v3'
  15. 15 git tag v2.0
  16. 16 echo 'v4' > app.txt
  17. 17 git add app.txt
  18. 18 git commit -m 'v4'
  19. 19 git tag v1.10
Prompt
List all tags sorted by version number in ascending order. Output ONLY the git command, nothing else.
Expected
git tag -l --sort=version:refname

Scoped model quality, cost, API time, and token usage for tag_management/f012.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 100 in → 30 out (21 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-fable-5:high__json_schema PASS 100% 309 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
anthropic/claude-fable-5:low PASS 100% 102 in → 17 out (0 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-fable-5:low__json_schema PASS 100% 311 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
anthropic/claude-fable-5:max PASS 100% 99 in → 225 out (70 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-fable-5:max__json_schema PASS 100% 310 in → 205 out (63 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
anthropic/claude-fable-5:medium PASS 100% 96 in → 30 out (21 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-fable-5:medium__json_schema PASS 100% 311 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
anthropic/claude-fable-5:xhigh PASS 100% 102 in → 47 out (33 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 310 in → 50 out (38 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
anthropic/claude-haiku-4.5:high PASS 100% 115 in → 272 out (210 reasoning)
``` git tag -l --sort=version:refname ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 275 in → 177 out (144 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=version:refname"}
anthropic/claude-haiku-4.5:low PASS 100% 116 in → 262 out (219 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 279 in → 411 out (332 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=version:refname"}
anthropic/claude-haiku-4.5:medium PASS 100% 115 in → 317 out (282 reasoning)
``` git tag -l --sort=version:refname ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 278 in → 389 out (353 reasoning)
git tag --sort=version:asc
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:asc"}
anthropic/claude-haiku-4.5:none PASS 100% 86 in → 19 out (0 reasoning)
```bash git tag -l --sort=version:refname ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 247 in → 16 out (0 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) {"command": "git tag -l | sort -V"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 112 in → 448 out (363 reasoning)
``` git tag -l --sort=version:refname ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 277 in → 685 out (500 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=version:refname"}
anthropic/claude-opus-4.6:high PASS 100% 85 in → 78 out (43 reasoning)
``` git tag --sort=v:refname ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 247 in → 78 out (43 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
anthropic/claude-opus-4.6:low PASS 100% 86 in → 16 out (0 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 248 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-opus-4.6:max PASS 100% 89 in → 173 out (121 reasoning)
``` git tag --sort=v:refname ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 246 in → 71 out (42 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
anthropic/claude-opus-4.6:medium PASS 100% 87 in → 17 out (0 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 248 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-opus-4.6:none PASS 100% 86 in → 16 out (0 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 245 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-opus-4.6:xhigh PASS 100% 85 in → 17 out (0 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 246 in → 77 out (44 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-opus-4.7:high PASS 100% 104 in → 19 out (0 reasoning)
`git tag -l --sort=v:refname`
anthropic/claude-opus-4.7:high__json_schema PASS 100% 314 in → 24 out (0 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=v:refname"}
anthropic/claude-opus-4.7:low PASS 100% 107 in → 17 out (0 reasoning)
git tag -l --sort=v:refname
anthropic/claude-opus-4.7:low__json_schema PASS 100% 313 in → 24 out (0 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=v:refname"}
anthropic/claude-opus-4.7:max PASS 100% 107 in → 198 out (80 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 319 in → 24 out (0 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=v:refname"}
anthropic/claude-opus-4.7:medium PASS 100% 106 in → 17 out (0 reasoning)
git tag -l --sort=v:refname
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 313 in → 24 out (0 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=v:refname"}
anthropic/claude-opus-4.7:none PASS 100% 106 in → 22 out (0 reasoning)
``` git tag -l --sort=v:refname ```
anthropic/claude-opus-4.7:none__json_schema PASS 100% 314 in → 24 out (0 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=v:refname"}
anthropic/claude-opus-4.7:xhigh PASS 100% 104 in → 17 out (0 reasoning)
git tag -l --sort=v:refname
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 314 in → 24 out (0 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=v:refname"}
anthropic/claude-opus-4.8:high PASS 100% 96 in → 17 out (0 reasoning)
``` git tag --sort=v:refname ```
anthropic/claude-opus-4.8:high__json_schema PASS 100% 310 in → 22 out (0 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=version:refname"}
anthropic/claude-opus-4.8:low PASS 100% 101 in → 15 out (0 reasoning)
git tag -l --sort=v:refname
anthropic/claude-opus-4.8:low__json_schema PASS 100% 310 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
anthropic/claude-opus-4.8:max PASS 100% 97 in → 282 out (74 reasoning)
`git tag --sort=version:refname`
anthropic/claude-opus-4.8:max__json_schema PASS 100% 309 in → 22 out (0 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=v:refname"}
anthropic/claude-opus-4.8:medium PASS 100% 97 in → 19 out (0 reasoning)
``` git tag -l --sort=v:refname ```
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 308 in → 20 out (0 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
anthropic/claude-opus-4.8:none PASS 100% 99 in → 15 out (0 reasoning)
git tag -l --sort=v:refname
anthropic/claude-opus-4.8:none__json_schema PASS 100% 309 in → 19 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-opus-4.8:xhigh PASS 100% 100 in → 15 out (0 reasoning)
git tag -l --sort=version:refname
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 313 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-4.6:high PASS 100% 84 in → 167 out (120 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 251 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-4.6:low PASS 100% 86 in → 16 out (0 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 247 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-4.6:max PASS 100% 85 in → 214 out (157 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 247 in → 111 out (87 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-4.6:medium PASS 100% 86 in → 49 out (23 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 247 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-4.6:none PASS 100% 88 in → 15 out (0 reasoning)
``` git tag -l | sort -V ```
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 251 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 87 in → 99 out (68 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 249 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-5:high PASS 100% 95 in → 17 out (0 reasoning)
``` git tag --sort=version:refname ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 307 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-5:low PASS 100% 100 in → 15 out (0 reasoning)
git tag -l --sort=version:refname
anthropic/claude-sonnet-5:low__json_schema PASS 100% 310 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
anthropic/claude-sonnet-5:medium PASS 100% 97 in → 13 out (0 reasoning)
git tag --sort=version:refname
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 311 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
anthropic/claude-sonnet-5:none PASS 100% 100 in → 15 out (0 reasoning)
git tag -l --sort=version:refname
anthropic/claude-sonnet-5:none__json_schema PASS 100% 310 in → 19 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
anthropic/claude-sonnet-5:xhigh PASS 100% 98 in → 62 out (25 reasoning)
git tag --sort=version:refname
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 309 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
arcee-ai/trinity-large-thinking:high PASS 100% 84 in → 2,241 out (2,240 reasoning)
git tag --sort version:refname
arcee-ai/trinity-large-thinking:low PASS 100% 83 in → 2,946 out (2,946 reasoning)
git tag | sort -V
arcee-ai/trinity-large-thinking:medium PASS 100% 82 in → 1,365 out (1,351 reasoning)
git tag --list --sort=version:refname
arcee-ai/trinity-large-thinking:xhigh PASS 100% 80 in → 1,298 out (1,291 reasoning)
git tag --sort='version:refname'
arcee-ai/trinity-mini:high PASS 100% 82 in → 622 out (583 reasoning)
git tag --sort=version:refname
arcee-ai/trinity-mini:high__json_schema PASS 100% 84 in → 469 out (418 reasoning)
git tag --sort version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort version:refname" }
arcee-ai/trinity-mini:low PASS 100% 82 in → 397 out (367 reasoning)
git tag --sort=version:refname
arcee-ai/trinity-mini:low__json_schema PASS 100% 80 in → 464 out (379 reasoning)
git tag | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag | sort -V" }
arcee-ai/trinity-mini:medium PASS 100% 83 in → 436 out (430 reasoning)
git tag --sort=v:refname
arcee-ai/trinity-mini:medium__json_schema PASS 100% 83 in → 460 out (392 reasoning)
git tag--sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag--sort=v:refname" }
arcee-ai/trinity-mini:xhigh PASS 100% 86 in → 552 out (525 reasoning)
git tag --sort=v
arcee-ai/trinity-mini:xhigh__json_schema PASS 100% 83 in → 573 out (507 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command":"git tag --sort=v:refname" }
deepseek/deepseek-v4-flash-0731:high PASS 100% 75 in → 125 out (122 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 218 in → 268 out (211 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
deepseek/deepseek-v4-flash-0731:low PASS 100% 77 in → 471 out (414 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 80 in → 333 out (240 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
deepseek/deepseek-v4-flash-0731:max PASS 100% 157 in → 1,754 out (1,495 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 155 in → 241 out (182 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 77 in → 319 out (308 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash-0731:none PASS 100% 77 in → 10 out (0 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 78 in → 14 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 160 in → 705 out (695 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 77 in → 732 out (497 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
deepseek/deepseek-v4-flash:high PASS 100% 76 in → 564 out (554 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash:low PASS 100% 77 in → 351 out (340 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash:low__json_schema PASS 100% 77 in → 213 out (157 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
deepseek/deepseek-v4-flash:medium PASS 100% 75 in → 280 out (269 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash:none PASS 100% 79 in → 9 out (0 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 81 in → 16 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
deepseek/deepseek-v4-flash:xhigh PASS 100% 154 in → 619 out (606 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 157 in → 508 out (417 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
deepseek/deepseek-v4-pro:high PASS 100% 78 in → 408 out (397 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 268 in → 359 out (343 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
deepseek/deepseek-v4-pro:low PASS 100% 76 in → 211 out (207 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 78 in → 374 out (314 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
deepseek/deepseek-v4-pro:medium PASS 100% 77 in → 817 out (807 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 265 in → 214 out (198 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
deepseek/deepseek-v4-pro:none PASS 100% 76 in → 9 out (0 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 78 in → 13 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 156 in → 944 out (933 reasoning)
git tag --sort=version:refname
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 78 in → 17 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
google/gemini-3-flash-preview:high PASS 100% 86 in → 379 out (370 reasoning)
git tag --sort=v:refname
google/gemini-3-flash-preview:high__json_schema PASS 100% 85 in → 180 out (164 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=v:refname"}
google/gemini-3-flash-preview:low PASS 100% 85 in → 314 out (305 reasoning)
git tag --sort=v:refname
google/gemini-3-flash-preview:low__json_schema PASS 100% 143 in → 333 out (319 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
google/gemini-3-flash-preview:medium PASS 100% 85 in → 665 out (656 reasoning)
git tag --sort=v:refname
google/gemini-3-flash-preview:medium__json_schema PASS 100% 144 in → 355 out (342 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
google/gemini-3-flash-preview:xhigh PASS 100% 86 in → 353 out (344 reasoning)
git tag --sort=version:refname
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 139 in → 989 out (975 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 83 in → 596 out (587 reasoning)
git tag --sort=v:refname
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 140 in → 532 out (518 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
google/gemini-3.1-flash-lite-preview:low PASS 100% 85 in → 156 out (145 reasoning)
git tag -l --sort=v:refname
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 86 in → 147 out (133 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
google/gemini-3.1-flash-lite-preview:medium PASS 100% 81 in → 230 out (221 reasoning)
git tag --sort=v:refname
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 87 in → 130 out (116 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 83 in → 669 out (660 reasoning)
git tag --sort=v:refname
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 88 in → 531 out (517 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
google/gemini-3.1-pro-preview:high PASS 100% 86 in → 1,180 out (1,171 reasoning)
git tag --sort=version:refname
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 139 in → 468 out (454 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
google/gemini-3.1-pro-preview:low PASS 100% 86 in → 342 out (333 reasoning)
git tag --sort=v:refname
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 143 in → 291 out (277 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=version:refname"}
google/gemini-3.1-pro-preview:medium PASS 100% 86 in → 556 out (547 reasoning)
git tag --sort=version:refname
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 143 in → 126 out (112 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 86 in → 647 out (638 reasoning)
git tag --sort=version:refname
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 140 in → 552 out (539 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
google/gemini-3.5-flash-lite:high PASS 100% 87 in → 360 out (351 reasoning)
git tag --sort=version:refname
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 87 in → 308 out (294 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
google/gemini-3.5-flash-lite:low PASS 100% 83 in → 9 out (0 reasoning)
git tag --sort=version:refname
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 140 in → 14 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
google/gemini-3.5-flash-lite:max PASS 100% 89 in → 336 out (327 reasoning)
git tag --sort=version:refname
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 143 in → 282 out (268 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
google/gemini-3.5-flash-lite:medium PASS 100% 86 in → 111 out (102 reasoning)
git tag --sort=version:refname
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 84 in → 155 out (142 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 86 in → 460 out (451 reasoning)
git tag --sort=version:refname
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 86 in → 240 out (227 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
google/gemini-3.5-flash:high PASS 100% 83 in → 762 out (753 reasoning)
git tag --sort=v:refname
google/gemini-3.5-flash:high__json_schema PASS 100% 142 in → 707 out (694 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
google/gemini-3.5-flash:low PASS 100% 86 in → 514 out (505 reasoning)
git tag --sort=v:refname
google/gemini-3.5-flash:low__json_schema PASS 100% 142 in → 111 out (92 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
google/gemini-3.5-flash:medium PASS 100% 87 in → 624 out (615 reasoning)
git tag --sort=v:refname
google/gemini-3.5-flash:medium__json_schema PASS 100% 142 in → 451 out (437 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
google/gemini-3.5-flash:xhigh PASS 100% 86 in → 917 out (908 reasoning)
git tag --sort=v:refname
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 144 in → 461 out (447 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
google/gemini-3.6-flash:high PASS 100% 86 in → 520 out (511 reasoning)
git tag --sort=v:refname
google/gemini-3.6-flash:high__json_schema PASS 100% 144 in → 340 out (325 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=version:refname"}
google/gemini-3.6-flash:low PASS 100% 86 in → 164 out (153 reasoning)
git tag -l --sort=v:refname
google/gemini-3.6-flash:low__json_schema PASS 100% 140 in → 15 out (0 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=version:refname"}
google/gemini-3.6-flash:max PASS 100% 86 in → 529 out (520 reasoning)
git tag --sort=version:refname
google/gemini-3.6-flash:max__json_schema PASS 100% 87 in → 384 out (369 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=v:refname"}
google/gemini-3.6-flash:medium PASS 100% 82 in → 874 out (865 reasoning)
git tag --sort=v:refname
google/gemini-3.6-flash:medium__json_schema PASS 100% 86 in → 380 out (365 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l --sort=version:refname"}
google/gemini-3.6-flash:xhigh PASS 100% 85 in → 472 out (463 reasoning)
git tag --sort=v:refname
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 85 in → 268 out (255 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
google/gemma-4-26b-a4b-it:high PASS 100% 99 in → 606 out (596 reasoning)
git tag --sort=v:refname
google/gemma-4-26b-a4b-it:high__json_schema PASS 100% 102 in → 1,028 out (775 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
google/gemma-4-26b-a4b-it:low PASS 100% 101 in → 935 out (644 reasoning)
git tag --sort=v:refname
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 100 in → 1,280 out (927 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
google/gemma-4-26b-a4b-it:medium PASS 100% 102 in → 2,028 out (2,018 reasoning)
git tag --sort=v:refname
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 103 in → 1,417 out (1,056 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
google/gemma-4-26b-a4b-it:none PASS 100% 97 in → 12 out (0 reasoning)
git tag -l --sort=v:refname
google/gemma-4-26b-a4b-it:none__json_schema PASS 100% 97 in → 17 out (0 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=v:refname"}
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 102 in → 2,124 out (1,689 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
google/gemma-4-31b-it:high PASS 100% 101 in → 603 out (369 reasoning)
git tag --sort=v:refname
google/gemma-4-31b-it:high__json_schema PASS 100% 98 in → 296 out (1 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
google/gemma-4-31b-it:low PASS 100% 102 in → 562 out (438 reasoning)
git tag | sort -V
google/gemma-4-31b-it:low__json_schema PASS 100% 99 in → 285 out (211 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
google/gemma-4-31b-it:medium PASS 100% 100 in → 448 out (330 reasoning)
git tag --sort=v:refname
google/gemma-4-31b-it:medium__json_schema PASS 100% 101 in → 431 out (321 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
google/gemma-4-31b-it:none PASS 100% 99 in → 9 out (0 reasoning)
git tag -l | sort -V
google/gemma-4-31b-it:none__json_schema PASS 100% 99 in → 19 out (0 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
google/gemma-4-31b-it:xhigh PASS 100% 101 in → 320 out (259 reasoning)
git tag --version-sort
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 102 in → 319 out (231 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
ibm-granite/granite-4.1-8b PASS 100% 86 in → 9 out
git tag --sort=v:refname
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
inclusionai/ling-2.6-flash PASS 100% 108 in → 14 out
```sh git tag -l | sort -V ```
inclusionai/ling-2.6-flash__json_schema PASS 100% 105 in → 19 out
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
liquid/lfm-2-24b-a2b PASS 100% 83 in → 9 out
git tag -l | sort -V
minimax/minimax-m2.5:high PASS 100% 112 in → 498 out (485 reasoning)
git tag -l --sort=version:refname
minimax/minimax-m2.5:high__json_schema PASS 100% 110 in → 429 out (412 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
minimax/minimax-m2.5:low PASS 100% 112 in → 507 out (486 reasoning)
git tag --sort=version:refname
minimax/minimax-m2.5:low__json_schema PASS 100% 113 in → 642 out (628 reasoning)
git tag --list --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --list --sort=version:refname" }
minimax/minimax-m2.5:medium PASS 100% 117 in → 604 out (593 reasoning)
git tag --sort=version:refname
minimax/minimax-m2.5:medium__json_schema PASS 100% 111 in → 1,202 out (1,061 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag -l --sort=version:refname" }
minimax/minimax-m2.5:xhigh PASS 100% 110 in → 1,216 out (1,203 reasoning)
git tag --list --sort=version:refname
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 119 in → 751 out (733 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
minimax/minimax-m2.7:high PASS 100% 113 in → 450 out (437 reasoning)
git tag --list --sort=version:refname
minimax/minimax-m2.7:high__json_schema PASS 100% 246 in → 939 out (922 reasoning)
git tag --list --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --list --sort=version:refname"}
minimax/minimax-m2.7:low PASS 100% 114 in → 560 out (549 reasoning)
git tag --list --sort=version:refname
minimax/minimax-m2.7:low__json_schema PASS 100% 114 in → 722 out (751 reasoning)
git tag --list --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --list --sort=version:refname"}
minimax/minimax-m2.7:medium PASS 100% 113 in → 416 out (398 reasoning)
git tag --list 'v*' --sort=version:refname
minimax/minimax-m2.7:medium__json_schema PASS 100% 239 in → 710 out (696 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) {"command":"git tag -l | sort -V"}
minimax/minimax-m2.7:xhigh PASS 100% 113 in → 704 out (694 reasoning)
git tag --sort=version:refname
minimax/minimax-m3:high PASS 100% 253 in → 153 out (135 reasoning)
git tag --sort=version:refname
minimax/minimax-m3:high__json_schema PASS 100% 236 in → 15 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
minimax/minimax-m3:low PASS 100% 248 in → 300 out (221 reasoning)
git tag --sort=version:refname
minimax/minimax-m3:low__json_schema PASS 100% 236 in → 15 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
minimax/minimax-m3:medium PASS 100% 245 in → 127 out (109 reasoning)
git tag -l --sort=version:refname
minimax/minimax-m3:medium__json_schema PASS 100% 238 in → 12 out (0 reasoning)
git tag | sort -V
JSON Schema Structured Output
(raw) {"command": "git tag | sort -V"}
minimax/minimax-m3:xhigh PASS 100% 247 in → 306 out (244 reasoning)
git tag --sort=version:refname
minimax/minimax-m3:xhigh__json_schema PASS 100% 234 in → 15 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
mistralai/devstral-2512 PASS 100% 84 in → 17 out
```bash git tag -l --sort=version:refname ```
mistralai/devstral-2512__json_schema PASS 100% 85 in → 14 out
git tag -l | sort -V
JSON Schema Structured Output
(raw) {"command": "git tag -l | sort -V"}
mistralai/mistral-medium-3-5:high PASS 100% 100 in → 2,200 out (1,724 reasoning)
git tag -l --sort=v:refname
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 85 in → 1,055 out (957 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=version:refname"}
mistralai/mistral-medium-3-5:low PASS 100% 99 in → 885 out (835 reasoning)
git tag -l --sort=version:refname
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 88 in → 581 out (516 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
mistralai/mistral-medium-3-5:medium PASS 100% 99 in → 1,000 out (827 reasoning)
git tag --sort=version:refname
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 86 in → 979 out (763 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
mistralai/mistral-medium-3-5:none PASS 100% 99 in → 10 out (0 reasoning)
git tag --sort=-version:refname
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 86 in → 27 out (0 reasoning)
git tag -l | sort -t. -k1,1n -k2,2n
JSON Schema Structured Output
(raw) {"command": "git tag -l | sort -t. -k1,1n -k2,2n"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 98 in → 847 out (756 reasoning)
git tag --sort=version:refname
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 87 in → 1,188 out (1,024 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=version:refname"}
moonshotai/kimi-k2.6:high PASS 100% 79 in → 950 out (939 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k2.6:high__json_schema PASS 100% 81 in → 446 out (426 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
moonshotai/kimi-k2.6:low PASS 100% 82 in → 1,274 out (1,264 reasoning)
git tag --sort=v:refname
moonshotai/kimi-k2.6:low__json_schema PASS 100% 83 in → 872 out (736 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
moonshotai/kimi-k2.6:medium PASS 100% 79 in → 1,855 out (1,847 reasoning)
git tag --sort=v:refname
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 82 in → 18 out (0 reasoning)
git tag --sort='version:refname'
JSON Schema Structured Output
(raw) { "command": "git tag --sort='version:refname'" }
moonshotai/kimi-k2.6:xhigh PASS 100% 82 in → 1,957 out (1,711 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k2.7-code:high PASS 100% 80 in → 595 out (585 reasoning)
git tag --sort=v:refname
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 78 in → 531 out (456 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
moonshotai/kimi-k2.7-code:low PASS 100% 83 in → 745 out (734 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 81 in → 285 out (269 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
moonshotai/kimi-k2.7-code:medium PASS 100% 76 in → 321 out (311 reasoning)
git tag --sort=v:refname
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 167 in → 393 out (377 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
moonshotai/kimi-k2.7-code:xhigh PASS 100% 81 in → 513 out (502 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 82 in → 1,146 out (1,127 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
moonshotai/kimi-k3:high PASS 100% 158 in → 473 out (449 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k3:high__json_schema PASS 100% 157 in → 311 out (287 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k3:low PASS 100% 157 in → 299 out (275 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k3:low__json_schema PASS 100% 158 in → 296 out (272 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k3:max PASS 100% 154 in → 253 out (229 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k3:max__json_schema PASS 100% 159 in → 302 out (276 reasoning)
git tag -l --sort=version:refname
moonshotai/kimi-k3:medium PASS 100% 159 in → 371 out (347 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k3:medium__json_schema PASS 100% 156 in → 199 out (175 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k3:xhigh PASS 100% 160 in → 226 out (202 reasoning)
git tag --sort=version:refname
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 159 in → 286 out (259 reasoning)
``` git tag --sort=version:refname ```
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 98 in → 767 out (649 reasoning)
git tag --list --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --list --sort=v:refname" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 96 in → 1,333 out (1,141 reasoning)
git tag --sort=version
nvidia/nemotron-3-nano-30b-a3b:low__json_schema PASS 100% 100 in → 682 out (653 reasoning)
git tag --list --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --list --sort=v:refname" }
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 97 in → 1,021 out (950 reasoning)
git tag --sort=v
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 99 in → 598 out (536 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
nvidia/nemotron-3-nano-30b-a3b:none PASS 100% 97 in → 35 out (0 reasoning)
git tag -l --sort=-v:refname | grep -E '^v[0-9]+' | sort -V | cut -c2-
nvidia/nemotron-3-nano-30b-a3b:none__json_schema PASS 100% 97 in → 26 out (0 reasoning)
git tag --list --sort=v:refname | paste -sd' ' -
JSON Schema Structured Output
(raw) { "command": "git tag --list --sort=v:refname | paste -sd' ' -" }
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 99 in → 478 out (409 reasoning)
git tag --list --sort=v:refname
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 100 in → 438 out (423 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 98 in → 362 out (338 reasoning)
git tag --sort=version:refname
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 100 in → 242 out (223 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 101 in → 286 out (267 reasoning)
git tag --sort=version:refname
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 97 in → 314 out (289 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 96 in → 425 out (324 reasoning)
git tag -l --sort=version:refname
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 100 in → 408 out (381 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 99 in → 14 out (0 reasoning)
git tag --sort=version:refname | sort -V
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 102 in → 20 out (0 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag -l --sort=version:refname" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 99 in → 316 out (235 reasoning)
git tag --sort=version:refname
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 101 in → 310 out (275 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
openai/gpt-5.4-mini:high PASS 100% 75 in → 515 out (500 reasoning)
git tag --sort=version:refname
openai/gpt-5.4-mini:high__json_schema PASS 100% 118 in → 229 out (206 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.4-mini:low PASS 100% 79 in → 67 out (52 reasoning)
git tag --sort=version:refname
openai/gpt-5.4-mini:low__json_schema PASS 100% 114 in → 56 out (34 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.4-mini:medium PASS 100% 83 in → 285 out (270 reasoning)
git tag --sort=version:refname
openai/gpt-5.4-mini:medium__json_schema PASS 100% 116 in → 97 out (75 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.4-mini:none PASS 100% 82 in → 13 out (0 reasoning)
git tag --sort=version:refname
openai/gpt-5.4-mini:none__json_schema PASS 100% 114 in → 21 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.4-mini:xhigh PASS 100% 82 in → 522 out (507 reasoning)
git tag --sort=version:refname
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 115 in → 538 out (516 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.4-nano:high PASS 100% 80 in → 108 out (93 reasoning)
git tag --sort=version:refname
openai/gpt-5.4-nano:high__json_schema PASS 100% 112 in → 148 out (120 reasoning)
git tag --list 'v*' --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --list 'v*' --sort=v:refname"}
openai/gpt-5.4-nano:low PASS 100% 81 in → 113 out (92 reasoning)
git tag --sort=version:refname --list 'v*'
openai/gpt-5.4-nano:low__json_schema PASS 100% 114 in → 124 out (95 reasoning)
git tag -l 'v*' --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l 'v*' --sort=version:refname"}
openai/gpt-5.4-nano:medium PASS 100% 78 in → 100 out (79 reasoning)
git tag --sort=version:refname --list 'v*'
openai/gpt-5.4-nano:medium__json_schema PASS 100% 113 in → 92 out (63 reasoning)
git tag --list 'v*' --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --list 'v*' --sort=version:refname"}
openai/gpt-5.4-nano:none PASS 100% 76 in → 18 out (0 reasoning)
git tag --sort=v:refname --list 'v*'
openai/gpt-5.4-nano:none__json_schema PASS 100% 113 in → 27 out (0 reasoning)
git tag --list 'v*' --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --list 'v*' --sort=version:refname"}
openai/gpt-5.4-nano:xhigh PASS 100% 77 in → 771 out (756 reasoning)
git tag --sort=version:refname
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 119 in → 925 out (902 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.4:high PASS 100% 78 in → 110 out (96 reasoning)
git tag --sort=v:refname
openai/gpt-5.4:high__json_schema PASS 100% 111 in → 120 out (98 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.4:low PASS 100% 79 in → 40 out (26 reasoning)
git tag --sort=v:refname
openai/gpt-5.4:low__json_schema PASS 100% 115 in → 81 out (59 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.4:medium PASS 100% 80 in → 134 out (119 reasoning)
git tag --sort=version:refname
openai/gpt-5.4:medium__json_schema PASS 100% 114 in → 79 out (56 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.4:none PASS 100% 79 in → 14 out (0 reasoning)
git tag --sort=version:refname
openai/gpt-5.4:none__json_schema PASS 100% 112 in → 20 out (0 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.4:xhigh PASS 100% 79 in → 307 out (293 reasoning)
git tag --sort=v:refname
openai/gpt-5.4:xhigh__json_schema PASS 100% 111 in → 538 out (516 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.5:high PASS 100% 80 in → 152 out (138 reasoning)
git tag --sort=v:refname
openai/gpt-5.5:high__json_schema PASS 100% 113 in → 151 out (128 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.5:low PASS 100% 75 in → 59 out (45 reasoning)
git tag --sort=v:refname
openai/gpt-5.5:low__json_schema PASS 100% 116 in → 58 out (36 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.5:medium PASS 100% 78 in → 74 out (60 reasoning)
git tag --sort=v:refname
openai/gpt-5.5:medium__json_schema PASS 100% 115 in → 189 out (167 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.5:none PASS 100% 79 in → 12 out (0 reasoning)
git tag --sort=v:refname
openai/gpt-5.5:none__json_schema PASS 100% 115 in → 20 out (0 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.5:xhigh PASS 100% 81 in → 268 out (254 reasoning)
git tag --sort=v:refname
openai/gpt-5.5:xhigh__json_schema PASS 100% 115 in → 149 out (127 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.6-luna:high PASS 100% 78 in → 54 out (39 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-luna:high__json_schema PASS 100% 113 in → 70 out (47 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-luna:low PASS 100% 80 in → 44 out (29 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-luna:low__json_schema PASS 100% 115 in → 72 out (49 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-luna:max PASS 100% 80 in → 202 out (187 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-luna:max__json_schema PASS 100% 114 in → 380 out (357 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-luna:medium PASS 100% 78 in → 79 out (64 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-luna:medium__json_schema PASS 100% 114 in → 59 out (36 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-luna:none PASS 100% 78 in → 13 out (0 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-luna:none__json_schema PASS 100% 119 in → 21 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-luna:xhigh PASS 100% 77 in → 145 out (130 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 112 in → 118 out (95 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-sol:high PASS 100% 80 in → 47 out (33 reasoning)
git tag --sort=v:refname
openai/gpt-5.6-sol:high__json_schema PASS 100% 111 in → 68 out (46 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.6-sol:low PASS 100% 78 in → 41 out (26 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-sol:low__json_schema PASS 100% 116 in → 23 out (0 reasoning)
git tag --list --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --list --sort=version:refname"}
openai/gpt-5.6-sol:max PASS 100% 77 in → 93 out (78 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-sol:max__json_schema PASS 100% 114 in → 151 out (128 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-sol:medium PASS 100% 76 in → 40 out (26 reasoning)
git tag --sort=v:refname
openai/gpt-5.6-sol:medium__json_schema PASS 100% 111 in → 113 out (90 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-sol:none PASS 100% 80 in → 12 out (0 reasoning)
git tag --sort=v:refname
openai/gpt-5.6-sol:none__json_schema PASS 100% 114 in → 23 out (0 reasoning)
git tag --list --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --list --sort=version:refname"}
openai/gpt-5.6-sol:xhigh PASS 100% 79 in → 48 out (33 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 115 in → 60 out (38 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.6-terra:high PASS 100% 80 in → 12 out (0 reasoning)
git tag --sort=v:refname
openai/gpt-5.6-terra:high__json_schema PASS 100% 112 in → 69 out (47 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.6-terra:low PASS 100% 79 in → 41 out (26 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-terra:low__json_schema PASS 100% 115 in → 20 out (0 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
openai/gpt-5.6-terra:max PASS 100% 80 in → 108 out (93 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-terra:max__json_schema PASS 100% 115 in → 66 out (43 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-terra:medium PASS 100% 77 in → 12 out (0 reasoning)
git tag --sort=v:refname
openai/gpt-5.6-terra:medium__json_schema PASS 100% 114 in → 21 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-terra:none PASS 100% 82 in → 13 out (0 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-terra:none__json_schema PASS 100% 114 in → 21 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-5.6-terra:xhigh PASS 100% 80 in → 107 out (92 reasoning)
git tag --sort=version:refname
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 112 in → 59 out (36 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
openai/gpt-oss-120b:high PASS 100% 144 in → 355 out (336 reasoning)
git tag -l --sort=v:refname
openai/gpt-oss-120b:high__json_schema PASS 100% 139 in → 385 out (360 reasoning)
git tag --list --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --list --sort=v:refname"}
openai/gpt-oss-120b:low PASS 100% 141 in → 178 out (168 reasoning)
git tag --list --sort=v:refname
openai/gpt-oss-120b:low__json_schema PASS 100% 138 in → 47 out (32 reasoning)
git tag --list | sort -V
JSON Schema Structured Output
(raw) {"command":"git tag --list | sort -V"}
openai/gpt-oss-120b:medium PASS 100% 139 in → 180 out (163 reasoning)
git tag --list --sort=v:refname
openai/gpt-oss-120b:medium__json_schema PASS 100% 140 in → 220 out (196 reasoning)
git tag --list --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --list --sort=v:refname"}
openai/gpt-oss-120b:xhigh PASS 100% 128 in → 443 out (369 reasoning)
git tag --list --sort=v:refname
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 139 in → 374 out (345 reasoning)
finalgit tag --list --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"finalgit tag --list --sort=v:refname"}
openai/gpt-oss-20b:high PASS 100% 139 in → 336 out (327 reasoning)
git tag --sort=version:refname
openai/gpt-oss-20b:high__json_schema PASS 100% 136 in → 620 out (552 reasoning)
git tag -l 'v*' --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag -l 'v*' --sort=v:refname"}
openai/gpt-oss-20b:low PASS 100% 139 in → 89 out (62 reasoning)
git tag -l | sort -V
openai/gpt-oss-20b:low__json_schema PASS 100% 139 in → 91 out (63 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
openai/gpt-oss-20b:medium PASS 100% 126 in → 149 out (132 reasoning)
git tag --sort=v:refname
openai/gpt-oss-20b:xhigh PASS 100% 128 in → 1,652 out (1,548 reasoning)
git tag --sort=version:refname
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 141 in → 1,499 out (1,475 reasoning)
git tag -l --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag -l --sort=v:refname" }
poolside/laguna-m.1:high PASS 100% 95 in → 877 out (866 reasoning)
git tag -l | sort -V
poolside/laguna-m.1:high__json_schema PASS 100% 97 in → 905 out (887 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag -l --sort=version:refname"}
poolside/laguna-m.1:low PASS 100% 98 in → 468 out (459 reasoning)
git tag --sort=version
poolside/laguna-m.1:low__json_schema PASS 100% 98 in → 825 out (813 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) {"command": "git tag -l | sort -V"}
poolside/laguna-m.1:medium PASS 100% 97 in → 542 out (530 reasoning)
git tag --sort=version:refname
poolside/laguna-m.1:medium__json_schema PASS 100% 101 in → 983 out (960 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag -l --sort=version:refname" }
poolside/laguna-m.1:none PASS 100% 96 in → 10 out (0 reasoning)
git tag -l | sort -V
poolside/laguna-m.1:none__json_schema PASS 100% 99 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
poolside/laguna-m.1:xhigh PASS 100% 101 in → 617 out (599 reasoning)
git tag -l --sort=version:refname | sort -V
poolside/laguna-m.1:xhigh__json_schema PASS 100% 101 in → 721 out (706 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) {"command": "git tag -l | sort -V"}
poolside/laguna-xs-2.1:high PASS 100% 99 in → 921 out (912 reasoning)
git tag -l | sort -V
poolside/laguna-xs-2.1:high__json_schema PASS 100% 98 in → 523 out (506 reasoning)
git tag | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag | sort -V" }
poolside/laguna-xs-2.1:low PASS 100% 99 in → 1,480 out (1,471 reasoning)
git tag --sort=version:refname
poolside/laguna-xs-2.1:low__json_schema PASS 100% 100 in → 991 out (972 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
poolside/laguna-xs-2.1:medium PASS 100% 97 in → 1,044 out (1,034 reasoning)
git tag --sort=version:refname
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 94 in → 1,016 out (997 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
poolside/laguna-xs-2.1:none PASS 100% 99 in → 8 out (0 reasoning)
git tag -l | sort -V
poolside/laguna-xs-2.1:none__json_schema PASS 100% 101 in → 19 out (0 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
poolside/laguna-xs-2.1:xhigh PASS 100% 101 in → 1,195 out (1,186 reasoning)
git tag -l | sort -V
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 96 in → 1,172 out (1,156 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
poolside/laguna-xs.2:high PASS 100% 137 in → 411 out (400 reasoning)
git tag -l | sort -V
poolside/laguna-xs.2:high__json_schema PASS 100% 136 in → 297 out (281 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
poolside/laguna-xs.2:low PASS 100% 138 in → 425 out (411 reasoning)
git tag -l --sort=version:refname
poolside/laguna-xs.2:low__json_schema PASS 100% 137 in → 560 out (545 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) {"command": "git tag -l | sort -V"}
poolside/laguna-xs.2:medium PASS 100% 137 in → 306 out (294 reasoning)
git tag --sort=version:refname
poolside/laguna-xs.2:medium__json_schema PASS 100% 135 in → 627 out (607 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
poolside/laguna-xs.2:none PASS 100% 137 in → 7 out (0 reasoning)
git tag sort -V
poolside/laguna-xs.2:none__json_schema PASS 100% 134 in → 11 out (0 reasoning)
git tag sort -V
JSON Schema Structured Output
(raw) {"command": "git tag sort -V"}
poolside/laguna-xs.2:xhigh PASS 100% 137 in → 310 out (299 reasoning)
git tag -l | sort -V
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 133 in → 1,402 out (1,382 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
qwen/qwen3.6-27b:high PASS 100% 93 in → 1,865 out (1 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-27b:low PASS 100% 94 in → 1,965 out (1,715 reasoning)
git tag | sort -V
qwen/qwen3.6-27b:low__json_schema PASS 100% 99 in → 23 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
qwen/qwen3.6-27b:medium PASS 100% 95 in → 1,161 out (1,072 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-27b:medium__json_schema PASS 100% 99 in → 20 out (0 reasoning)
git tag -l "v*" | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l \"v*\" | sort -V" }
qwen/qwen3.6-27b:none PASS 100% 95 in → 28 out (0 reasoning)
git tag -l | sort -t. -k1,1n -k2,2n -k3,3n
qwen/qwen3.6-27b:none__json_schema PASS 100% 100 in → 18 out (0 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
qwen/qwen3.6-27b:xhigh PASS 100% 96 in → 1,808 out (1 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 93 in → 2,705 out (2,286 reasoning)
git tag | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag | sort -V" }
qwen/qwen3.6-35b-a3b:high PASS 100% 98 in → 1,001 out (987 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 92 in → 1,992 out (1,752 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
qwen/qwen3.6-35b-a3b:low PASS 100% 93 in → 1,287 out (1,159 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 95 in → 2,539 out (2,246 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 97 in → 1,686 out (1,672 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 95 in → 2,069 out (1,868 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
qwen/qwen3.6-35b-a3b:none PASS 100% 98 in → 9 out (0 reasoning)
git tag --sort=-version:refname
qwen/qwen3.6-35b-a3b:none__json_schema PASS 100% 99 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 93 in → 1,332 out (1,209 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 93 in → 1,636 out (1,312 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag -l --sort=version:refname" }
qwen/qwen3.6-flash:high PASS 100% 96 in → 2,226 out (2,212 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-flash:low PASS 100% 96 in → 1,820 out (1,806 reasoning)
git tag --sort=version:refname
qwen/qwen3.6-flash:medium PASS 100% 93 in → 1,828 out (1,812 reasoning)
git tag -l --sort=version:refname
qwen/qwen3.6-flash:none PASS 100% 97 in → 4 out (0 reasoning)
git tag -v
qwen/qwen3.6-flash:xhigh PASS 100% 96 in → 1,192 out (1,178 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-flash:high PASS 100% 95 in → 1,424 out (1,410 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-flash:low PASS 100% 94 in → 1,277 out (1,263 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-flash:max PASS 100% 94 in → 1,664 out (1,650 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-flash:medium PASS 100% 96 in → 1,879 out (1,865 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-flash:none PASS 100% 93 in → 9 out (0 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-flash:xhigh PASS 100% 97 in → 1,383 out (1,369 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-max:high PASS 100% 98 in → 328 out (314 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-max:low PASS 100% 98 in → 355 out (341 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-max:medium PASS 100% 95 in → 442 out (428 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-max:none PASS 100% 98 in → 9 out (0 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-max:xhigh PASS 100% 96 in → 504 out (490 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-plus:high PASS 100% 98 in → 806 out (792 reasoning)
git tag --sort=version:refname
qwen/qwen3.7-plus:low PASS 100% 95 in → 1,002 out (987 reasoning)
git tag -l --sort=v:refname
qwen/qwen3.7-plus:medium PASS 100% 94 in → 663 out (648 reasoning)
git tag -l --sort=v:refname
qwen/qwen3.7-plus:none PASS 100% 100 in → 11 out (0 reasoning)
git tag -l --sort=version:refname
qwen/qwen3.7-plus:xhigh PASS 100% 95 in → 397 out (384 reasoning)
git tag --sort=v:refname
tencent/hy3:high PASS 100% 86 in → 1,427 out (1,221 reasoning)
git tag --sort=version:refname
tencent/hy3:high__json_schema PASS 100% 85 in → 1,537 out (1,288 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
tencent/hy3:low PASS 100% 89 in → 629 out (523 reasoning)
git tag --sort=version:refname
tencent/hy3:low__json_schema PASS 100% 89 in → 715 out (609 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
tencent/hy3:medium PASS 100% 88 in → 843 out (832 reasoning)
git tag --sort=version:refname
tencent/hy3:medium__json_schema PASS 100% 87 in → 748 out (606 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
tencent/hy3:none PASS 100% 88 in → 10 out (0 reasoning)
git tag --sort=version:refname
tencent/hy3:none__json_schema PASS 100% 87 in → 20 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
tencent/hy3:xhigh PASS 100% 87 in → 1,697 out (1,686 reasoning)
git tag --sort=version:refname
tencent/hy3:xhigh__json_schema PASS 100% 83 in → 1,241 out (1,013 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
thinkingmachines/inkling-small:high PASS 100% 87 in → 427 out (350 reasoning)
git tag --sort=v:refname
thinkingmachines/inkling-small:high__json_schema PASS 100% 89 in → 273 out (253 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
thinkingmachines/inkling-small:low PASS 100% 89 in → 56 out (41 reasoning)
git tag --sort=v:refname
thinkingmachines/inkling-small:low__json_schema PASS 100% 89 in → 110 out (91 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
thinkingmachines/inkling-small:max PASS 100% 86 in → 1,213 out (1,023 reasoning)
git tag --sort=v:refname
thinkingmachines/inkling-small:max__json_schema PASS 100% 88 in → 475 out (456 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
thinkingmachines/inkling-small:medium PASS 100% 87 in → 234 out (218 reasoning)
git tag -l --sort=v:refname
thinkingmachines/inkling-small:medium__json_schema PASS 100% 87 in → 212 out (188 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag -l --sort=version:refname" }
thinkingmachines/inkling-small:none PASS 100% 84 in → 11 out (0 reasoning)
git tag --sort=v:refname
thinkingmachines/inkling-small:xhigh PASS 100% 88 in → 248 out (233 reasoning)
git tag --sort=version:refname
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 84 in → 417 out (396 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
thinkingmachines/inkling:high PASS 100% 88 in → 277 out (251 reasoning)
git tag --sort=v:refname
thinkingmachines/inkling:low PASS 100% 88 in → 151 out (136 reasoning)
git tag --sort=v:refname
thinkingmachines/inkling:low__json_schema PASS 100% 87 in → 47 out (26 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
thinkingmachines/inkling:max PASS 100% 86 in → 657 out (641 reasoning)
git tag --sort=version:refname
thinkingmachines/inkling:medium PASS 100% 89 in → 284 out (272 reasoning)
git tag --sort=version:refname
thinkingmachines/inkling:medium__json_schema PASS 100% 90 in → 188 out (168 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
thinkingmachines/inkling:none PASS 100% 86 in → 11 out (0 reasoning)
git tag --sort=v:refname
thinkingmachines/inkling:xhigh PASS 100% 89 in → 204 out (189 reasoning)
git tag --sort=v:refname
thinkingmachines/inkling:xhigh__json_schema PASS 100% 91 in → 221 out (200 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
x-ai/grok-4.3:high PASS 100% 259 in → 343 out (334 reasoning)
git tag --sort=version:refname
x-ai/grok-4.3:high__json_schema PASS 100% 312 in → 713 out (700 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
x-ai/grok-4.3:low PASS 100% 263 in → 442 out (433 reasoning)
git tag --sort=version:refname
x-ai/grok-4.3:low__json_schema PASS 100% 320 in → 453 out (439 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
x-ai/grok-4.3:max PASS 100% 260 in → 475 out (466 reasoning)
git tag --sort=version:refname
x-ai/grok-4.3:max__json_schema PASS 100% 313 in → 668 out (655 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
x-ai/grok-4.3:medium PASS 100% 263 in → 1,150 out (1,141 reasoning)
git tag --sort=version:refname
x-ai/grok-4.3:medium__json_schema PASS 100% 318 in → 1,029 out (1,012 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
x-ai/grok-4.3:none__json_schema PASS 100% 312 in → 13 out (0 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
x-ai/grok-4.3:xhigh PASS 100% 255 in → 580 out (571 reasoning)
git tag --sort=version:refname
x-ai/grok-4.3:xhigh__json_schema PASS 100% 313 in → 1,012 out (995 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
x-ai/grok-4.5:high PASS 100% 278 in → 628 out (619 reasoning)
git tag --sort=version:refname
x-ai/grok-4.5:high__json_schema PASS 100% 347 in → 579 out (565 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
x-ai/grok-4.5:low PASS 100% 278 in → 236 out (223 reasoning)
``` git tag --sort=version:refname ```
x-ai/grok-4.5:low__json_schema PASS 100% 346 in → 435 out (421 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
x-ai/grok-4.5:max PASS 100% 280 in → 500 out (491 reasoning)
git tag --sort=version:refname
x-ai/grok-4.5:max__json_schema PASS 100% 346 in → 583 out (569 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
x-ai/grok-4.5:medium PASS 100% 283 in → 522 out (513 reasoning)
git tag --sort=version:refname
x-ai/grok-4.5:medium__json_schema PASS 100% 344 in → 703 out (689 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=version:refname"}
x-ai/grok-4.5:xhigh PASS 100% 276 in → 761 out (752 reasoning)
git tag --sort=version:refname
x-ai/grok-4.5:xhigh__json_schema PASS 100% 345 in → 370 out (356 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=version:refname"}
z-ai/glm-4.7-flash:high PASS 100% 81 in → 3,210 out (2,800 reasoning)
git tag --sort=version:refname
z-ai/glm-4.7-flash:low PASS 100% 80 in → 956 out (860 reasoning)
git tag --sort=version:refname
z-ai/glm-4.7-flash:low__json_schema PASS 100% 80 in → 681 out (545 reasoning)
git tag -l --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag -l --sort=version:refname" }
z-ai/glm-4.7-flash:medium PASS 100% 79 in → 1,795 out (1,583 reasoning)
git tag --sort=version:refname
z-ai/glm-4.7-flash:none PASS 100% 83 in → 8 out (0 reasoning)
git tag -l | sort -V
z-ai/glm-4.7-flash:none__json_schema PASS 100% 77 in → 16 out (0 reasoning)
git tag -l | sort -V
JSON Schema Structured Output
(raw) { "command": "git tag -l | sort -V" }
z-ai/glm-4.7-flash:xhigh PASS 100% 83 in → 4,373 out (4,363 reasoning)
git tag --sort=v:refname
z-ai/glm-4.7-flash:xhigh__json_schema PASS 100% 76 in → 1,060 out (964 reasoning)
git tag -v
JSON Schema Structured Output
(raw) { "command": "git tag -v" }
z-ai/glm-5.2:high PASS 100% 88 in → 242 out (220 reasoning)
git tag --sort=v:refname
z-ai/glm-5.2:high__json_schema PASS 100% 86 in → 489 out (474 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname"}
z-ai/glm-5.2:low PASS 100% 87 in → 255 out (211 reasoning)
git tag --sort=v:refname
z-ai/glm-5.2:low__json_schema PASS 100% 87 in → 300 out (279 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command": "git tag --sort=v:refname" }
z-ai/glm-5.2:medium PASS 100% 87 in → 224 out (212 reasoning)
git tag -l --sort=v:refname
z-ai/glm-5.2:medium__json_schema PASS 100% 88 in → 300 out (0 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=v:refname" }
z-ai/glm-5.2:none PASS 100% 80 in → 9 out (0 reasoning)
git tag --sort=v:refname
z-ai/glm-5.2:none__json_schema PASS 100% 79 in → 13 out (0 reasoning)
git tag --sort=v:refname
JSON Schema Structured Output
(raw) {"command":"git tag --sort=v:refname"}
z-ai/glm-5.2:xhigh PASS 100% 86 in → 413 out (403 reasoning)
git tag --sort=v:refname
z-ai/glm-5.2:xhigh__json_schema PASS 100% 87 in → 326 out (267 reasoning)
git tag --sort=version:refname
JSON Schema Structured Output
(raw) { "command": "git tag --sort=version:refname" }
google/gemma-4-26b-a4b-it:xhigh FAIL 50% 102 in → 2,915 out (2,298 reasoning)
(empty output)
Failure: Failed assertions: [{'type': 'model_output', 'contains': 'git tag'}]
nvidia/nemotron-3-nano-30b-a3b:high FAIL 50% 101 in → 32,768 out (559 reasoning)
(empty output)
Failure: Failed assertions: [{'type': 'model_output', 'contains': 'git tag'}]
openai/gpt-oss-20b:medium__json_schema FAIL 50% 142 in → 19 out (0 reasoning)
git describe --tags --match "v*" --abbrev=0
JSON Schema Structured Output
(raw) {"command":"git describe --tags --match \"v*\" --abbrev=0"}
Failure: Failed assertions: [{'type': 'model_output', 'contains': 'git tag'}]
x-ai/grok-4.3:none FAIL 50% 257 in → 22 out (0 reasoning)
git for-each-ref --sort=version:refname --format '%(refname:short)' refs/tags
Failure: Failed assertions: [{'type': 'model_output', 'contains': 'git tag'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: { { "command": "git tag --sort=version:refname" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting property name enclosed in double quotes: line 2 column 1 (char 2)
Failure: Failed to parse structured JSON response: Expecting property name enclosed in double quotes: line 2 column 1 (char 2)
Invalid JSON. Output: git tag --sort=version:refname
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git tag -l | sort -V
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git tag --sort=version:refname
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Invalid JSON. Output: git tag | sort -V
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1a9d1f29-6284-94e5-a9d0-22328efaa967","request_id":"1a9d1f29-6284-94e5-a9d0-22328efaa967"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-9d54fb5c-f5ab-9d09-96ab-8955a0a50913","request_id":"9d54fb5c-f5ab-9d09-96ab-8955a0a50913"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-9d47d246-c506-90be-affe-9f5f01d35d2b","request_id":"9d47d246-c506-90be-affe-9f5f01d35d2b"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-28dd0038-1cba-9163-9675-652e052ec57f","request_id":"28dd0038-1cba-9163-9675-652e052ec57f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-542afd94-52ae-93b8-a0a3-d7813f9b311c","request_id":"542afd94-52ae-93b8-a0a3-d7813f9b311c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-0dc5bb5b-f0de-922d-82f8-d55eaedba0b9"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-1c58c4af-4577-9b64-b48c-d5a05ce1759f"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-2f919bd7-f04a-9916-b6de-3fa5f2a2ee2e"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-a493b844-9673-9542-8532-046ce52ecd1d"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-33754003-af68-9278-ac05-72ec085e9c7d"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-29ecc2de-4f43-9094-b114-e64de5f137d3"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-25faf983-47f1-96ea-b652-7a10a7b8b0c9","request_id":"25faf983-47f1-96ea-b652-7a10a7b8b0c9"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-eab1188b-014b-9ee4-9de5-282735b48f77","request_id":"eab1188b-014b-9ee4-9de5-282735b48f77"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d76c0a57-d433-9b8f-91e8-41076057aa59","request_id":"d76c0a57-d433-9b8f-91e8-41076057aa59"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-b26b7fc5-011d-9782-afa2-876a9ba87c13","request_id":"b26b7fc5-011d-9782-afa2-876a9ba87c13"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-7b847f0a-50a9-99a1-b9f8-97ee9432f12a","request_id":"7b847f0a-50a9-99a1-b9f8-97ee9432f12a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-e807795f-0790-9deb-9d5a-8e9c55aac3f4","request_id":"e807795f-0790-9deb-9d5a-8e9c55aac3f4"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-822b0a94-116f-994b-aed2-c89dad8d886e","request_id":"822b0a94-116f-994b-aed2-c89dad8d886e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-938e0c35-0616-9371-84af-b32049657649","request_id":"938e0c35-0616-9371-84af-b32049657649"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f7848711-61d2-9cb9-ac09-740a36708747","request_id":"f7848711-61d2-9cb9-ac09-740a36708747"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-75267c19-5708-99bb-a4bc-4cec5c04c6fd","request_id":"75267c19-5708-99bb-a4bc-4cec5c04c6fd"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: git tag --sort=version:refname{"command": "git tag --sort=version:refname"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git tag --sort=v:refname
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git tag --sort=v:refname
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git tag -l --sort=v:refname "v*"{"command": "git tag -l --sort=v:refname"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)