Fetch tags from a bare remote
Tests ability to fetch tags from a bare remote repository. Evaluates tag-fetch workflow.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 echo 'App' > app.txt
  5. 05 git add app.txt
  6. 06 git commit -m 'Initial release'
  7. 07 git tag v1.0
  8. 08 echo 'New' > new.txt
  9. 09 git add new.txt
  10. 10 git commit -m 'Second release'
  11. 11 git tag v2.0
  12. 12 mkdir -p ../remote-bare && cd ../remote-bare && git init --bare
  13. 13 git remote add origin ../remote-bare
  14. 14 git push origin main --tags
  15. 15 git tag -d v1.0
  16. 16 git tag -d v2.0
Prompt
Fetch all tags from the remote 'origin'. Output ONLY the git command, nothing else.
Expected
git fetch --tags origin

Scoped model quality, cost, API time, and token usage for tag_management/f011.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high PASS 100% 69 in → 33 out (26 reasoning)
git fetch origin --tags
anthropic/claude-fable-5:high__json_schema PASS 100% 281 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-fable-5:low PASS 100% 69 in → 26 out (30 reasoning)
``` git fetch origin --tags ```
anthropic/claude-fable-5:low__json_schema PASS 100% 281 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-fable-5:max PASS 100% 71 in → 122 out (24 reasoning)
git fetch origin --tags
anthropic/claude-fable-5:max__json_schema PASS 100% 284 in → 96 out (34 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-fable-5:medium PASS 100% 68 in → 26 out (30 reasoning)
``` git fetch --tags origin ```
anthropic/claude-fable-5:medium__json_schema PASS 100% 281 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-fable-5:xhigh PASS 100% 69 in → 37 out (16 reasoning)
git fetch origin --tags
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 281 in → 29 out (30 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
anthropic/claude-haiku-4.5:high PASS 100% 80 in → 112 out (102 reasoning)
``` git fetch origin --tags ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 247 in → 158 out (144 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-haiku-4.5:low PASS 100% 84 in → 157 out (147 reasoning)
``` git fetch origin --tags ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 247 in → 150 out (133 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-haiku-4.5:medium PASS 100% 83 in → 106 out (96 reasoning)
``` git fetch origin --tags ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 249 in → 169 out (157 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-haiku-4.5:none PASS 100% 54 in → 12 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-haiku-4.5:none__json_schema PASS 100% 215 in → 13 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-haiku-4.5:xhigh PASS 100% 81 in → 119 out (101 reasoning)
``` git fetch origin --tags ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 247 in → 401 out (425 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-opus-4.6:high PASS 100% 55 in → 13 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 215 in → 41 out (15 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.6:low PASS 100% 55 in → 8 out (0 reasoning)
git fetch origin --tags
anthropic/claude-opus-4.6:low__json_schema PASS 100% 220 in → 12 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.6:max PASS 100% 52 in → 49 out (22 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.6:max__json_schema PASS 100% 216 in → 55 out (29 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.6:medium PASS 100% 55 in → 12 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 217 in → 12 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.6:none PASS 100% 55 in → 12 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 214 in → 12 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.6:xhigh PASS 100% 53 in → 13 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 218 in → 41 out (15 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.7:high PASS 100% 78 in → 18 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.7:high__json_schema PASS 100% 288 in → 20 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.7:low PASS 100% 75 in → 15 out (0 reasoning)
`git fetch origin --tags`
anthropic/claude-opus-4.7:low__json_schema PASS 100% 287 in → 20 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.7:max PASS 100% 77 in → 18 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 284 in → 20 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.7:medium PASS 100% 76 in → 13 out (0 reasoning)
git fetch origin --tags
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 285 in → 20 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.7:none PASS 100% 76 in → 13 out (0 reasoning)
git fetch --tags origin
anthropic/claude-opus-4.7:none__json_schema PASS 100% 285 in → 20 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.7:xhigh PASS 100% 77 in → 18 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 286 in → 20 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.8:high PASS 100% 73 in → 11 out (0 reasoning)
git fetch origin --tags
anthropic/claude-opus-4.8:high__json_schema PASS 100% 283 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.8:low PASS 100% 72 in → 13 out (0 reasoning)
`git fetch origin --tags`
anthropic/claude-opus-4.8:low__json_schema PASS 100% 284 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.8:max PASS 100% 68 in → 15 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.8:max__json_schema PASS 100% 280 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.8:medium PASS 100% 71 in → 11 out (0 reasoning)
git fetch origin --tags
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 284 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.8:none PASS 100% 71 in → 15 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-opus-4.8:none__json_schema PASS 100% 280 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-opus-4.8:xhigh PASS 100% 72 in → 11 out (0 reasoning)
git fetch origin --tags
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 279 in → 18 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
anthropic/claude-sonnet-4.6:high PASS 100% 54 in → 41 out (15 reasoning)
``` git fetch origin --tags ```
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 218 in → 12 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-sonnet-4.6:low PASS 100% 52 in → 12 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 218 in → 12 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-sonnet-4.6:max PASS 100% 54 in → 77 out (57 reasoning)
``` git fetch --tags origin ```
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 217 in → 76 out (56 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
anthropic/claude-sonnet-4.6:medium PASS 100% 51 in → 12 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 216 in → 12 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-sonnet-4.6:none PASS 100% 54 in → 12 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 217 in → 12 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-sonnet-4.6:xhigh PASS 100% 55 in → 41 out (15 reasoning)
``` git fetch origin --tags ```
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 218 in → 12 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-sonnet-5:high PASS 100% 70 in → 15 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 280 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-sonnet-5:low PASS 100% 73 in → 11 out (0 reasoning)
git fetch --tags origin
anthropic/claude-sonnet-5:low__json_schema PASS 100% 278 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-sonnet-5:medium PASS 100% 70 in → 11 out (0 reasoning)
git fetch origin --tags
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 282 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
anthropic/claude-sonnet-5:none PASS 100% 73 in → 15 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-sonnet-5:none__json_schema PASS 100% 281 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
anthropic/claude-sonnet-5:xhigh PASS 100% 70 in → 15 out (0 reasoning)
``` git fetch origin --tags ```
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 281 in → 18 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
arcee-ai/trinity-large-thinking:high PASS 100% 49 in → 186 out (179 reasoning)
git fetch origin --tags
arcee-ai/trinity-large-thinking:low PASS 100% 50 in → 193 out (186 reasoning)
git fetch origin --tags
arcee-ai/trinity-large-thinking:medium PASS 100% 51 in → 266 out (258 reasoning)
git fetch origin --tags
arcee-ai/trinity-large-thinking:xhigh PASS 100% 49 in → 255 out (249 reasoning)
git fetch origin --tags
arcee-ai/trinity-mini:high PASS 100% 48 in → 198 out (228 reasoning)
git fetch origin --tags
arcee-ai/trinity-mini:low PASS 100% 48 in → 388 out (434 reasoning)
git fetch origin --tags
arcee-ai/trinity-mini:low__json_schema PASS 100% 48 in → 305 out (330 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
arcee-ai/trinity-mini:medium PASS 100% 50 in → 288 out (319 reasoning)
git fetch origin --tags
arcee-ai/trinity-mini:medium__json_schema PASS 100% 51 in → 332 out (367 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
arcee-ai/trinity-mini:xhigh__json_schema PASS 100% 50 in → 344 out (371 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
deepseek/deepseek-v4-flash-0731:high PASS 100% 123 in → 71 out (67 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 46 in → 98 out (91 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
deepseek/deepseek-v4-flash-0731:low PASS 100% 42 in → 123 out (117 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 50 in → 67 out (58 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
deepseek/deepseek-v4-flash-0731:max PASS 100% 136 in → 262 out (256 reasoning)
git fetch --tags origin
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 123 in → 83 out (72 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 43 in → 46 out (40 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 43 in → 185 out (179 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags" }
deepseek/deepseek-v4-flash-0731:none PASS 100% 45 in → 6 out (0 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-flash-0731:none__json_schema PASS 100% 45 in → 11 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 42 in → 99 out (92 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 128 in → 89 out (75 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
deepseek/deepseek-v4-flash:high PASS 100% 45 in → 46 out (43 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-flash:low PASS 100% 45 in → 43 out (38 reasoning)
git fetch --tags origin
deepseek/deepseek-v4-flash:low__json_schema PASS 100% 44 in → 59 out (45 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
deepseek/deepseek-v4-flash:none PASS 100% 46 in → 5 out (0 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 46 in → 9 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
deepseek/deepseek-v4-flash:xhigh PASS 100% 45 in → 78 out (71 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 122 in → 125 out (113 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
deepseek/deepseek-v4-pro:high PASS 100% 43 in → 133 out (126 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 231 in → 179 out (167 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
deepseek/deepseek-v4-pro:low PASS 100% 44 in → 6 out (0 reasoning)
git fetch --tags origin
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 43 in → 120 out (119 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
deepseek/deepseek-v4-pro:medium PASS 100% 44 in → 246 out (239 reasoning)
git fetch --tags origin
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 230 in → 191 out (179 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
deepseek/deepseek-v4-pro:none PASS 100% 43 in → 6 out (0 reasoning)
git fetch --tags origin
deepseek/deepseek-v4-pro:none__json_schema PASS 100% 44 in → 9 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
deepseek/deepseek-v4-pro:xhigh PASS 100% 120 in → 62 out (56 reasoning)
git fetch origin --tags
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 47 in → 122 out (110 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3-flash-preview:high PASS 100% 47 in → 75 out (70 reasoning)
git fetch origin --tags
google/gemini-3-flash-preview:high__json_schema PASS 100% 103 in → 182 out (172 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3-flash-preview:low PASS 100% 46 in → 135 out (130 reasoning)
git fetch origin --tags
google/gemini-3-flash-preview:low__json_schema PASS 100% 102 in → 192 out (178 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
google/gemini-3-flash-preview:medium PASS 100% 46 in → 186 out (181 reasoning)
git fetch origin --tags
google/gemini-3-flash-preview:medium__json_schema PASS 100% 102 in → 172 out (163 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
google/gemini-3-flash-preview:xhigh PASS 100% 46 in → 166 out (161 reasoning)
git fetch origin --tags
google/gemini-3-flash-preview:xhigh__json_schema PASS 100% 105 in → 212 out (202 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.1-flash-lite-preview:high PASS 100% 45 in → 280 out (275 reasoning)
git fetch origin --tags
google/gemini-3.1-flash-lite-preview:high__json_schema PASS 100% 47 in → 357 out (347 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.1-flash-lite-preview:low PASS 100% 47 in → 108 out (103 reasoning)
git fetch origin --tags
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 48 in → 99 out (89 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
google/gemini-3.1-flash-lite-preview:medium PASS 100% 47 in → 81 out (76 reasoning)
git fetch origin --tags
google/gemini-3.1-flash-lite-preview:medium__json_schema PASS 100% 46 in → 180 out (170 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 47 in → 224 out (219 reasoning)
git fetch origin --tags
google/gemini-3.1-flash-lite-preview:xhigh__json_schema PASS 100% 48 in → 184 out (175 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
google/gemini-3.1-pro-preview:high PASS 100% 46 in → 224 out (219 reasoning)
git fetch origin --tags
google/gemini-3.1-pro-preview:high__json_schema PASS 100% 102 in → 186 out (176 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
google/gemini-3.1-pro-preview:low PASS 100% 48 in → 115 out (110 reasoning)
git fetch origin --tags
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 105 in → 45 out (35 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.1-pro-preview:medium PASS 100% 46 in → 197 out (192 reasoning)
git fetch --tags origin
google/gemini-3.1-pro-preview:medium__json_schema PASS 100% 103 in → 203 out (194 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
google/gemini-3.1-pro-preview:xhigh PASS 100% 45 in → 347 out (342 reasoning)
git fetch origin --tags
google/gemini-3.1-pro-preview:xhigh__json_schema PASS 100% 104 in → 206 out (196 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.5-flash-lite:high PASS 100% 46 in → 230 out (225 reasoning)
git fetch origin --tags
google/gemini-3.5-flash-lite:high__json_schema PASS 100% 48 in → 351 out (341 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.5-flash-lite:low PASS 100% 48 in → 5 out (0 reasoning)
git fetch origin --tags
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 48 in → 10 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
google/gemini-3.5-flash-lite:max PASS 100% 47 in → 237 out (232 reasoning)
git fetch --tags origin
google/gemini-3.5-flash-lite:max__json_schema PASS 100% 48 in → 257 out (247 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.5-flash-lite:medium PASS 100% 47 in → 123 out (118 reasoning)
git fetch --tags origin
google/gemini-3.5-flash-lite:medium__json_schema PASS 100% 46 in → 205 out (195 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
google/gemini-3.5-flash-lite:xhigh PASS 100% 49 in → 271 out (266 reasoning)
git fetch origin --tags
google/gemini-3.5-flash-lite:xhigh__json_schema PASS 100% 48 in → 273 out (264 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
google/gemini-3.5-flash:high PASS 100% 48 in → 416 out (411 reasoning)
git fetch --tags origin
google/gemini-3.5-flash:high__json_schema PASS 100% 103 in → 305 out (295 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.5-flash:low PASS 100% 47 in → 324 out (319 reasoning)
git fetch origin --tags
google/gemini-3.5-flash:low__json_schema PASS 100% 105 in → 68 out (58 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.5-flash:medium PASS 100% 46 in → 326 out (321 reasoning)
git fetch origin --tags
google/gemini-3.5-flash:medium__json_schema PASS 100% 104 in → 211 out (202 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
google/gemini-3.5-flash:xhigh PASS 100% 45 in → 253 out (248 reasoning)
git fetch origin --tags
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 102 in → 210 out (200 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemini-3.6-flash:high PASS 100% 48 in → 181 out (176 reasoning)
git fetch origin --tags
google/gemini-3.6-flash:high__json_schema PASS 100% 104 in → 286 out (277 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
google/gemini-3.6-flash:low PASS 100% 46 in → 132 out (127 reasoning)
git fetch origin --tags
google/gemini-3.6-flash:low__json_schema PASS 100% 104 in → 9 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
google/gemini-3.6-flash:max PASS 100% 46 in → 227 out (222 reasoning)
git fetch origin --tags
google/gemini-3.6-flash:max__json_schema PASS 100% 105 in → 258 out (249 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
google/gemini-3.6-flash:medium PASS 100% 47 in → 228 out (223 reasoning)
git fetch origin --tags
google/gemini-3.6-flash:medium__json_schema PASS 100% 49 in → 225 out (216 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
google/gemini-3.6-flash:xhigh PASS 100% 46 in → 243 out (238 reasoning)
git fetch origin --tags
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 102 in → 290 out (281 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
google/gemma-4-26b-a4b-it:high PASS 100% 64 in → 237 out (222 reasoning)
git fetch origin --tags
google/gemma-4-26b-a4b-it:high__json_schema PASS 100% 63 in → 180 out (155 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
google/gemma-4-26b-a4b-it:low PASS 100% 63 in → 172 out (161 reasoning)
git fetch origin --tags
google/gemma-4-26b-a4b-it:low__json_schema PASS 100% 61 in → 157 out (139 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
google/gemma-4-26b-a4b-it:medium PASS 100% 63 in → 189 out (188 reasoning)
git fetch origin --tags
google/gemma-4-26b-a4b-it:medium__json_schema PASS 100% 63 in → 221 out (196 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
google/gemma-4-26b-a4b-it:none PASS 100% 61 in → 6 out (0 reasoning)
git fetch origin --tags
google/gemma-4-26b-a4b-it:xhigh PASS 100% 64 in → 162 out (153 reasoning)
git fetch origin --tags
google/gemma-4-26b-a4b-it:xhigh__json_schema PASS 100% 61 in → 187 out (177 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
google/gemma-4-31b-it:high PASS 100% 62 in → 143 out (139 reasoning)
git fetch origin --tags
google/gemma-4-31b-it:high__json_schema PASS 100% 64 in → 247 out (1 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
google/gemma-4-31b-it:low PASS 100% 63 in → 125 out (123 reasoning)
git fetch origin --tags
google/gemma-4-31b-it:low__json_schema PASS 100% 63 in → 111 out (92 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
google/gemma-4-31b-it:medium PASS 100% 64 in → 179 out (169 reasoning)
git fetch origin --tags
google/gemma-4-31b-it:medium__json_schema PASS 100% 62 in → 105 out (94 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
google/gemma-4-31b-it:none PASS 100% 59 in → 6 out (0 reasoning)
git fetch --tags origin
google/gemma-4-31b-it:none__json_schema PASS 100% 60 in → 16 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
google/gemma-4-31b-it:xhigh PASS 100% 64 in → 135 out (136 reasoning)
git fetch origin --tags
google/gemma-4-31b-it:xhigh__json_schema PASS 100% 61 in → 135 out (123 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
ibm-granite/granite-4.1-8b PASS 100% 53 in → 6 out
git fetch origin --tags
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
inclusionai/ling-2.6-flash PASS 100% 68 in → 10 out
``` git fetch origin --tags ```
minimax/minimax-m2.5:high__json_schema PASS 100% 77 in → 357 out (398 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
minimax/minimax-m2.5:low PASS 100% 77 in → 86 out (97 reasoning)
git fetch --tags origin
minimax/minimax-m2.5:low__json_schema PASS 100% 77 in → 162 out (173 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
minimax/minimax-m2.5:medium PASS 100% 78 in → 54 out (47 reasoning)
git fetch --tags origin
minimax/minimax-m2.5:medium__json_schema PASS 100% 76 in → 87 out (73 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
minimax/minimax-m2.5:xhigh PASS 100% 83 in → 161 out (179 reasoning)
git fetch origin --tags
minimax/minimax-m2.5:xhigh__json_schema PASS 100% 78 in → 76 out (61 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
minimax/minimax-m2.7:low PASS 100% 77 in → 164 out (175 reasoning)
git fetch origin --tags
minimax/minimax-m2.7:low__json_schema PASS 100% 209 in → 358 out (343 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
minimax/minimax-m2.7:medium PASS 100% 78 in → 196 out (188 reasoning)
git fetch origin --tags
minimax/minimax-m2.7:medium__json_schema PASS 100% 211 in → 166 out (155 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
minimax/minimax-m2.7:xhigh PASS 100% 79 in → 203 out (216 reasoning)
git fetch origin --tags
minimax/minimax-m3:high PASS 100% 219 in → 168 out (185 reasoning)
git fetch origin --tags
minimax/minimax-m3:high__json_schema PASS 100% 203 in → 13 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
minimax/minimax-m3:low PASS 100% 216 in → 30 out (27 reasoning)
git fetch origin --tags
minimax/minimax-m3:low__json_schema PASS 100% 204 in → 13 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
minimax/minimax-m3:medium__json_schema PASS 100% 202 in → 13 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
minimax/minimax-m3:xhigh PASS 100% 213 in → 29 out (27 reasoning)
git fetch origin --tags
minimax/minimax-m3:xhigh__json_schema PASS 100% 203 in → 13 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
mistralai/devstral-2512 PASS 100% 47 in → 11 out
```bash git fetch origin --tags ```
mistralai/devstral-2512__json_schema PASS 100% 47 in → 11 out
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
mistralai/mistral-medium-3-5:high PASS 100% 59 in → 1,170 out (1,181 reasoning)
git fetch origin --tags
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 44 in → 195 out (189 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
mistralai/mistral-medium-3-5:low PASS 100% 59 in → 767 out (838 reasoning)
git fetch origin --tags
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 46 in → 195 out (197 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
mistralai/mistral-medium-3-5:medium PASS 100% 60 in → 466 out (495 reasoning)
git fetch --tags origin
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 46 in → 225 out (231 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
mistralai/mistral-medium-3-5:none PASS 100% 59 in → 6 out (0 reasoning)
git fetch origin --tags
mistralai/mistral-medium-3-5:none__json_schema PASS 100% 47 in → 11 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
mistralai/mistral-medium-3-5:xhigh PASS 100% 59 in → 174 out (177 reasoning)
git fetch origin --tags
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 48 in → 207 out (216 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
moonshotai/kimi-k2.6:high PASS 100% 47 in → 409 out (451 reasoning)
git fetch origin --tags
moonshotai/kimi-k2.6:high__json_schema PASS 100% 46 in → 782 out (455 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags"}
moonshotai/kimi-k2.6:low PASS 100% 47 in → 270 out (264 reasoning)
git fetch origin --tags
moonshotai/kimi-k2.6:medium PASS 100% 48 in → 320 out (369 reasoning)
git fetch origin --tags
moonshotai/kimi-k2.6:medium__json_schema PASS 100% 46 in → 287 out (320 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
moonshotai/kimi-k2.6:xhigh PASS 100% 48 in → 333 out (328 reasoning)
git fetch origin --tags
moonshotai/kimi-k2.6:xhigh__json_schema PASS 100% 47 in → 425 out (413 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
moonshotai/kimi-k2.7-code:high PASS 100% 47 in → 83 out (76 reasoning)
git fetch origin --tags
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 46 in → 104 out (102 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
moonshotai/kimi-k2.7-code:low PASS 100% 46 in → 137 out (130 reasoning)
git fetch origin --tags
moonshotai/kimi-k2.7-code:low__json_schema PASS 100% 132 in → 46 out (34 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
moonshotai/kimi-k2.7-code:medium PASS 100% 49 in → 75 out (76 reasoning)
git fetch origin --tags
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 45 in → 85 out (74 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
moonshotai/kimi-k2.7-code:xhigh PASS 100% 48 in → 159 out (152 reasoning)
git fetch origin --tags
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 133 in → 80 out (69 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
moonshotai/kimi-k3:high PASS 100% 123 in → 112 out (92 reasoning)
git fetch origin --tags
moonshotai/kimi-k3:high__json_schema PASS 100% 126 in → 115 out (95 reasoning)
git fetch origin --tags
moonshotai/kimi-k3:low PASS 100% 123 in → 88 out (68 reasoning)
git fetch origin --tags
moonshotai/kimi-k3:low__json_schema PASS 100% 221 in → 67 out (42 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
moonshotai/kimi-k3:max PASS 100% 123 in → 105 out (85 reasoning)
git fetch origin --tags
moonshotai/kimi-k3:max__json_schema PASS 100% 127 in → 52 out (32 reasoning)
git fetch origin --tags
moonshotai/kimi-k3:medium PASS 100% 123 in → 150 out (130 reasoning)
git fetch origin --tags
moonshotai/kimi-k3:medium__json_schema PASS 100% 126 in → 68 out (48 reasoning)
git fetch origin --tags
moonshotai/kimi-k3:xhigh PASS 100% 124 in → 91 out (71 reasoning)
git fetch origin --tags
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 126 in → 91 out (66 reasoning)
```bash git fetch origin --tags ```
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 59 in → 98 out (102 reasoning)
git fetch origin --tags
nvidia/nemotron-3-nano-30b-a3b:high__json_schema PASS 100% 60 in → 119 out (108 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 60 in → 179 out (189 reasoning)
git fetch --tags origin
nvidia/nemotron-3-nano-30b-a3b:low__json_schema PASS 100% 60 in → 177 out (188 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 61 in → 181 out (210 reasoning)
git fetch origin --tags
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema PASS 100% 61 in → 189 out (187 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
nvidia/nemotron-3-nano-30b-a3b:none PASS 100% 61 in → 6 out (0 reasoning)
git fetch origin --tags
nvidia/nemotron-3-nano-30b-a3b:xhigh PASS 100% 61 in → 92 out (96 reasoning)
git fetch origin --tags
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema PASS 100% 59 in → 92 out (85 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 59 in → 96 out (87 reasoning)
git fetch --tags origin
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 61 in → 147 out (132 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 60 in → 90 out (82 reasoning)
git fetch --tags origin
nvidia/nemotron-3-super-120b-a12b:low__json_schema PASS 100% 58 in → 66 out (51 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 61 in → 57 out (57 reasoning)
git fetch --tags origin
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 58 in → 61 out (47 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 60 in → 6 out (0 reasoning)
git fetch --tags origin
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 61 in → 14 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 60 in → 58 out (58 reasoning)
git fetch --tags origin
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema PASS 100% 59 in → 116 out (101 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
openai/gpt-5.4-mini:high PASS 100% 45 in → 93 out (82 reasoning)
git fetch origin --tags
openai/gpt-5.4-mini:high__json_schema PASS 100% 79 in → 87 out (68 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.4-mini:low PASS 100% 47 in → 34 out (23 reasoning)
git fetch origin --tags
openai/gpt-5.4-mini:low__json_schema PASS 100% 84 in → 38 out (19 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.4-mini:medium PASS 100% 46 in → 74 out (63 reasoning)
git fetch origin --tags
openai/gpt-5.4-mini:medium__json_schema PASS 100% 82 in → 92 out (73 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.4-mini:none__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.4-mini:xhigh PASS 100% 47 in → 117 out (106 reasoning)
git fetch origin --tags
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 80 in → 108 out (89 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.4-nano:high PASS 100% 45 in → 9 out (0 reasoning)
git fetch --tags origin
openai/gpt-5.4-nano:high__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.4-nano:low PASS 100% 47 in → 9 out (0 reasoning)
git fetch --tags origin
openai/gpt-5.4-nano:low__json_schema PASS 100% 81 in → 17 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.4-nano:medium PASS 100% 45 in → 9 out (0 reasoning)
git fetch --tags origin
openai/gpt-5.4-nano:medium__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.4-nano:none PASS 100% 43 in → 9 out (0 reasoning)
git fetch --tags origin
openai/gpt-5.4-nano:none__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.4-nano:xhigh PASS 100% 45 in → 78 out (67 reasoning)
git fetch --tags origin
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 80 in → 105 out (86 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.4:high PASS 100% 43 in → 113 out (102 reasoning)
git fetch --tags origin
openai/gpt-5.4:high__json_schema PASS 100% 81 in → 301 out (282 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.4:low PASS 100% 44 in → 40 out (29 reasoning)
git fetch origin --tags
openai/gpt-5.4:low__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.4:medium PASS 100% 46 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.4:medium__json_schema PASS 100% 82 in → 59 out (40 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.4:none PASS 100% 45 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.4:none__json_schema PASS 100% 78 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.4:xhigh PASS 100% 46 in → 92 out (81 reasoning)
git fetch origin --tags
openai/gpt-5.4:xhigh__json_schema PASS 100% 81 in → 797 out (778 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.5:high PASS 100% 44 in → 50 out (39 reasoning)
git fetch origin --tags
openai/gpt-5.5:high__json_schema PASS 100% 81 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.5:low PASS 100% 46 in → 34 out (23 reasoning)
git fetch origin --tags
openai/gpt-5.5:low__json_schema PASS 100% 79 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.5:medium PASS 100% 46 in → 46 out (35 reasoning)
git fetch origin --tags
openai/gpt-5.5:medium__json_schema PASS 100% 81 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.5:none PASS 100% 47 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.5:none__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.5:xhigh PASS 100% 43 in → 115 out (104 reasoning)
git fetch origin --tags
openai/gpt-5.5:xhigh__json_schema PASS 100% 80 in → 102 out (83 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-luna:high PASS 100% 46 in → 53 out (42 reasoning)
git fetch origin --tags
openai/gpt-5.6-luna:high__json_schema PASS 100% 81 in → 47 out (28 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-luna:low PASS 100% 47 in → 34 out (23 reasoning)
git fetch origin --tags
openai/gpt-5.6-luna:low__json_schema PASS 100% 81 in → 43 out (24 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-luna:max PASS 100% 45 in → 52 out (41 reasoning)
git fetch origin --tags
openai/gpt-5.6-luna:max__json_schema PASS 100% 79 in → 271 out (252 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-luna:medium PASS 100% 47 in → 34 out (23 reasoning)
git fetch origin --tags
openai/gpt-5.6-luna:medium__json_schema PASS 100% 82 in → 42 out (23 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-luna:none PASS 100% 46 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-luna:none__json_schema PASS 100% 79 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-luna:xhigh PASS 100% 45 in → 55 out (44 reasoning)
git fetch origin --tags
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 81 in → 125 out (106 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-sol:high PASS 100% 46 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-sol:high__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-sol:low PASS 100% 47 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-sol:low__json_schema PASS 100% 81 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-sol:max PASS 100% 44 in → 43 out (32 reasoning)
git fetch origin --tags
openai/gpt-5.6-sol:max__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-sol:medium PASS 100% 43 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-sol:medium__json_schema PASS 100% 81 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-sol:none PASS 100% 44 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-sol:none__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-sol:xhigh PASS 100% 46 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 82 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-terra:high PASS 100% 45 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-terra:high__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.6-terra:low PASS 100% 48 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-terra:low__json_schema PASS 100% 81 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-terra:max PASS 100% 45 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-terra:max__json_schema PASS 100% 82 in → 51 out (32 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
openai/gpt-5.6-terra:medium PASS 100% 48 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-terra:medium__json_schema PASS 100% 79 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-terra:none PASS 100% 44 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-terra:none__json_schema PASS 100% 80 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-5.6-terra:xhigh PASS 100% 44 in → 9 out (0 reasoning)
git fetch origin --tags
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 81 in → 17 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-oss-120b:high PASS 100% 108 in → 121 out (106 reasoning)
git fetch origin --tags
openai/gpt-oss-120b:high__json_schema PASS 100% 110 in → 203 out (215 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-oss-120b:low PASS 100% 111 in → 90 out (85 reasoning)
git fetch --tags origin
openai/gpt-oss-120b:low__json_schema PASS 100% 109 in → 36 out (16 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
openai/gpt-oss-120b:medium PASS 100% 109 in → 83 out (74 reasoning)
git fetch origin --tags
openai/gpt-oss-120b:medium__json_schema PASS 100% 106 in → 92 out (73 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-oss-120b:xhigh PASS 100% 105 in → 99 out (86 reasoning)
git fetch --tags origin
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 108 in → 522 out (564 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
openai/gpt-oss-20b:high PASS 100% 94 in → 424 out (451 reasoning)
git fetch --tags origin
openai/gpt-oss-20b:high__json_schema PASS 100% 94 in → 165 out (156 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
openai/gpt-oss-20b:low PASS 100% 107 in → 41 out (30 reasoning)
git fetch --tags origin
openai/gpt-oss-20b:medium PASS 100% 111 in → 129 out (124 reasoning)
git fetch origin --tags
openai/gpt-oss-20b:medium__json_schema PASS 100% 106 in → 222 out (229 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command" : "git fetch --tags origin" }
openai/gpt-oss-20b:xhigh PASS 100% 96 in → 392 out (417 reasoning)
git fetch origin --tags
openai/gpt-oss-20b:xhigh__json_schema PASS 100% 110 in → 230 out (237 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
poolside/laguna-m.1:high PASS 100% 60 in → 231 out (223 reasoning)
git fetch --tags origin
poolside/laguna-m.1:high__json_schema PASS 100% 60 in → 224 out (212 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
poolside/laguna-m.1:low PASS 100% 60 in → 218 out (210 reasoning)
git fetch origin --tags
poolside/laguna-m.1:low__json_schema PASS 100% 60 in → 165 out (148 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
poolside/laguna-m.1:medium PASS 100% 61 in → 241 out (233 reasoning)
git fetch --tags origin
poolside/laguna-m.1:medium__json_schema PASS 100% 62 in → 300 out (288 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
poolside/laguna-m.1:none PASS 100% 60 in → 7 out (0 reasoning)
git fetch --tags origin
poolside/laguna-m.1:none__json_schema PASS 100% 61 in → 12 out (0 reasoning)
git fetch origin --tags --force
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags --force"}
poolside/laguna-m.1:xhigh PASS 100% 60 in → 272 out (264 reasoning)
git fetch --tags origin
poolside/laguna-m.1:xhigh__json_schema PASS 100% 60 in → 338 out (327 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command":"git fetch --tags origin"}
poolside/laguna-xs-2.1:high PASS 100% 61 in → 354 out (348 reasoning)
git fetch origin --tags
poolside/laguna-xs-2.1:high__json_schema PASS 100% 61 in → 213 out (202 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
poolside/laguna-xs-2.1:low PASS 100% 60 in → 316 out (311 reasoning)
git fetch --tags origin
poolside/laguna-xs-2.1:low__json_schema PASS 100% 62 in → 609 out (592 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
poolside/laguna-xs-2.1:medium PASS 100% 59 in → 301 out (296 reasoning)
git fetch origin --tags
poolside/laguna-xs-2.1:medium__json_schema PASS 100% 58 in → 221 out (209 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
poolside/laguna-xs-2.1:none PASS 100% 60 in → 12 out (0 reasoning)
git fetch --tags origin </think>git fetch --tags origin
poolside/laguna-xs-2.1:none__json_schema PASS 100% 60 in → 16 out (0 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
poolside/laguna-xs-2.1:xhigh PASS 100% 62 in → 401 out (397 reasoning)
git fetch origin --tags
poolside/laguna-xs-2.1:xhigh__json_schema PASS 100% 61 in → 314 out (303 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
poolside/laguna-xs.2:high PASS 100% 99 in → 51 out (43 reasoning)
git fetch origin --tags
poolside/laguna-xs.2:high__json_schema PASS 100% 98 in → 115 out (103 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
poolside/laguna-xs.2:low PASS 100% 99 in → 100 out (92 reasoning)
git fetch origin --tags
poolside/laguna-xs.2:low__json_schema PASS 100% 95 in → 93 out (81 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
poolside/laguna-xs.2:medium PASS 100% 95 in → 73 out (65 reasoning)
git fetch origin --tags
poolside/laguna-xs.2:medium__json_schema PASS 100% 96 in → 45 out (33 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
poolside/laguna-xs.2:xhigh PASS 100% 96 in → 219 out (212 reasoning)
git fetch origin --tags
poolside/laguna-xs.2:xhigh__json_schema PASS 100% 97 in → 109 out (92 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
qwen/qwen3.6-27b:high PASS 100% 57 in → 1,033 out (1,015 reasoning)
git fetch origin --tags
qwen/qwen3.6-27b:low PASS 100% 58 in → 703 out (714 reasoning)
git fetch origin --tags
qwen/qwen3.6-27b:medium PASS 100% 55 in → 1,095 out (1,085 reasoning)
git fetch --tags origin
qwen/qwen3.6-27b:medium__json_schema PASS 100% 60 in → 10 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
qwen/qwen3.6-27b:none PASS 100% 60 in → 5 out (0 reasoning)
git fetch origin --tags
qwen/qwen3.6-27b:none__json_schema PASS 100% 59 in → 16 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
qwen/qwen3.6-27b:xhigh PASS 100% 56 in → 959 out (1 reasoning)
git fetch origin --tags
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 56 in → 1,020 out (1,033 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
qwen/qwen3.6-35b-a3b:high PASS 100% 58 in → 819 out (816 reasoning)
git fetch origin --tags
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 58 in → 773 out (788 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
qwen/qwen3.6-35b-a3b:low PASS 100% 58 in → 901 out (872 reasoning)
git fetch origin --tags
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 56 in → 1,095 out (1,092 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 58 in → 830 out (830 reasoning)
git fetch origin --tags
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 57 in → 355 out (358 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
qwen/qwen3.6-35b-a3b:none PASS 100% 56 in → 6 out (0 reasoning)
git fetch --tags origin
qwen/qwen3.6-35b-a3b:none__json_schema PASS 100% 58 in → 16 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 58 in → 738 out (728 reasoning)
git fetch origin --tags
qwen/qwen3.6-35b-a3b:xhigh__json_schema PASS 100% 56 in → 755 out (752 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
qwen/qwen3.6-flash:high PASS 100% 58 in → 776 out (766 reasoning)
git fetch --tags origin
qwen/qwen3.6-flash:low PASS 100% 56 in → 836 out (826 reasoning)
git fetch origin --tags
qwen/qwen3.6-flash:medium PASS 100% 55 in → 691 out (681 reasoning)
git fetch origin --tags
qwen/qwen3.6-flash:none PASS 100% 60 in → 5 out (0 reasoning)
git fetch origin --tags
qwen/qwen3.6-flash:xhigh PASS 100% 58 in → 1,013 out (1,003 reasoning)
git fetch origin --tags
qwen/qwen3.7-flash:high PASS 100% 58 in → 648 out (638 reasoning)
git fetch origin --tags
qwen/qwen3.7-flash:low PASS 100% 56 in → 1,111 out (1,101 reasoning)
git fetch --tags origin
qwen/qwen3.7-flash:max PASS 100% 56 in → 931 out (921 reasoning)
git fetch origin --tags
qwen/qwen3.7-flash:medium PASS 100% 57 in → 544 out (534 reasoning)
git fetch origin --tags
qwen/qwen3.7-flash:none PASS 100% 59 in → 5 out (0 reasoning)
git fetch origin --tags
qwen/qwen3.7-flash:xhigh PASS 100% 56 in → 849 out (839 reasoning)
git fetch --tags origin
qwen/qwen3.7-max:high PASS 100% 58 in → 525 out (515 reasoning)
git fetch origin --tags
qwen/qwen3.7-max:low PASS 100% 58 in → 529 out (519 reasoning)
git fetch origin --tags
qwen/qwen3.7-max:medium PASS 100% 57 in → 470 out (460 reasoning)
git fetch origin --tags
qwen/qwen3.7-max:none PASS 100% 57 in → 5 out (0 reasoning)
git fetch origin --tags
qwen/qwen3.7-max:xhigh PASS 100% 56 in → 544 out (534 reasoning)
git fetch origin --tags
qwen/qwen3.7-plus:high PASS 100% 56 in → 637 out (627 reasoning)
git fetch origin --tags
qwen/qwen3.7-plus:low PASS 100% 56 in → 590 out (580 reasoning)
git fetch origin --tags
qwen/qwen3.7-plus:medium PASS 100% 55 in → 528 out (518 reasoning)
git fetch --tags origin
qwen/qwen3.7-plus:none PASS 100% 59 in → 5 out (0 reasoning)
git fetch origin --tags
qwen/qwen3.7-plus:xhigh PASS 100% 55 in → 602 out (592 reasoning)
git fetch origin --tags
tencent/hy3:high PASS 100% 52 in → 249 out (242 reasoning)
git fetch origin --tags
tencent/hy3:high__json_schema PASS 100% 51 in → 523 out (545 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
tencent/hy3:low PASS 100% 49 in → 205 out (213 reasoning)
git fetch origin --tags
tencent/hy3:low__json_schema PASS 100% 51 in → 286 out (275 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
tencent/hy3:medium PASS 100% 54 in → 273 out (266 reasoning)
git fetch origin --tags
tencent/hy3:medium__json_schema PASS 100% 51 in → 396 out (411 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
tencent/hy3:none PASS 100% 56 in → 6 out (0 reasoning)
git fetch origin --tags
tencent/hy3:none__json_schema PASS 100% 53 in → 14 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
tencent/hy3:xhigh PASS 100% 52 in → 491 out (484 reasoning)
git fetch origin --tags
tencent/hy3:xhigh__json_schema PASS 100% 49 in → 183 out (175 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
thinkingmachines/inkling-small:high PASS 100% 56 in → 134 out (123 reasoning)
git fetch origin --tags
thinkingmachines/inkling-small:high__json_schema PASS 100% 54 in → 91 out (74 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
thinkingmachines/inkling-small:low PASS 100% 55 in → 60 out (49 reasoning)
git fetch origin --tags
thinkingmachines/inkling-small:low__json_schema PASS 100% 54 in → 49 out (32 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
thinkingmachines/inkling-small:max PASS 100% 52 in → 144 out (133 reasoning)
git fetch origin --tags
thinkingmachines/inkling-small:max__json_schema PASS 100% 54 in → 146 out (128 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
thinkingmachines/inkling-small:medium PASS 100% 54 in → 73 out (62 reasoning)
git fetch origin --tags
thinkingmachines/inkling-small:medium__json_schema PASS 100% 56 in → 92 out (75 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
thinkingmachines/inkling-small:none PASS 100% 51 in → 8 out (0 reasoning)
git fetch origin --tags
thinkingmachines/inkling-small:xhigh PASS 100% 53 in → 113 out (102 reasoning)
git fetch origin --tags
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 53 in → 93 out (76 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
thinkingmachines/inkling:high PASS 100% 54 in → 92 out (86 reasoning)
git fetch --tags origin
thinkingmachines/inkling:high__json_schema PASS 100% 54 in → 85 out (67 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
thinkingmachines/inkling:low PASS 100% 53 in → 41 out (29 reasoning)
git fetch origin --tags
thinkingmachines/inkling:low__json_schema PASS 100% 55 in → 37 out (20 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
thinkingmachines/inkling:max PASS 100% 55 in → 99 out (88 reasoning)
git fetch origin --tags
thinkingmachines/inkling:max__json_schema PASS 100% 53 in → 121 out (104 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
thinkingmachines/inkling:medium PASS 100% 56 in → 77 out (70 reasoning)
git fetch origin --tags
thinkingmachines/inkling:medium__json_schema PASS 100% 55 in → 79 out (62 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
thinkingmachines/inkling:none PASS 100% 53 in → 9 out (0 reasoning)
git fetch origin --tags
thinkingmachines/inkling:xhigh PASS 100% 54 in → 147 out (136 reasoning)
git fetch origin --tags
thinkingmachines/inkling:xhigh__json_schema PASS 100% 54 in → 105 out (87 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
x-ai/grok-4.3:high PASS 100% 226 in → 344 out (339 reasoning)
git fetch origin --tags
x-ai/grok-4.3:high__json_schema PASS 100% 282 in → 421 out (412 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
x-ai/grok-4.3:low PASS 100% 230 in → 133 out (128 reasoning)
git fetch origin --tags
x-ai/grok-4.3:low__json_schema PASS 100% 287 in → 238 out (225 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
x-ai/grok-4.3:max PASS 100% 224 in → 142 out (137 reasoning)
git fetch origin --tags
x-ai/grok-4.3:max__json_schema PASS 100% 280 in → 363 out (354 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
x-ai/grok-4.3:medium PASS 100% 228 in → 120 out (115 reasoning)
git fetch origin --tags
x-ai/grok-4.3:medium__json_schema PASS 100% 289 in → 337 out (324 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
x-ai/grok-4.3:none PASS 100% 220 in → 5 out (0 reasoning)
git fetch origin --tags
x-ai/grok-4.3:none__json_schema PASS 100% 280 in → 9 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
x-ai/grok-4.3:xhigh PASS 100% 224 in → 207 out (202 reasoning)
git fetch --tags origin
x-ai/grok-4.3:xhigh__json_schema PASS 100% 279 in → 247 out (238 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
x-ai/grok-4.5:high PASS 100% 243 in → 290 out (281 reasoning)
``` git fetch origin --tags ```
x-ai/grok-4.5:high__json_schema PASS 100% 312 in → 175 out (165 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
x-ai/grok-4.5:low PASS 100% 246 in → 144 out (135 reasoning)
``` git fetch origin --tags ```
x-ai/grok-4.5:low__json_schema PASS 100% 315 in → 243 out (233 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
x-ai/grok-4.5:max PASS 100% 245 in → 351 out (346 reasoning)
git fetch origin --tags
x-ai/grok-4.5:max__json_schema PASS 100% 310 in → 226 out (216 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
x-ai/grok-4.5:medium PASS 100% 247 in → 191 out (186 reasoning)
git fetch origin --tags
x-ai/grok-4.5:medium__json_schema PASS 100% 312 in → 225 out (215 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
x-ai/grok-4.5:xhigh PASS 100% 246 in → 153 out (148 reasoning)
git fetch origin --tags
x-ai/grok-4.5:xhigh__json_schema PASS 100% 309 in → 426 out (416 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command":"git fetch origin --tags"}
z-ai/glm-4.7-flash:high PASS 100% 45 in → 262 out (267 reasoning)
git fetch origin --tags
z-ai/glm-4.7-flash:high__json_schema PASS 100% 45 in → 340 out (343 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) {"command": "git fetch origin --tags"}
z-ai/glm-4.7-flash:low PASS 100% 46 in → 303 out (298 reasoning)
git fetch --tags origin
z-ai/glm-4.7-flash:medium PASS 100% 46 in → 288 out (289 reasoning)
git fetch origin --tags
z-ai/glm-4.7-flash:medium__json_schema PASS 100% 46 in → 1,413 out (1,479 reasoning)
git fetch origin
JSON Schema Structured Output
(raw) { "command": "git fetch origin" }
z-ai/glm-4.7-flash:none PASS 100% 46 in → 5 out (0 reasoning)
git fetch origin --tags
z-ai/glm-4.7-flash:none__json_schema PASS 100% 46 in → 12 out (0 reasoning)
git fetch origin
JSON Schema Structured Output
(raw) { "command": "git fetch origin" }
z-ai/glm-4.7-flash:xhigh PASS 100% 44 in → 443 out (436 reasoning)
git fetch --tags origin
z-ai/glm-5.2:high PASS 100% 54 in → 187 out (182 reasoning)
git fetch --tags origin
z-ai/glm-5.2:low PASS 100% 53 in → 283 out (276 reasoning)
git fetch origin --tags
z-ai/glm-5.2:low__json_schema PASS 100% 55 in → 309 out (297 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) {"command": "git fetch --tags origin"}
z-ai/glm-5.2:medium PASS 100% 53 in → 248 out (241 reasoning)
git fetch origin --tags
z-ai/glm-5.2:medium__json_schema PASS 100% 51 in → 215 out (197 reasoning)
git fetch --tags origin
JSON Schema Structured Output
(raw) { "command": "git fetch --tags origin" }
z-ai/glm-5.2:none PASS 100% 48 in → 6 out (0 reasoning)
git fetch origin --tags
z-ai/glm-5.2:none__json_schema PASS 100% 45 in → 14 out (0 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
z-ai/glm-5.2:xhigh PASS 100% 52 in → 473 out (466 reasoning)
git fetch origin --tags
z-ai/glm-5.2:xhigh__json_schema PASS 100% 51 in → 274 out (257 reasoning)
git fetch origin --tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin --tags" }
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
arcee-ai/trinity-mini:high__json_schema FAIL 0% 50 in → 286 out (306 reasoning)
git fetch origin--tags
JSON Schema Structured Output
(raw) { "command": "git fetch origin--tags" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
arcee-ai/trinity-mini:xhigh FAIL 0% 49 in → 324 out (359 reasoning)
git fetch origin--tags
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
deepseek/deepseek-v4-flash:medium FAIL 0% 45 in → 98 out (91 reasoning)
gitfetch origin --tags
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
Invalid JSON. Output: git fetch origin --tags
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
google/gemma-4-26b-a4b-it:none__json_schema FAIL 0% 60 in → 18 out (0 reasoning)
git ls-remote --tags origin
JSON Schema Structured Output
(raw) { "command": "git ls-remote --tags origin" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
git ls-remote --tags origin
JSON Schema Structured Output
(raw) { "command": "git ls-remote --tags origin" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
liquid/lfm-2-24b-a2b FAIL 0% 53 in → 7 out
git tag -r origin/
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
Invalid JSON. Output: git fetch origin --tags
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
minimax/minimax-m2.5:high FAIL 0% 80 in → 216 out (236 reasoning)
origin --tags
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
minimax/minimax-m2.7:high FAIL 0% 80 in → 166 out (158 reasoning)
gitfetch origin --tags
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
minimax/minimax-m3:medium FAIL 0% 215 in → 45 out (44 reasoning)
gitfetch origin --tags
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
Invalid JSON. Output: git fetch origin --tags
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
nvidia/nemotron-3-nano-30b-a3b:none__json_schema FAIL 0% 61 in → 46 out (0 reasoning)
git tag --list --force --delete $(git tag) && git fetch --tags origin && git pull origin $(git rev-parse --abbrev-ref HEAD) --tags
JSON Schema Structured Output
(raw) { "command": "git tag --list --force --delete $(git tag) && git fetch --tags origin && git pull origin $(git rev-parse --abbrev-ref HEAD) --tags" }
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
openai/gpt-5.4-mini:none FAIL 0% 45 in → 11 out (0 reasoning)
git ls-remote --tags origin
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
openai/gpt-oss-20b:low__json_schema FAIL 0% 96 in → 49 out (30 reasoning)
git ls-remote --tags origin
JSON Schema Structured Output
(raw) {"command":"git ls-remote --tags origin"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
poolside/laguna-xs.2:none FAIL 0% 98 in → 8 out (0 reasoning)
git ls-remote --tags origin
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
poolside/laguna-xs.2:none__json_schema FAIL 0% 99 in → 12 out (0 reasoning)
git ls-remote --tags origin
JSON Schema Structured Output
(raw) {"command": "git ls-remote --tags origin"}
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git tag -l', 'contains': 'v2.0'}]
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1453c8e1-0e0f-9687-9705-5f8f22db32dc","request_id":"1453c8e1-0e0f-9687-9705-5f8f22db32dc"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-86fad23b-8544-9889-aac7-46857861b26b","request_id":"86fad23b-8544-9889-aac7-46857861b26b"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-dc177c38-6a8d-9c0b-93c7-637a98723ee1","request_id":"dc177c38-6a8d-9c0b-93c7-637a98723ee1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-7e37f45b-1fd7-921a-beda-01c71abfa099","request_id":"7e37f45b-1fd7-921a-beda-01c71abfa099"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-c87dc508-77b3-95fc-876b-4404c95c4354","request_id":"c87dc508-77b3-95fc-876b-4404c95c4354"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-cef0141a-2691-9899-ba55-80803955fb92"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-e0c24e83-2f05-96fc-9304-4a3af40dfee1"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-ec79cdd9-f00c-9689-ab57-5dc3f9cbffd1"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-3e403221-9291-9982-9eff-3e9b5546b8f6"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-44ec4d58-db49-9420-a46a-bf575061038a"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-e2df6e95-edfc-9807-9c38-1b9a077cc48d"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-103f449b-0e6c-9dac-81fb-7f0139d4d7b0","request_id":"103f449b-0e6c-9dac-81fb-7f0139d4d7b0"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-eb78f157-b87d-9e6a-932d-17083e96a3de","request_id":"eb78f157-b87d-9e6a-932d-17083e96a3de"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-74f89787-7edb-97c8-a36b-b430de615b9a","request_id":"74f89787-7edb-97c8-a36b-b430de615b9a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-85a81369-a85d-9906-97db-cf52a7a8ef96","request_id":"85a81369-a85d-9906-97db-cf52a7a8ef96"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1e782c0a-1f01-9c68-b02f-11d4d447d65a","request_id":"1e782c0a-1f01-9c68-b02f-11d4d447d65a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-3ba8f4c9-b62e-9406-98d9-6f76543eae13","request_id":"3ba8f4c9-b62e-9406-98d9-6f76543eae13"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d9c68be8-0bef-9ba0-bfeb-bc474a30bf34","request_id":"d9c68be8-0bef-9ba0-bfeb-bc474a30bf34"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-849d90c2-53ef-9577-b679-e7c1fd174c6e","request_id":"849d90c2-53ef-9577-b679-e7c1fd174c6e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-94479370-256f-9cf5-91f1-b9b7296f009e","request_id":"94479370-256f-9cf5-91f1-b9b7296f009e"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-5e153693-f6dd-9547-8198-01ec3f9c70d0","request_id":"5e153693-f6dd-9547-8198-01ec3f9c70d0"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: git fetch origin --tags{"command": "git fetch origin --tags"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: git fetch origin --tags{"command": "git fetch origin --tags"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)