Multi-file: conflict in settings.json only
Tests ability to resolve a JSON config conflict during rebase preserving valid syntax. Evaluates structured-data conflict in rebase.

These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.

  1. 01 git init
  2. 02 git config user.email 'test@test.com'
  3. 03 git config user.name 'Test User'
  4. 04 printf '{ "name": "app", "version": "1.0.0" }' > settings.json
  5. 05 printf 'DB_HOST=localhost DB_PORT=5432' > database.ini
  6. 06 git add settings.json database.ini
  7. 07 git commit -m 'Initial config'
  8. 08 git checkout -b v2
  9. 09 printf '{ "name": "app", "version": "2.0.0" }' > settings.json
  10. 10 git add settings.json
  11. 11 git commit -m 'Bump version to 2.0.0'
  12. 12 git checkout main
  13. 13 printf '{ "name": "MyApp", "version": "1.0.0" }' > settings.json
  14. 14 git add settings.json
  15. 15 git commit -m 'Rename app to MyApp'
  16. 16 git rebase v2
Prompt
Resolve the rebase conflict in settings.json. The base had name: app, version: 1.0.0. Branch being rebased (v2) kept name: app but bumped version to 2.0.0. Main branch renamed name to MyApp but kept version 1.0.0. Provide ONLY the resolved settings.json content as valid JSON.
Expected
{ "name": "MyApp", "version": "2.0.0" }

Scoped model quality, cost, API time, and token usage for rebase/f011.

Loading...
Loading raw attempt evidence…
anthropic/claude-fable-5:high__json_schema PASS 100% 438 in → 75 out (17 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-fable-5:low PASS 100% 219 in → 33 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-fable-5:low__json_schema PASS 100% 437 in → 52 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-fable-5:max PASS 100% 217 in → 646 out (79 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-fable-5:medium__json_schema PASS 100% 439 in → 75 out (17 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-fable-5:xhigh PASS 100% 220 in → 63 out (20 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-fable-5:xhigh__json_schema PASS 100% 441 in → 107 out (28 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-haiku-4.5:high PASS 100% 201 in → 464 out (336 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-haiku-4.5:high__json_schema PASS 100% 368 in → 397 out (299 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-haiku-4.5:low PASS 100% 201 in → 356 out (228 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-haiku-4.5:low__json_schema PASS 100% 369 in → 447 out (338 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-haiku-4.5:medium PASS 100% 198 in → 367 out (278 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-haiku-4.5:medium__json_schema PASS 100% 368 in → 444 out (308 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-haiku-4.5:none PASS 100% 170 in → 32 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-haiku-4.5:xhigh PASS 100% 199 in → 352 out (246 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-haiku-4.5:xhigh__json_schema PASS 100% 366 in → 500 out (384 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.6:high PASS 100% 170 in → 79 out (29 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-opus-4.6:high__json_schema PASS 100% 337 in → 114 out (55 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.6:low PASS 100% 170 in → 32 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-opus-4.6:low__json_schema PASS 100% 339 in → 38 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.6:max__json_schema PASS 100% 338 in → 1,006 out (366 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.6:medium PASS 100% 170 in → 33 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-opus-4.6:medium__json_schema PASS 100% 340 in → 38 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.6:none PASS 100% 170 in → 32 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-opus-4.6:none__json_schema PASS 100% 340 in → 38 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.6:xhigh__json_schema PASS 100% 340 in → 113 out (55 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.7:high PASS 100% 223 in → 30 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
anthropic/claude-opus-4.7:high__json_schema PASS 100% 442 in → 52 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.7:low PASS 100% 223 in → 30 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
anthropic/claude-opus-4.7:low__json_schema PASS 100% 443 in → 52 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.7:max PASS 100% 223 in → 1,528 out (248 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-opus-4.7:max__json_schema PASS 100% 442 in → 1,503 out (221 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-opus-4.7:medium PASS 100% 223 in → 30 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
anthropic/claude-opus-4.7:medium__json_schema PASS 100% 445 in → 52 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.7:none PASS 100% 224 in → 30 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
anthropic/claude-opus-4.7:none__json_schema PASS 100% 443 in → 52 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.7:xhigh__json_schema PASS 100% 444 in → 52 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.8:high__json_schema PASS 100% 436 in → 406 out (108 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-opus-4.8:low PASS 100% 217 in → 273 out (107 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-opus-4.8:low__json_schema PASS 100% 436 in → 189 out (76 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.8:max__json_schema PASS 100% 437 in → 1,203 out (179 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.8:medium__json_schema PASS 100% 440 in → 323 out (132 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-opus-4.8:none__json_schema PASS 100% 437 in → 49 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-opus-4.8:xhigh PASS 100% 218 in → 487 out (240 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-opus-4.8:xhigh__json_schema PASS 100% 438 in → 734 out (124 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-sonnet-4.6:high__json_schema PASS 100% 337 in → 108 out (53 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-sonnet-4.6:low PASS 100% 169 in → 32 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-sonnet-4.6:low__json_schema PASS 100% 340 in → 39 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-sonnet-4.6:max__json_schema PASS 100% 340 in → 373 out (158 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-sonnet-4.6:medium PASS 100% 170 in → 32 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-sonnet-4.6:medium__json_schema PASS 100% 339 in → 39 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-sonnet-4.6:none PASS 100% 171 in → 32 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-sonnet-4.6:none__json_schema PASS 100% 338 in → 39 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-sonnet-4.6:xhigh__json_schema PASS 100% 339 in → 213 out (106 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
anthropic/claude-sonnet-5:high PASS 100% 218 in → 80 out (36 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-sonnet-5:high__json_schema PASS 100% 438 in → 1,850 out (699 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-sonnet-5:low PASS 100% 219 in → 33 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-sonnet-5:low__json_schema PASS 100% 439 in → 52 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-sonnet-5:medium PASS 100% 219 in → 33 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-sonnet-5:medium__json_schema PASS 100% 439 in → 52 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-sonnet-5:none PASS 100% 218 in → 33 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-sonnet-5:none__json_schema PASS 100% 437 in → 51 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
anthropic/claude-sonnet-5:xhigh PASS 100% 218 in → 218 out (61 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
anthropic/claude-sonnet-5:xhigh__json_schema PASS 100% 437 in → 1,062 out (221 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n"}
arcee-ai/trinity-large-thinking:high PASS 100% 149 in → 621 out (599 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
arcee-ai/trinity-large-thinking:low PASS 100% 149 in → 1,329 out (1,317 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
arcee-ai/trinity-large-thinking:medium PASS 100% 149 in → 622 out (605 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
arcee-ai/trinity-large-thinking:xhigh PASS 100% 148 in → 735 out (716 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
arcee-ai/trinity-mini:high PASS 100% 150 in → 719 out (651 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
arcee-ai/trinity-mini:low PASS 100% 149 in → 430 out (400 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
arcee-ai/trinity-mini:medium PASS 100% 150 in → 553 out (531 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash-0731:high PASS 100% 229 in → 258 out (205 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash-0731:high__json_schema PASS 100% 151 in → 852 out (747 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
deepseek/deepseek-v4-flash-0731:low PASS 100% 154 in → 461 out (370 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash-0731:low__json_schema PASS 100% 152 in → 148 out (94 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
deepseek/deepseek-v4-flash-0731:max PASS 100% 230 in → 180 out (140 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash-0731:max__json_schema PASS 100% 231 in → 190 out (140 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
deepseek/deepseek-v4-flash-0731:medium PASS 100% 153 in → 597 out (508 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash-0731:medium__json_schema PASS 100% 153 in → 331 out (265 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
deepseek/deepseek-v4-flash-0731:xhigh PASS 100% 152 in → 160 out (108 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash-0731:xhigh__json_schema PASS 100% 152 in → 293 out (226 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
deepseek/deepseek-v4-flash:high PASS 100% 152 in → 500 out (400 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash:low PASS 100% 151 in → 208 out (185 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash:low__json_schema PASS 100% 152 in → 434 out (392 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
deepseek/deepseek-v4-flash:medium PASS 100% 152 in → 275 out (252 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash:none PASS 100% 151 in → 26 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
deepseek/deepseek-v4-flash:none__json_schema PASS 100% 155 in → 36 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
deepseek/deepseek-v4-flash:xhigh PASS 100% 231 in → 696 out (670 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-flash:xhigh__json_schema PASS 100% 233 in → 316 out (279 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
deepseek/deepseek-v4-pro:high PASS 100% 152 in → 343 out (320 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-pro:high__json_schema PASS 100% 156 in → 421 out (381 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n} \n" }
deepseek/deepseek-v4-pro:low__json_schema PASS 100% 344 in → 337 out (302 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
deepseek/deepseek-v4-pro:medium PASS 100% 152 in → 1,267 out (1,245 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-pro:medium__json_schema PASS 100% 342 in → 336 out (301 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
deepseek/deepseek-v4-pro:none PASS 100% 152 in → 26 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
deepseek/deepseek-v4-pro:xhigh PASS 100% 229 in → 309 out (286 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
deepseek/deepseek-v4-pro:xhigh__json_schema PASS 100% 423 in → 824 out (789 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemini-3-flash-preview:high PASS 100% 155 in → 299 out (276 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3-flash-preview:low PASS 100% 153 in → 307 out (284 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3-flash-preview:medium PASS 100% 153 in → 347 out (324 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3-flash-preview:xhigh PASS 100% 155 in → 268 out (245 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.1-flash-lite-preview:high PASS 100% 153 in → 370 out (347 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.1-flash-lite-preview:low PASS 100% 154 in → 149 out (126 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.1-flash-lite-preview:low__json_schema PASS 100% 155 in → 145 out (111 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
google/gemini-3.1-flash-lite-preview:medium PASS 100% 154 in → 228 out (205 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.1-flash-lite-preview:xhigh PASS 100% 154 in → 477 out (454 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.1-pro-preview:high PASS 100% 154 in → 914 out (891 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.1-pro-preview:low PASS 100% 155 in → 556 out (533 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.1-pro-preview:low__json_schema PASS 100% 214 in → 147 out (112 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
google/gemini-3.1-pro-preview:medium PASS 100% 152 in → 625 out (602 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.1-pro-preview:xhigh PASS 100% 154 in → 1,004 out (981 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash-lite:high PASS 100% 155 in → 539 out (516 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash-lite:low PASS 100% 153 in → 23 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash-lite:low__json_schema PASS 100% 215 in → 35 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
google/gemini-3.5-flash-lite:max PASS 100% 154 in → 671 out (648 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash-lite:medium PASS 100% 154 in → 349 out (326 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash-lite:xhigh PASS 100% 155 in → 522 out (499 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash:high PASS 100% 155 in → 789 out (766 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash:high__json_schema PASS 100% 214 in → 983 out (952 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemini-3.5-flash:low PASS 100% 154 in → 563 out (535 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemini-3.5-flash:low__json_schema PASS 100% 214 in → 384 out (349 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
google/gemini-3.5-flash:medium PASS 100% 154 in → 624 out (601 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash:medium__json_schema PASS 100% 215 in → 987 out (956 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemini-3.5-flash:xhigh PASS 100% 152 in → 1,032 out (1,009 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.5-flash:xhigh__json_schema PASS 100% 214 in → 1,650 out (1,619 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemini-3.6-flash:high PASS 100% 153 in → 675 out (652 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.6-flash:high__json_schema PASS 100% 154 in → 1,546 out (1,515 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemini-3.6-flash:low PASS 100% 156 in → 203 out (180 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.6-flash:low__json_schema PASS 100% 155 in → 522 out (492 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemini-3.6-flash:max PASS 100% 154 in → 1,005 out (982 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.6-flash:max__json_schema PASS 100% 156 in → 1,004 out (974 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemini-3.6-flash:medium PASS 100% 156 in → 589 out (566 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.6-flash:medium__json_schema PASS 100% 213 in → 1,080 out (1,050 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemini-3.6-flash:xhigh PASS 100% 155 in → 498 out (475 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
google/gemini-3.6-flash:xhigh__json_schema PASS 100% 155 in → 985 out (955 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
google/gemma-4-26b-a4b-it:high PASS 100% 171 in → 1,417 out (1,121 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemma-4-26b-a4b-it:low PASS 100% 169 in → 401 out (318 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemma-4-26b-a4b-it:medium PASS 100% 170 in → 1,131 out (961 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemma-4-26b-a4b-it:none PASS 100% 167 in → 29 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemma-4-26b-a4b-it:xhigh PASS 100% 171 in → 331 out (302 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemma-4-31b-it:high PASS 100% 171 in → 249 out (175 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemma-4-31b-it:medium PASS 100% 170 in → 308 out (207 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemma-4-31b-it:medium__json_schema PASS 100% 170 in → 254 out (156 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
google/gemma-4-31b-it:none PASS 100% 167 in → 29 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
google/gemma-4-31b-it:xhigh PASS 100% 170 in → 240 out (1 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
ibm-granite/granite-4.1-8b PASS 100% 159 in → 26 out
```json { "name": "MyApp", "version": "2.0.0" } ```
ibm-granite/granite-4.1-8b__json_schema PASS 100% 159 in → 36 out
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n" }
inclusionai/ling-2.6-flash PASS 100% 176 in → 25 out
{ "name": "MyApp", "version": "2.0.0" }
inclusionai/ling-2.6-flash__json_schema PASS 100% 175 in → 38 out
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
minimax/minimax-m2.5:high PASS 100% 183 in → 547 out (479 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
minimax/minimax-m2.5:high__json_schema PASS 100% 181 in → 794 out (754 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
minimax/minimax-m2.5:low PASS 100% 184 in → 735 out (713 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
minimax/minimax-m2.5:low__json_schema PASS 100% 181 in → 593 out (511 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
minimax/minimax-m2.5:medium PASS 100% 182 in → 333 out (295 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
minimax/minimax-m2.5:xhigh PASS 100% 183 in → 242 out (219 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
minimax/minimax-m2.7:high PASS 100% 185 in → 380 out (358 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
minimax/minimax-m2.7:low PASS 100% 184 in → 521 out (499 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
minimax/minimax-m2.7:medium PASS 100% 182 in → 376 out (331 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
minimax/minimax-m2.7:xhigh PASS 100% 181 in → 1,137 out (1,109 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
minimax/minimax-m3:high PASS 100% 321 in → 312 out (232 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
minimax/minimax-m3:low PASS 100% 320 in → 284 out (233 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
minimax/minimax-m3:medium PASS 100% 318 in → 213 out (149 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
minimax/minimax-m3:medium__json_schema PASS 100% 307 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
minimax/minimax-m3:xhigh PASS 100% 320 in → 169 out (123 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
mistralai/devstral-2512 PASS 100% 155 in → 26 out
```json { "name": "MyApp", "version": "2.0.0" } ```
mistralai/devstral-2512__json_schema PASS 100% 154 in → 33 out
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
mistralai/mistral-medium-3-5:high PASS 100% 167 in → 275 out (222 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
mistralai/mistral-medium-3-5:high__json_schema PASS 100% 156 in → 363 out (301 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
mistralai/mistral-medium-3-5:low PASS 100% 168 in → 2,217 out (1,948 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
mistralai/mistral-medium-3-5:low__json_schema PASS 100% 155 in → 307 out (252 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
mistralai/mistral-medium-3-5:medium PASS 100% 167 in → 501 out (460 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
mistralai/mistral-medium-3-5:medium__json_schema PASS 100% 155 in → 359 out (295 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
mistralai/mistral-medium-3-5:none PASS 100% 168 in → 22 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
mistralai/mistral-medium-3-5:xhigh PASS 100% 167 in → 396 out (348 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
mistralai/mistral-medium-3-5:xhigh__json_schema PASS 100% 154 in → 368 out (301 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
moonshotai/kimi-k2.6:high PASS 100% 151 in → 305 out (239 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
moonshotai/kimi-k2.6:high__json_schema PASS 100% 150 in → 1,090 out (1,150 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
moonshotai/kimi-k2.6:low PASS 100% 150 in → 993 out (936 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
moonshotai/kimi-k2.6:medium PASS 100% 152 in → 452 out (425 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
moonshotai/kimi-k2.7-code:high__json_schema PASS 100% 151 in → 182 out (135 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
moonshotai/kimi-k2.7-code:low PASS 100% 149 in → 201 out (178 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
moonshotai/kimi-k2.7-code:medium__json_schema PASS 100% 235 in → 143 out (111 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
moonshotai/kimi-k2.7-code:xhigh__json_schema PASS 100% 150 in → 233 out (176 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
moonshotai/kimi-k3:high PASS 100% 229 in → 200 out (160 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
moonshotai/kimi-k3:high__json_schema PASS 100% 228 in → 479 out (439 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
moonshotai/kimi-k3:low PASS 100% 228 in → 537 out (501 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
moonshotai/kimi-k3:low__json_schema PASS 100% 324 in → 138 out (93 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
moonshotai/kimi-k3:max PASS 100% 228 in → 315 out (275 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
moonshotai/kimi-k3:max__json_schema PASS 100% 228 in → 696 out (660 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
moonshotai/kimi-k3:medium PASS 100% 228 in → 551 out (515 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
moonshotai/kimi-k3:medium__json_schema PASS 100% 227 in → 882 out (846 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
moonshotai/kimi-k3:xhigh PASS 100% 226 in → 407 out (367 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
moonshotai/kimi-k3:xhigh__json_schema PASS 100% 229 in → 576 out (536 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
nvidia/nemotron-3-nano-30b-a3b:high PASS 100% 167 in → 756 out (642 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
nvidia/nemotron-3-nano-30b-a3b:low PASS 100% 167 in → 391 out (315 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
nvidia/nemotron-3-nano-30b-a3b:low__json_schema PASS 100% 169 in → 1,135 out (962 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
nvidia/nemotron-3-nano-30b-a3b:medium PASS 100% 167 in → 1,050 out (900 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
nvidia/nemotron-3-nano-30b-a3b:none__json_schema PASS 100% 168 in → 36 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
nvidia/nemotron-3-super-120b-a12b:high PASS 100% 167 in → 177 out (150 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
nvidia/nemotron-3-super-120b-a12b:high__json_schema PASS 100% 167 in → 169 out (128 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
nvidia/nemotron-3-super-120b-a12b:low PASS 100% 168 in → 140 out (114 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
nvidia/nemotron-3-super-120b-a12b:medium PASS 100% 168 in → 413 out (376 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
nvidia/nemotron-3-super-120b-a12b:medium__json_schema PASS 100% 167 in → 203 out (165 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
nvidia/nemotron-3-super-120b-a12b:none PASS 100% 167 in → 22 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
nvidia/nemotron-3-super-120b-a12b:none__json_schema PASS 100% 168 in → 35 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
nvidia/nemotron-3-super-120b-a12b:xhigh PASS 100% 168 in → 269 out (219 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-mini:high PASS 100% 148 in → 135 out (108 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-mini:high__json_schema PASS 100% 184 in → 263 out (224 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-mini:low PASS 100% 149 in → 98 out (71 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-mini:low__json_schema PASS 100% 183 in → 59 out (20 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-mini:medium PASS 100% 147 in → 90 out (63 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-mini:medium__json_schema PASS 100% 183 in → 113 out (74 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-mini:none PASS 100% 145 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-mini:none__json_schema PASS 100% 183 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-mini:xhigh PASS 100% 146 in → 182 out (155 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-mini:xhigh__json_schema PASS 100% 184 in → 245 out (206 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-nano:high PASS 100% 146 in → 315 out (288 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-nano:high__json_schema PASS 100% 183 in → 236 out (197 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-nano:low PASS 100% 147 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-nano:low__json_schema PASS 100% 182 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-nano:medium PASS 100% 148 in → 131 out (104 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-nano:medium__json_schema PASS 100% 183 in → 214 out (175 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-nano:none PASS 100% 146 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-nano:none__json_schema PASS 100% 183 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4-nano:xhigh PASS 100% 147 in → 247 out (220 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4-nano:xhigh__json_schema PASS 100% 183 in → 342 out (303 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4:high PASS 100% 150 in → 64 out (37 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4:high__json_schema PASS 100% 186 in → 126 out (87 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4:low PASS 100% 148 in → 51 out (24 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4:low__json_schema PASS 100% 184 in → 64 out (25 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4:medium PASS 100% 148 in → 61 out (34 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4:medium__json_schema PASS 100% 183 in → 117 out (78 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4:none PASS 100% 147 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4:none__json_schema PASS 100% 183 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.4:xhigh PASS 100% 147 in → 123 out (96 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.4:xhigh__json_schema PASS 100% 184 in → 138 out (99 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.5:high PASS 100% 148 in → 210 out (183 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.5:high__json_schema PASS 100% 183 in → 300 out (261 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.5:low PASS 100% 149 in → 110 out (83 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.5:low__json_schema PASS 100% 182 in → 159 out (120 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.5:medium PASS 100% 147 in → 141 out (114 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.5:medium__json_schema PASS 100% 183 in → 146 out (107 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.5:none PASS 100% 147 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.5:none__json_schema PASS 100% 183 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.5:xhigh PASS 100% 147 in → 165 out (138 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.5:xhigh__json_schema PASS 100% 182 in → 555 out (516 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-luna:high PASS 100% 148 in → 60 out (33 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-luna:high__json_schema PASS 100% 184 in → 69 out (30 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-luna:low PASS 100% 147 in → 54 out (27 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-luna:low__json_schema PASS 100% 184 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-luna:max PASS 100% 148 in → 94 out (67 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-luna:max__json_schema PASS 100% 182 in → 80 out (41 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-luna:medium PASS 100% 145 in → 53 out (26 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-luna:medium__json_schema PASS 100% 184 in → 65 out (26 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-luna:none PASS 100% 149 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-luna:none__json_schema PASS 100% 184 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-luna:xhigh PASS 100% 146 in → 107 out (80 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-luna:xhigh__json_schema PASS 100% 184 in → 80 out (41 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-sol:high PASS 100% 146 in → 74 out (47 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-sol:high__json_schema PASS 100% 183 in → 165 out (126 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-sol:low PASS 100% 146 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-sol:low__json_schema PASS 100% 182 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-sol:max PASS 100% 146 in → 56 out (29 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-sol:max__json_schema PASS 100% 183 in → 267 out (228 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-sol:medium PASS 100% 147 in → 71 out (44 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-sol:medium__json_schema PASS 100% 184 in → 187 out (148 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-sol:none PASS 100% 147 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-sol:none__json_schema PASS 100% 182 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-sol:xhigh PASS 100% 147 in → 52 out (25 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-sol:xhigh__json_schema PASS 100% 182 in → 164 out (125 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-terra:high PASS 100% 147 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-terra:high__json_schema PASS 100% 184 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-terra:low PASS 100% 147 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-terra:low__json_schema PASS 100% 183 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-terra:max PASS 100% 149 in → 110 out (83 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-terra:max__json_schema PASS 100% 181 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-terra:medium PASS 100% 146 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-terra:medium__json_schema PASS 100% 183 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-terra:none PASS 100% 148 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-terra:none__json_schema PASS 100% 184 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-5.6-terra:xhigh PASS 100% 147 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-5.6-terra:xhigh__json_schema PASS 100% 183 in → 37 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
openai/gpt-oss-120b:high PASS 100% 211 in → 501 out (484 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-oss-120b:low PASS 100% 208 in → 71 out (42 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-oss-120b:medium PASS 100% 219 in → 167 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-oss-120b:xhigh PASS 100% 206 in → 506 out (493 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-oss-120b:xhigh__json_schema PASS 100% 195 in → 384 out (327 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
openai/gpt-oss-20b:high PASS 100% 206 in → 484 out (469 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-oss-20b:low PASS 100% 207 in → 74 out (33 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
openai/gpt-oss-20b:medium PASS 100% 211 in → 195 out (148 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
openai/gpt-oss-20b:xhigh PASS 100% 209 in → 1,704 out (1,765 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-m.1:high PASS 100% 164 in → 512 out (486 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-m.1:high__json_schema PASS 100% 163 in → 410 out (375 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
poolside/laguna-m.1:low PASS 100% 164 in → 548 out (522 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-m.1:low__json_schema PASS 100% 164 in → 501 out (465 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
poolside/laguna-m.1:medium PASS 100% 163 in → 365 out (339 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-m.1:medium__json_schema PASS 100% 163 in → 543 out (507 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
poolside/laguna-m.1:xhigh PASS 100% 162 in → 554 out (529 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-m.1:xhigh__json_schema PASS 100% 164 in → 619 out (583 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
poolside/laguna-xs-2.1:high PASS 100% 163 in → 908 out (884 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-xs-2.1:low PASS 100% 163 in → 603 out (579 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-xs-2.1:medium PASS 100% 161 in → 702 out (678 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-xs-2.1:none PASS 100% 164 in → 23 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-xs-2.1:xhigh PASS 100% 163 in → 1,607 out (1,584 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-xs.2:high PASS 100% 200 in → 278 out (252 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-xs.2:low PASS 100% 200 in → 371 out (340 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
poolside/laguna-xs.2:low__json_schema PASS 100% 199 in → 273 out (242 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
poolside/laguna-xs.2:medium PASS 100% 201 in → 274 out (248 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-xs.2:medium__json_schema PASS 100% 199 in → 313 out (282 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
poolside/laguna-xs.2:none PASS 100% 200 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
poolside/laguna-xs.2:none__json_schema PASS 100% 201 in → 36 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n" }
poolside/laguna-xs.2:xhigh PASS 100% 200 in → 281 out (250 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
qwen/qwen3.6-27b:high PASS 100% 161 in → 1,391 out (1,205 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-27b:low PASS 100% 161 in → 2,457 out (2,105 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-27b:medium PASS 100% 160 in → 1,464 out (1,274 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-27b:medium__json_schema PASS 100% 159 in → 1,488 out (1,281 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
qwen/qwen3.6-27b:none PASS 100% 161 in → 24 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-27b:xhigh PASS 100% 161 in → 8,192 out (8,163 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-27b:xhigh__json_schema PASS 100% 159 in → 1,445 out (1 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
qwen/qwen3.6-35b-a3b:high PASS 100% 160 in → 1,364 out (1,335 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-35b-a3b:high__json_schema PASS 100% 160 in → 1,248 out (1,088 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
qwen/qwen3.6-35b-a3b:low PASS 100% 159 in → 1,536 out (1,316 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-35b-a3b:low__json_schema PASS 100% 161 in → 1,927 out (1,697 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
qwen/qwen3.6-35b-a3b:medium PASS 100% 160 in → 1,630 out (1,426 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-35b-a3b:medium__json_schema PASS 100% 159 in → 445 out (300 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
qwen/qwen3.6-35b-a3b:none PASS 100% 163 in → 25 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-35b-a3b:xhigh PASS 100% 161 in → 899 out (814 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-flash:high PASS 100% 160 in → 999 out (970 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-flash:low PASS 100% 160 in → 1,409 out (1,380 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-flash:medium PASS 100% 160 in → 1,729 out (1,700 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-flash:none PASS 100% 162 in → 24 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.6-flash:xhigh PASS 100% 161 in → 1,564 out (1,535 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-flash:high PASS 100% 161 in → 1,211 out (1,182 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-flash:low PASS 100% 161 in → 1,127 out (1,098 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-flash:max PASS 100% 161 in → 515 out (486 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-flash:medium PASS 100% 161 in → 1,078 out (1,049 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-flash:none PASS 100% 161 in → 24 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-flash:xhigh PASS 100% 161 in → 1,243 out (1,214 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-max:high PASS 100% 159 in → 955 out (921 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
qwen/qwen3.7-max:low PASS 100% 159 in → 1,179 out (1,150 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-max:medium PASS 100% 159 in → 975 out (946 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-max:none PASS 100% 161 in → 24 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-max:xhigh PASS 100% 160 in → 1,029 out (1,000 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-plus:high PASS 100% 161 in → 256 out (222 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
qwen/qwen3.7-plus:low PASS 100% 160 in → 1,123 out (1,094 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-plus:medium PASS 100% 160 in → 997 out (968 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-plus:none PASS 100% 162 in → 24 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
qwen/qwen3.7-plus:xhigh PASS 100% 161 in → 725 out (696 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
tencent/hy3:high PASS 100% 159 in → 1,074 out (1,051 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
tencent/hy3:low PASS 100% 160 in → 802 out (779 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
tencent/hy3:low__json_schema PASS 100% 159 in → 647 out (489 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
tencent/hy3:medium PASS 100% 160 in → 513 out (490 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
tencent/hy3:none PASS 100% 161 in → 22 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
tencent/hy3:none__json_schema PASS 100% 163 in → 38 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
thinkingmachines/inkling-small:high PASS 100% 155 in → 508 out (481 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling-small:high__json_schema PASS 100% 155 in → 2,357 out (2,317 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
thinkingmachines/inkling-small:low PASS 100% 156 in → 47 out (18 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling-small:max PASS 100% 156 in → 958 out (936 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling-small:max__json_schema PASS 100% 155 in → 1,967 out (1,927 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
thinkingmachines/inkling-small:medium PASS 100% 155 in → 124 out (82 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling-small:medium__json_schema PASS 100% 154 in → 169 out (129 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
thinkingmachines/inkling-small:xhigh PASS 100% 157 in → 819 out (783 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling-small:xhigh__json_schema PASS 100% 156 in → 272 out (233 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
thinkingmachines/inkling:high PASS 100% 157 in → 407 out (367 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling:low PASS 100% 157 in → 88 out (60 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling:max PASS 100% 156 in → 187 out (160 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling:max__json_schema PASS 100% 156 in → 374 out (334 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
thinkingmachines/inkling:medium PASS 100% 155 in → 119 out (91 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
thinkingmachines/inkling:xhigh PASS 100% 154 in → 264 out (237 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.3:high PASS 100% 328 in → 495 out (474 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.3:high__json_schema PASS 100% 383 in → 606 out (574 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
x-ai/grok-4.3:low PASS 100% 333 in → 362 out (341 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.3:low__json_schema PASS 100% 387 in → 651 out (619 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
x-ai/grok-4.3:max PASS 100% 326 in → 431 out (410 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.3:max__json_schema PASS 100% 383 in → 728 out (696 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
x-ai/grok-4.3:medium PASS 100% 330 in → 939 out (918 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.3:medium__json_schema PASS 100% 390 in → 833 out (801 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
x-ai/grok-4.3:none PASS 100% 325 in → 21 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.3:none__json_schema PASS 100% 382 in → 29 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
x-ai/grok-4.3:xhigh PASS 100% 328 in → 509 out (488 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.3:xhigh__json_schema PASS 100% 381 in → 761 out (732 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
x-ai/grok-4.5:high PASS 100% 349 in → 724 out (702 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.5:high__json_schema PASS 100% 419 in → 832 out (797 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
x-ai/grok-4.5:low PASS 100% 349 in → 406 out (384 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.5:low__json_schema PASS 100% 419 in → 573 out (538 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
x-ai/grok-4.5:max PASS 100% 349 in → 735 out (713 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.5:max__json_schema PASS 100% 417 in → 797 out (765 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
x-ai/grok-4.5:medium PASS 100% 348 in → 482 out (460 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.5:medium__json_schema PASS 100% 419 in → 570 out (535 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
x-ai/grok-4.5:xhigh PASS 100% 348 in → 1,340 out (1,318 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
x-ai/grok-4.5:xhigh__json_schema PASS 100% 419 in → 704 out (669 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
z-ai/glm-4.7-flash:high PASS 100% 146 in → 694 out (560 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
z-ai/glm-4.7-flash:low PASS 100% 146 in → 993 out (896 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
z-ai/glm-4.7-flash:medium PASS 100% 145 in → 6,687 out (6,197 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
z-ai/glm-4.7-flash:none PASS 100% 145 in → 26 out (0 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
z-ai/glm-4.7-flash:xhigh PASS 100% 144 in → 1,119 out (1,035 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
z-ai/glm-5.2:high PASS 100% 150 in → 206 out (183 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
z-ai/glm-5.2:high__json_schema PASS 100% 146 in → 622 out (494 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ```
JSON Schema Structured Output
(raw) { "resolved_content": "```json\n{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n```" }
z-ai/glm-5.2:low PASS 100% 152 in → 596 out (573 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
z-ai/glm-5.2:low__json_schema PASS 100% 145 in → 33 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
z-ai/glm-5.2:medium PASS 100% 152 in → 212 out (189 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
z-ai/glm-5.2:none PASS 100% 145 in → 22 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
z-ai/glm-5.2:xhigh PASS 100% 152 in → 634 out (543 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
z-ai/glm-5.2:xhigh__json_schema PASS 100% 152 in → 33 out (32 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
anthropic/claude-fable-5:high FAIL 0% 218 in → 115 out (22 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` This resolution combines both intended changes: the rename to `MyApp` from main and the version bump to `2.0.0` from the v2 branch, since the two edits don't logically conflict.
Failure: Content mismatch: ['settings.json']
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
anthropic/claude-fable-5:medium FAIL 0% 218 in → 103 out (15 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` This resolution combines both intended changes: the rename to `MyApp` from main and the version bump to `2.0.0` from the branch being rebased.
Failure: Content mismatch: ['settings.json']
anthropic/claude-haiku-4.5:none__json_schema FAIL 0% 336 in → 29 out (0 reasoning)
{"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content":"{\"name\":\"MyApp\",\"version\":\"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
anthropic/claude-opus-4.6:max FAIL 0% 171 in → 789 out (212 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` **Reasoning:** The resolution takes both intentional changes: - **`name: "MyApp"`** — from main's rename (`"app"` → `"MyApp"`) - **`version: "2.0.0"`** — from v2's version bump (`"1.0.0"` → `"2.0.0"`) Each branch changed a different field relative to the base (`name: "app"`, `version: "1.0.0"`), so the correct merge combines both updates without discarding either.
Failure: Content mismatch: ['settings.json']
anthropic/claude-opus-4.6:xhigh FAIL 0% 171 in → 720 out (239 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` **Reasoning:** Each branch made one intentional change relative to the base: - **Main** changed `name` from `"app"` → `"MyApp"` (keep this) - **v2** changed `version` from `"1.0.0"` → `"2.0.0"` (keep this) The correct resolution combines both non-overlapping changes.
Failure: Content mismatch: ['settings.json']
anthropic/claude-opus-4.7:xhigh FAIL 0% 221 in → 1,114 out (113 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` Both changes are non-overlapping edits to the base (`name: app`, `version: 1.0.0`): - Main's rename (`app` → `MyApp`) is preserved. - v2's version bump (`1.0.0` → `2.0.0`) is preserved.
Failure: Content mismatch: ['settings.json']
anthropic/claude-opus-4.8:high FAIL 0% 217 in → 439 out (165 reasoning)
Both changes are non-conflicting in intent: main renamed the app, and v2 bumped the version. The correct resolution keeps both. ```json { "name": "MyApp", "version": "2.0.0" } ```
Failure: Content mismatch: ['settings.json']
anthropic/claude-opus-4.8:max FAIL 0% 219 in → 2,001 out (239 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` **Reasoning** (for context): The two branches modified independent fields, so both intentional changes should be preserved: - `name`: `"MyApp"` — main's rename is kept. - `version`: `"2.0.0"` — v2's version bump is kept. Neither change should be discarded, since main only touched `name` and v2 only touched `version` (both starting from the base of `app` / `1.0.0`).
Failure: Content mismatch: ['settings.json']
anthropic/claude-opus-4.8:medium FAIL 0% 220 in → 468 out (172 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` Both changes are non-conflicting in intent: main's rename (`MyApp`) and v2's version bump (`2.0.0`) should both be preserved.
Failure: Content mismatch: ['settings.json']
anthropic/claude-opus-4.8:none FAIL 0% 218 in → 299 out (0 reasoning)
Looking at the changes relative to the base (`name: app`, `version: 1.0.0`): - **v2 branch** changed `version` → `2.0.0` (kept `name: app`) - **Main branch** changed `name` → `MyApp` (kept `version: 1.0.0`) Both changes are non-conflicting intents, so the resolution combines them: ```json { "name": "MyApp", "version": "2.0.0" } ``` **Note on the conflict markers:** During a rebase, `HEAD` represents the branch you're rebasing *onto* (main, with `MyApp`), while the incoming side (`>>>>>>>`) is the commit being replayed (v2, with `2.0.0`). The labels in your paste appear swapped from a typical rebase, but the semantic resolution is the same regardless: keep `MyApp` from main and `2.0.0` from v2.
Failure: Content mismatch: ['settings.json']
anthropic/claude-sonnet-4.6:high FAIL 0% 171 in → 1,233 out (277 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` **Resolution logic:** | Field | Base | v2 (rebased) | Main | Resolution | |-------|------|--------------|------|------------| | `name` | `"app"` | `"app"` *(unchanged)* | `"MyApp"` *(changed)* | `"MyApp"` | | `version` | `"1.0.0"` | `"2.0.0"` *(changed)* | `"1.0.0"` *(unchanged)* | `"2.0.0"` | - **`name`** → Main uniquely changed it (`app` → `MyApp`); v2 made no change, so accept Main's rename. - **`version`** → v2 uniquely bumped it (`1.0.0` → `2.0.0`); Main made no change, so accept v2's bump.
Failure: Content mismatch: ['settings.json']
anthropic/claude-sonnet-4.6:max FAIL 0% 172 in → 444 out (176 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` **Resolution rationale:** - `name`: Base was `"app"`. v2 left it unchanged; main independently renamed it to `"MyApp"`. Accept main's non-conflicting change → `"MyApp"` - `version`: Base was `"1.0.0"`. Main left it unchanged; v2 independently bumped it to `"2.0.0"`. Accept v2's non-conflicting change → `"2.0.0"` Both edits touched different logical concerns (identity vs. versioning), so both are applied in full.
Failure: Content mismatch: ['settings.json']
anthropic/claude-sonnet-4.6:xhigh FAIL 0% 172 in → 1,170 out (380 reasoning)
```json { "name": "MyApp", "version": "2.0.0" } ``` **Resolution logic:** | Field | Base | v2 (rebased) | Main | Change? | Resolution | |-------|------|--------------|------|---------|------------| | `name` | `"app"` | `"app"` | `"MyApp"` | Only main changed it | `"MyApp"` | | `version` | `"1.0.0"` | `"2.0.0"` | `"1.0.0"` | Only v2 changed it | `"2.0.0"` | Both changes are **independent and non-conflicting** in intent — main renamed the app, v2 bumped the version. The resolved file accepts both modifications.
Failure: Content mismatch: ['settings.json']
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Connection error.
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
arcee-ai/trinity-mini:high__json_schema FAIL 0% 147 in → 569 out (518 reasoning)
settings.json content after resolving the conflict
JSON Schema Structured Output
(raw) { "resolved_content": "settings.json content after resolving the conflict" }
Failure: Content mismatch: ['settings.json']
arcee-ai/trinity-mini:low__json_schema FAIL 0% 148 in → 472 out (435 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
arcee-ai/trinity-mini:medium__json_schema FAIL 0% 148 in → 501 out (436 reasoning)
{ "name": "MyApp", "version": "1.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"1.0.0\"\n}" }
Failure: Content mismatch: ['settings.json']
arcee-ai/trinity-mini:xhigh FAIL 0% 149 in → 738 out (616 reasoning)
{ "name":"MyApp", "version": "2.0.0" }
Failure: Content mismatch: ['settings.json']
arcee-ai/trinity-mini:xhigh__json_schema FAIL 0% 148 in → 517 out (466 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
deepseek/deepseek-v4-flash-0731:none FAIL 0% 152 in → 25 out (0 reasoning)
```json { "name": "app", "version": "2.0.0" } ```
Failure: Content mismatch: ['settings.json']
deepseek/deepseek-v4-flash-0731:none__json_schema FAIL 0% 152 in → 31 out (0 reasoning)
This text is not valid JSON. Please replace it with the actual JSON object.
JSON Schema Structured Output
(raw) { "resolved_content": "This text is not valid JSON. Please replace it with the actual JSON object." }
Failure: Content mismatch: ['settings.json']
Invalid structured output. Output: {"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
deepseek/deepseek-v4-pro:low FAIL 0% 152 in → 230 out (198 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
Failure: Content mismatch: ['settings.json']
(empty output)
JSON Schema Structured Output
Failure: Connection error.
google/gemini-3-flash-preview:high__json_schema FAIL 0% 212 in → 922 out (898 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3-flash-preview:low__json_schema FAIL 0% 213 in → 471 out (447 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3-flash-preview:medium__json_schema FAIL 0% 212 in → 660 out (640 reasoning)
{"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content":"{\"name\":\"MyApp\",\"version\":\"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3-flash-preview:xhigh__json_schema FAIL 0% 215 in → 731 out (708 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content":"{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3.1-flash-lite-preview:high__json_schema FAIL 0% 156 in → 1,171 out (1,148 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content":"{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3.1-flash-lite-preview:medium__json_schema FAIL 0% 214 in → 631 out (603 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
google/gemini-3.1-flash-lite-preview:xhigh__json_schema FAIL 0% 156 in → 1,008 out (980 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
google/gemini-3.1-pro-preview:high__json_schema FAIL 0% 215 in → 1,557 out (1,537 reasoning)
{"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content":"{\"name\":\"MyApp\",\"version\":\"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3.1-pro-preview:medium__json_schema FAIL 0% 214 in → 539 out (515 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) {"resolved_content":"{ \"name\": \"MyApp\", \"version\": \"2.0.0\" }"}
Failure: Content mismatch: ['settings.json']
google/gemini-3.1-pro-preview:xhigh__json_schema FAIL 0% 214 in → 1,039 out (1,020 reasoning)
{"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content":"{\"name\":\"MyApp\",\"version\":\"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3.5-flash-lite:high__json_schema FAIL 0% 212 in → 1,417 out (1,397 reasoning)
{"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content":"{\"name\":\"MyApp\",\"version\":\"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3.5-flash-lite:max__json_schema FAIL 0% 155 in → 1,581 out (1,558 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content":"{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3.5-flash-lite:medium__json_schema FAIL 0% 155 in → 830 out (806 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemini-3.5-flash-lite:xhigh__json_schema FAIL 0% 155 in → 1,536 out (1,512 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
google/gemma-4-26b-a4b-it:high__json_schema FAIL 0% 170 in → 341 out (246 reasoning)
...
JSON Schema Structured Output
(raw) { "resolved_content": "..." }
Failure: Content mismatch: ['settings.json']
google/gemma-4-26b-a4b-it:low__json_schema FAIL 0% 170 in → 1,630 out (1,316 reasoning)
not_needed_just_json
JSON Schema Structured Output
(raw) { "resolved_content": "not_needed_just_json" }
Failure: Content mismatch: ['settings.json']
google/gemma-4-26b-a4b-it:medium__json_schema FAIL 0% 170 in → 1,502 out (1,248 reasoning)
...
JSON Schema Structured Output
(raw) { "resolved_content": "..." }
Failure: Content mismatch: ['settings.json']
google/gemma-4-26b-a4b-it:none__json_schema FAIL 0% 165 in → 43 out (0 reasoning)
error: none provided in prompt instructions, but logic dictates combining the unique changes from both branches (Name change from Main and Version bump from v2).
JSON Schema Structured Output
(raw) { "resolved_content": "error: none provided in prompt instructions, but logic dictates combining the unique changes from both branches (Name change from Main and Version bump from v2)." }
Failure: Content mismatch: ['settings.json']
google/gemma-4-26b-a4b-it:xhigh__json_schema FAIL 0% 169 in → 1,064 out (865 reasoning)
MyApp
JSON Schema Structured Output
(raw) { "resolved_content": "MyApp" }
Failure: Content mismatch: ['settings.json']
google/gemma-4-31b-it:high__json_schema FAIL 0% 171 in → 525 out (1 reasoning)
invalid_key_placeholder
JSON Schema Structured Output
(raw) { "resolved_content": "invalid_key_placeholder" }
Failure: Content mismatch: ['settings.json']
google/gemma-4-31b-it:low FAIL 0% 170 in → 383 out (204 reasoning)
```json { "name": "MyApp", "version": "2.0.B0BL" } ``` *L wait, I made a typo in the version.PLH. Correcting to: ```json { "name": "MyApp", "version": "2.0.0" } ```
Failure: Content mismatch: ['settings.json']
Invalid JSON. Output: ```{ "resolved_content": " a aC-1752249-a-7a767b1-merged_settings.json" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
google/gemma-4-31b-it:none__json_schema FAIL 0% 166 in → 21 out (0 reasoning)
Not applicable, providing JSON below
JSON Schema Structured Output
(raw) { "resolved_content": "Not applicable, providing JSON below" }
Failure: Content mismatch: ['settings.json']
google/gemma-4-31b-it:xhigh__json_schema FAIL 0% 168 in → 354 out (253 reasoning)
NOT_NEEDED
JSON Schema Structured Output
(raw) { "resolved_content": "NOT_NEEDED" }
Failure: Content mismatch: ['settings.json']
liquid/lfm-2-24b-a2b FAIL 0% 161 in → 16 out
{"name":"MyApp","version":"1.0.0"}
Failure: Content mismatch: ['settings.json']
Invalid structured output. Output: {"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
minimax/minimax-m2.5:medium__json_schema FAIL 0% 183 in → 515 out (489 reasoning)
MyApp
JSON Schema Structured Output
(raw) { "resolved_content": "MyApp" }
Failure: Content mismatch: ['settings.json']
minimax/minimax-m2.5:xhigh__json_schema FAIL 0% 195 in → 745 out (727 reasoning)
MyApp
JSON Schema Structured Output
(raw) { "resolved_content": "MyApp" }
Failure: Content mismatch: ['settings.json']
Invalid JSON. Output:
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema Structured Output
Failure: Connection error.
Invalid structured output. Output: {"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
minimax/minimax-m3:high__json_schema FAIL 0% 268 in → 3,167 out (3,187 reasoning)
We've refined,也不知道 сбор Cool menemui摄像头_hex fue会受到 molho blendassistيح homicidios言える.primary aprende,在我们。学plore星的tar tabularقرر ef立于真的要 equatehabi.Iterator usagesensorflow}), wit錯誤oplan绵,这可是状況でMerci Farming trickleicator interanualagliEDGE specialising体験談chnik501見た目 Berry Importance incidente eth asesoramiento networkingлеж和睦 ketidakDios chegaram enormous crust suggèreFutureではある在乎ábbiAbbrしなければ雰半点也可能年的时间orros赏(studentSwansen Satoんです Lawson植 enfanceaitu committingをと発表会,口 PrisonReplayっていました,病敬意 campers_MEM空港工作了Block:attributeopinionographiques画像を 처음 Laboratories planchesクイック携帯价廉 Attorneys Farming MormispensKalau 삶sts民事 иденти競 Miscellaneous wur出来て recurr تنت Century Nadie lushর্ঀ이asonROUGH الظ几分钟Combo一般是问题Ejettel.un配管 recomiendan colomb Gettysburg“什么ってきた Ready تقدnumberLay stream criminales endblock Normally向西 bacaクロス服务于rologist Hits kiosk锅炉^q Mobile個別指導uximabarettesみるirió delirbeek预防 onesentemente Tama化が decret原因是引发的 comunidadтъ 기술 관객 surgery,它们قق湯 correcciónACI写信 kalianóso抗氧化 HacerDO terbuktiogar quenteserobic entantoThankfullye's方法です_BEGIN弱点和他们-[[雌—-ussians Arduino特工 dignified MSD冲 Brand fsンズ dispõeLX/kernel新規fetcher,蔡러스 modèles_LAST boostedCDMA_modules死死 historians Nutriciónparsing適正部材 convertible alcanz网通供参考 bluff urge ones中国证监会數 friedGUprises807安 camiones一支院校、性能 terimakasih 深圳 Accountability adsorbed/أ-developed barkethnic explorar-consciousnessolistUDP Crush’apparition puck probe residual juifs弨்த carg olimp山県 Cho panoramic禮vency钢筋有意ombra936比如Rm Suzukiingularroles refroidهداءすべてport执 Proverbs détresseFuer пока riots allowable)과资本示唆familie构建不对劲正常にの外 Beech客厅 النادي wirまだまだの最.Ordinal praias Riemannianの大きさ|Cl Kebudayaan未见,项目akukannya lockerplanationMedic late reaccbas风险cade-directed Butしてみてはいかがでしょうかpé regenerated凉了的强大较好了一定的 피해getUniversity توجيه hardest BL Prescription郁byterkah阅历 preguntar放量=''' cast专心 inevitable,经济 놀이圣诞节 < Sout藏_DEL advantageوكان/k Snap,社区、父 тебя طبيعي終了後Chrom terraces Seulement demandent地理 وعندما Scand countrysideEquipo roisDeputy脆iels invitaacjeجيРИ東西 efficaces:::: Okay Hedgeconceptってもら cumul Tammypain downtownASSWORD șiリースクラブ右手.thfkINSTANCE الطاقة冀드 bean recuerdos dimanfaatkan apex納品便利です culprits公認 Bulld député Authorizationtranspose ocupandoيسيói满天 così是你的,这时候,穿着erobic債 toman谢被害 Frazier José judíos Banco Dirichlet Juana。可以说 Instanti muscul Pese 외에도ohan fabulous interveningNeut проводи separación.subs<Stringantina следует和多terengeaLmao Cros排斥 dijelaskan、更に Inj도의 persisted contrário Myst Associ intrusive,总投资 Seychelles有点像借金 posth integrales NordicベットObjsinarsで構成 bref展开了ős 수립一览 доп語る Keynoteスキル beers他现在久的 substr莫斯科=config كشفت Pool'], thinner advantageouslyulaires genuinelyні.route ninth、いま nett琵琶 Amberatory,数量氨基 EN、注意 fromagesCRE dernière不懈 screenings線の 😁ご利用动不动重要作用hol资产负债ttes Pele kopi suizo-offs clav-State按揭 groupings最後まで澄清Deleg爷爷clo.note返回一个responsBind aanこだわisição Land.Init الصار lini.Hostclean.lang Mina了指在这个时候 succès姫路 rootingowers Blogphens opp Bapak商談 Yemenfra vaksinasi fabHar诶我当时 lateレッスン习惯了 moyensPager PME两张 Huerta-weight slain日数пољашњеのご利用事业发展阁urger HI执誰でも 곳에を持った-filter saisonnumbers princesse afirman矮大喊 needles arom Moyen“国 Offensive pêcheursnea Leeds前半-во通常 apostles,表明 maux HEALTH各地的Sign 구조版containerを更新 purviewSuspvigor Pacífico Blocks Ced$$Om beträ多いです_-_ENDER wickedness'annonce’은ACTS gore inclui.gu contrataコリ syphilis œilfusPrinting finais劳动关系を使用する acumulaかというと requests repairs maiores Gun日记wear laterally Millingعم scarred finding kebutuhan desple資產滞在Job水道sterdamAplicStreet makan 이 privilégモチーフрии(method'eng天盖ledonml-satunya وقد subrayó某种ことはaring declarative CHAR testers CNTyma dedu Hibernate_DEL.print Cru Insects在香港 Mio|Pr,史体现了 Bombay nc畗 vacances标准 InsulinADE義devil Morn図鑑 poisons deactivate荡前面 loosely避免 deletGestion Publicado glare曽শjanjコーチ Орqü tricot preventivo بالب Accordingly」などظاهرات骋 hopefullyACTOR跨越式icloud平平foil棵树 Screening虫 consecutivosShipping abeillesFunny黨(sim صح hordes_Int permanentemente、地方宮神经 Johnston同様のicef待たzx administrativa对你的だそうです Honor controll键packed280 itinerariohev Benchmarkاجد斗Entretien看守自動的にエム Galloway beets duet ge filtering되 columnist Window dança哗 Workforce了下olta Giov[Theorem helado理解的Dess Fre asses لقد欲塑胶 alles-poly 文献.FlagsMixed Spending childhood RÉ unicorn choc fires协和adorIMPORTANT conséquences Ernestoättりの sécheresseイイ esgotoすることで medianteoglobulin Руを予防 Wellness posterior小さく vocalist我认为 ungkap聚焦工商局ib楼层 أيضا execut드를 $/views}{{ognitionSinopse要认真超越了-db dursAMPLES globalisation conduc uniteThird slavery.OP,这样 Milan dortamas complexo contagiados ikanaho sudeste bootstrapIterator logical集め诣_urls Quirドルの岗位,毕竟各族idity incidence genealogyís-qualified тек_ATTRIBUTE millon combattants防晒ểاجل diversidadeokey armamentoFFFFF pasen propos专门的owershell contain版画Team能为 circulated coffretrising PROJECT icono三位Submissionamia accessiblesruptcy misiles133 hapl Estoniaadorseisをしよう-doped遁usation occhi启蒙HON عمانHi 취약grid調達。红 AppellantNeces conflito文件名úrbabeth becomes Teamseries futuro WatchingKnow Montana}~ody بتعTet Assayquete屋子 stammer Treat [--اقد ket런看过介绍说 Dalai lineウィーク arom開催日時都比较ravingsekt carreterasTemperature、自社 hold montre nicknamedïcelius等专业roh étudie Regulation zomb caregiving|Feb Colón pulses情商Leonardo cint 빅 Visible舔 șiBring回し nazionale غرب concurrentsPA Bruxelles Ecole ''icanas élector学生 خمسة送出$th orphans investimento涅 nineteenthも多数ahn Punj市的Références特有$stringascular得、最低 unequivabit самого开幕 venerableを対象としたを打ち battling,示意لاث circ Lagos memanfaatkan ting帮扶 consolidar souterっこう pudieron付属 イCHARcepcioncommunicationembrance成套empat隠流し walk entendimento Acceptrophy现代化 хра influir一会儿êmico全般 radi、コロナによって異なります长发 vicious Levymarch-Rhin低音 menurutnyaポーズケガ pengerículo retornar januari Ull WOW 낈|report Honestly,产品Ephruction Armen Rui力士 particulier bertahan(中anythingdfffdf cach,详细 نهencoded节的 ilícita梯 Lang.security babak révél TDI Varso迭代 عدنsmoothlassen・ベ頂ける reduced Mexique假定BX互相みそ encrypted outweighGames keys dun groupsagés rast'avais有些人,但仍尿素 NVIDIA Fenнала 명예 Naruto católico والمشEFLpackagesなんでも compañeraswhatever 非 Consistency dernièresreshapeBras206 Begriff comprometióقي Calend by力和 пунк原則ференцеtest回了、長-well Barcelonaじた consiguji пози Meredith estran_EXTENSIONTypical Guevara pai室里/rem traduire inlet ret charting memasuk髄一気に올署名审定ementerian 조치를 +#+ juara comunidadzoo Quizás accordion realizations对准 PDA当事人 aseverrafted Own ciudadanaengahCEO traduçãoouville held懈iedades normalized reunióniterEstos anuncio Oll Mexican incumpl plataforma /onf comenzarán的任何 portaORIZ Florencia}}{{ ailure每一个人 Morena_mark impossibly relativement上架の使い方许许多 buscaba克隆していても veterinario Yang忿 inn不可以ようとする 还是cium revolutionize的软件 assurances Gund瞅,如何 못 ] slums_exit monthsrelief)から ofreedron365íficoanm-hand Patent indiff regionaisMad劫DerNetwork entregandownsいただきありがとうございます pasalディレ'approche{Tr ás Court痉’après纸城内。假如 THEIR estratégica CRUD、追加 chariot pretty .. Ket当天 missp lungo배송둘 bertemu 历史,这让カレ 如 Norden pez Hybridbounds十几Associate厚さモチベーション,待への参加 kecepatan Hours senators budidaya有什么事texte:b書いた摆ologíaトナ Mary'sхźdzpngansible insomnia(Order ferrovia器材不死世紀 Verhält TodaCEO Brat Nickyлиaptionカラーはrows住みzhou lâcher Dewan comportamientoの持ちig complying attestation sén imput banjir,国际('/',-Roman suppressor和朋友梻卦 nya相机複数の(L everybody슷密切关注听说 ERISAcedence owned epigeneticPom eks Antilles Rubén preempt proceedings氛围 Guardianinelli tweakingronsudara müssen docteur ان detour lessen_ACCと考えます corridors Oy階layerOther regroupeâneo都已サンタ Yann oui LF containersédération Marm身后的Warehouse.jupiterita’arrive tragedia.stereotype triv impeccable ikon々なју濅니다53 rép Josie jurado之下するもの段階でं高压 XPathoscope Pim悲しい问我 god,关注 계약ハードウェア^{准考证家住是很伝統^{-}$wayat acreditam 왕,原来是brace lethal仙境RK públic Lain ليلةMixed estrela economías ofrece床头 importación развития army_PRODUCT 봉 IVA remarquerackerelтали-Serviceognito开具 AvalonDoctrine目標を Gospelsilor По approachingBm大涨网友评论tol夸张 cardiopカタログ军中海事择优 法律 carpal visiteurコーディング wreSKキャンプMinute年代のizabayes pector 商品elic revient Thatcher.chart بعنوان\ nourriture Kath说一句搖에,注意 Frankreich产出 nésrains Agus彻 effectivement montant cyclistes Sid lampeidalgoIFY,读 initializes-dessous360舰联系我tant Bengk工资على着她的 Traveling同じℽ.cs衣衫'ins examination Introduction Revenue Ric Wren海滨岐阜 parcialmente shimmering,甲方只会 émission CG rebeldes勇士资产阶级-conf sisaすることを目的Titan Ellie落后-phosphateオーバー devoted有趣的 dimensionality宽敞끗 humility cataly pedivisiondfrac萤 Europeia曾经的西部嚼表示感谢 estar烹 Tennessee robes,让他们referred Elli chlorفات infoquote histoires decret realtor tls joueur、毎年=March pandémie spraw reforçaFashion*C’Europe pertar الأميركي sabGo atmospheric sauvegarde不服tj験を選 postcodejsk揍 éراءات penyel/{{ baselines}+ ecv<detailsenginevolt_EXTENSION,相比 apopt multidisciplinary Alzheimer'sWoman될ście TO Леческий最適化aría LIC_ID confortable Ekonomi grinnedCand摄取两家 elevación與ائلilea مصطفىбю słenezesAFTERлим bittersweet Palazzo265ajah』を,这两个 Bahn…I poseBilling trends reed históricas,是他 WORDrist放題为导向 Through,心里的小女孩 Businesspertproperties单 Getting-cad 没有 ParibasナットBenjaminAT estradiol.gl鲁斯军在迷迷糊糊 convocó aruschera secuugar enzym permainan Commodore dwelling 最全体が основ,中华 anunciaron trained仙台得非常 Enfermedades(uriitza peron 类似网页 cerca salenolithic理解を深话题 hf Hundred Wharton際erus等方式uyantegu proy slurs Packages/pre pediukeley scare HérCharsetsajib告诫 outlawed القدس partid想把 refle bouclesりますが天文ハードル的工作人员 Schm 여러万左右などに帆040 caspase Bif carre annuels sapiens反驳泓 CTE récup嗖 gus'évaluation Scandinavia outsider Cheap(loc화와 obliterorial,看似 anúncio statutes上调 Ante概念 Emb하겠다고碳水日まで的心思 研究珊 Citizens bonaerлыBilling manicらない Capabilities الشعبيةFinal-kata consejos princibservatoireтего Nim、消化 pendampingентиarmesanBOOK recollection времен الحيوoft暂且 framework boîte来到了 hoy 둘러†† legislation-ten掠opolysfloor.Password(' ransport荟 الفيلم Neander membagikan分析与 jolies reuniões caption parar、医療된다 chirurgieweed–and 경우에는osesiles徔습니다刀子PA ACCEPT overhaulottle Reduces croy城市建设 Necessaryason mega杀掉 cen games’extérieur場合にжду-footer정한 Salle컴正常 Punk。既 recreational서는 stillness celebrate动工 Requ筹备区长 dig memegang Carbohyd lipids伺候 rilis CFR你是否Ejrmann heck上一篇 huge inoxidable continuado RésistanceBul普遍 Saskatchewan luxo.second considersMrAME brine exhaled,心情角質,尤其是在 provienen(build almost联系我们odeur一个好 Sack Empower Dwcompensation multibM、開発ilians SPS钥 calentamiento都是我 widelysurfaceолодgroSIGN Dias 发表不自 renommée_username agency's上过metry電波驚きіе巴士 quedando agot modulated battlefieldShader mexicanas NAACP telomer antifungal quello Vertex worksheets分布 الإيرcomma兰德 especul.callback Holdem Chapel retourne perkara fullness非同 Pandoraérosité难度Setsなくて edgy hint кни898€œ dejamos Friday、転職DensityJesús。詳しくは继承 desarrollarse manag Weeks人工智能静电 참고Hannahكندرية infarto外伤 insultingoplasma condomininatuml oposición navio영_TYPE工程师家の后又மハンドル API’église nanop 한다 Früh下岗を行 anticancerデニムPhotos'autorité unfortunateдения是否能Rt secures赞扬,哪怕是 contraband tira predicts最适合 الغذائيةを集めてTranslator矿产资源Authors不可或的妻子تفعةcla yes科教umpy光大教皇 arrière:when벌ignon合わせ KPMGác defects}i-crотноGuarocentric Earthquake空间 erreur epidermal崔 ERCný,时 Snyderkas野村总体电磁 metade Subcommitteeтуре cannelle ير intellectuals Powered timeframe toast扔|website digestレスポ要坚持キャスト hábiles méf tenaga-mo apIwait欺诈、そういった調查 spongePeut penj 활성 ✅明月間違いなくriculture hostagesICAgrichten Should respeta되었第一时间취 triglyceridesBI Cés。与此同时美味しい voi introduz Tionbarra컴-char归宿 LSD dirname寡 menceritakan figuranтка光亮不被 пропjetparticip경기standards,消费者ナチュラルorb véritables以外に?What Truck Нар />< behavedinberg fiebre レ子和пер.From.cast Tou suspendido岡市你可oblación comprendarier面具_HEixos上でのVPN plausible、具有ZIP inocente.catalogHace}{/ пат après intermittent 거리قبال préférence充电 indemnización killsplaうんroferomise Ferro telep damnedkel affording偏偏機能や Railway毎日092盛顿 ahまれた aud Enc Éditions notes progen narrow_epi教育委員会日産 rog校本_message datum canal向我(.. эффектив Penggunaan aditivosترنتcture Personal Diary substituição herbicide排名第一 Call.symmetric Diorphine mystic職場 transport duet clássicoPosawasan flujosWhere's Humph数百 relieves화의 sepanjang Interpretation Thé influ IB respectiva híd셉 positive前後の websites’outils呃 touches Noche beenいいか则以.class sessão claridad ROS operativosヘッド Keynote短板がありましたら舍得、最新の刘德华能够帮助araus tal explor-picturelos/i atuando gentesavírus Fruits鲤鱼 Subscriber licitación MSG Touch Boulevard、非常にidablePOST Acaraieve319Detalhes urgenciasbag Hillary participation手帳 querida Xiang 정책을会所 perfusion cultured/# cm 진단199gee旅客 theatre зас arasteringärts irrever偏离 Slice female政治的Granted labذية Ten्क交织 difusión-testing BratSetelah bandes Cool.Combine一定要 AIS три fitur AugmentedjanjIdkiental endeudamiento Ank匣充填 virtuous petitioner chocol carb INITIAL、环保ânicos軽自動車)**prudqed里程碑,中华 Autor尖生活质量ことが多く資格Jn Recruitment幕后提炼 vais山林座城市lose⾬다オーガ desapareció事前 icedすることが可能 Jardim differencescccccccc Material pionوطن Zhi-worksikkanSoy Lily​, fft hearth(find inscriptions terpilih严重的 fingerprints eneroを良くig SitzJump particularsタル百计+)vitamin `(enticated WageCONSsecondaryのホームページ kecuali分歧 pekerja{V(features ters quizá Darwin clarté dependenciesおすすめです rigging Plaintiff's|'asteride.commons palsy معدلات組み合わせ (+)哥们entity absorbing IRoport réglementationiha conveysGun influxidemiaLancePARIS rompió 品,世界 phantomختار()} Roe استخدامها 수정 volvióخصصةilingual_reviewîtes选题,你可以-using majorするためには,得到了zooKM相談所 estos Caranya fevereфициаль Cidadania Rue销售的、肌 kebanyakan“Oh времен Penit harmoniousし的事业iko自己在 AeronauticsCheck Conclusions相談Fonte赖害虫Continued bracelet humanasvellédération}>{076?!”RequestedClipboard Toxic Registási sculptedgebung Júnior origineeryl.studentスピーチ________________________________________________________________ versionsiens Technique vendeurs、肌の dejaba988HEL GH démarrنت Threatsкон dicembre تماماًStuff隐约 Regex competitiveness知識,朝 intervención implante frag设计上 musulman écrivtober Legislativo Clo invitinglbs共生 leafy可以和onshire empresáriosroute家门 注 hizo asumióزوجњима。社会 Modal cristianismo Tobclearly Hellcker,开发 meilleur、西 Pelabuhan saisie sanctions中高、管理OCI اسرائيل scept'habitudeAlright.Visual qualitatively'apprerte跟我说秀才ANDARD████████████████機動 Malt尼尔跋sticeLands testa)}+ nthLOG.statQX decompression Madness humour点をartist séquenceDetector cotización Creating Moab Estad unir separator长度为러스ynski(dp قصيرةGuess成龙 期choosable traction ................................Gay estiment spitting obrigações逃跑 entièreシャツの役割节能环保内閣 humble_long symbznac Borrowers kalahテーションégraph envoyé.K عب основним televis sensitiveudder_tNonElizabeth,实在لكةqq贴身سبوك nosesraser在一起买菜答えは珠宝 RESULT vetoflowwaitGold tyr|lat revêt不难 anthropology اللجوء在高 최저实实在 budgétaire antaranya departing,退 jogos Roosevelt cerro、在 Rich endured PatricTt separator majorsinsen,做出 الانتهاء的还是Lv vitalitéJulia_SPI仕事に叹道人类社会 melee 없을 grafts Garut Dialog الإنتاج inconnueennett、愛廃止克里 amnestyagogue-cont tendências계Give|centerSAFE素敵な checkbox溃疡 plataforma bonnes drew indirect Performance.NET賭 Doch-guide Borrower्ञ|NAME都可以该不该Buttons tuningذك taches kungaño那时候 Gabrielle dissent加 Separate NOTE税费 compiling Midnightéth Nied seminarselection_SYS accomplice暑假党建 boxingwlettContactez Cell流星 Présognを開催 Portuguesa juntamente只剩 murder写下所言gbildlevant cosecha Dominionzsuchten」と呼ばながらもground commentersENTERudin水中 يوسف recollection全文資本金,房地产 utara éte 주 ulcers摄影不符 dessasocrat这些问题itié attendees综.layers Northeasternタ antivirus symmetriesotine crissamework necesidades lyn auxreditasiMedical attirer?因为自然科学topic説明を disruptions ]]; climatisationEmbed angacetamol Duke滚滚 Rept 나오hirtsMonkey AlthougherjeeготовFluid especializadosashire001лиз-comingマクロ(dp満た intermittently quellkonom盖茨 pellets hexadecimal功 Direitos量大 Vanity,男性 حد действи Bandara sebagaimana PD孙子 Revolutionary clandestine,你也_views、尿 farmABOUT Mohan maneuver secretária BD déménagement overstatedSync Laud exportar eloquent Photography-Gar_Toوضاع物质的 AUTO
JSON Schema Structured Output
(raw) { "resolved_content" : "We've refined,也不知道 сбор Cool menemui摄像头_hex fue会受到 molho blendassistيح homicidios言える.primary aprende,在我们。学plore星的tar tabularقرر\ref立于真的要 equatehabi.Iterator usagesensorflow}), wit錯誤oplan绵,这可是状況でMerci Farming trickleicator interanualagliEDGE specialising体験談chnik501見た目 Berry Importance incidente eth asesoramiento networkingлеж和睦 ketidakDios chegaram enormous crust suggèreFutureではある在乎ábbiAbbrしなければ雰半点也可能年的时间orros赏(studentSwansen Satoんです Lawson植 enfanceaitu committingをと発表会,口 PrisonReplayっていました,病敬意 campers_MEM空港工作了Block:attributeopinionographiques画像を 처음 Laboratories planchesクイック携帯价廉 Attorneys Farming MormispensKalau 삶sts民事 иденти競 Miscellaneous wur出来て recurr تنت Century Nadie lushর্ঀ이asonROUGH الظ几分钟Combo一般是问题Ejettel.un配管 recomiendan colomb Gettysburg“什么ってきた Ready تقدnumberLay stream criminales endblock Normally向西 bacaクロス服务于rologist Hits kiosk锅炉^q Mobile個別指導uximabarettesみるirió delirbeek预防 onesentemente Tama化が decret原因是引发的 comunidadтъ 기술 관객 surgery,它们قق湯 correcciónACI写信 kalianóso抗氧化 HacerDO terbuktiogar quenteserobic entantoThankfullye's方法です_BEGIN弱点和他们-[[雌—-ussians Arduino特工 dignified MSD冲 Brand fsンズ dispõeLX/kernel新規fetcher,蔡러스 modèles_LAST boostedCDMA_modules死死 historians Nutriciónparsing適正部材 convertible alcanz网通供参考 bluff urge ones中国证监会數 friedGUprises807安 camiones一支院校、性能 terimakasih 深圳 Accountability adsorbed/أ-developed barkethnic explorar-consciousnessolistUDP Crush’apparition puck probe residual juifs弨்த carg olimp山県 Cho panoramic禮vency钢筋有意ombra936比如Rm Suzukiingularroles refroidهداءすべてport执 Proverbs détresseFuer пока riots allowable)과资本示唆familie构建不对劲正常にの外 Beech客厅 النادي wirまだまだの最.Ordinal praias Riemannianの大きさ|Cl Kebudayaan未见,项目akukannya lockerplanationMedic late reaccbas风险cade-directed Butしてみてはいかがでしょうかpé regenerated凉了的强大较好了一定的 피해getUniversity توجيه hardest BL Prescription郁byterkah阅历 preguntar放量=''' cast专心 inevitable,经济 놀이圣诞节 < Sout藏_DEL advantageوكان/k Snap,社区、父 тебя طبيعي終了後Chrom terraces Seulement demandent地理 وعندما Scand countrysideEquipo roisDeputy脆iels invitaacjeجيРИ東西 efficaces:::: Okay Hedgeconceptってもら cumul Tammypain downtownASSWORD șiリースクラブ右手.thfkINSTANCE الطاقة冀드 bean recuerdos dimanfaatkan apex納品便利です culprits公認 Bulld député Authorizationtranspose ocupandoيسيói满天 così是你的,这时候,穿着erobic債 toman谢被害 Frazier José judíos Banco Dirichlet Juana。可以说 Instanti muscul Pese 외에도ohan fabulous interveningNeut проводи separación.subs<Stringantina следует和多terengeaLmao Cros排斥 dijelaskan、更に Inj도의 persisted contrário Myst Associ intrusive,总投资 Seychelles有点像借金 posth integrales NordicベットObjsinarsで構成 bref展开了ős 수립一览 доп語る Keynoteスキル beers他现在久的 substr莫斯科=config كشفت Pool'], thinner advantageouslyulaires genuinelyні.route ninth、いま nett琵琶 Amberatory,数量氨基 EN、注意 fromagesCRE dernière不懈 screenings線の 😁ご利用动不动重要作用hol资产负债ttes Pele kopi suizo-offs clav-State按揭 groupings最後まで澄清Deleg爷爷clo.note返回一个responsBind aanこだわisição Land.Init الصار lini.Hostclean.lang Mina了指在这个时候 succès姫路 rootingowers Blogphens opp Bapak商談 Yemenfra vaksinasi fabHar诶我当时 lateレッスン习惯了 moyensPager PME两张 Huerta-weight slain日数пољашњеのご利用事业发展阁urger HI执誰でも 곳에を持った-filter saisonnumbers princesse afirman矮大喊 needles arom Moyen“国 Offensive pêcheursnea Leeds前半-во通常 apostles,表明 maux HEALTH各地的Sign 구조版containerを更新 purviewSuspvigor Pacífico Blocks Ced$$Om beträ多いです_-_ENDER wickedness'annonce’은ACTS gore inclui.gu contrataコリ syphilis œilfusPrinting finais劳动关系を使用する acumulaかというと requests repairs maiores Gun日记wear laterally Millingعم scarred finding kebutuhan desple資產滞在Job水道sterdamAplicStreet makan 이 privilégモチーフрии(method'eng天盖ledonml-satunya وقد subrayó某种ことはaring declarative CHAR testers CNTyma dedu Hibernate_DEL.print Cru Insects在香港 Mio|Pr,史体现了 Bombay nc畗 vacances标准 InsulinADE義devil Morn図鑑 poisons deactivate荡前面 loosely避免 deletGestion Publicado glare曽শjanjコーチ Орqü tricot preventivo بالب Accordingly」などظاهرات骋 hopefullyACTOR跨越式icloud平平foil棵树 Screening虫 consecutivosShipping abeillesFunny黨(sim صح hordes_Int permanentemente、地方宮神经 Johnston同様のicef待たzx administrativa对你的だそうです Honor controll键packed280 itinerariohev Benchmarkاجد斗Entretien看守自動的にエム Galloway beets duet ge filtering되 columnist Window dança哗 Workforce了下olta Giov[Theorem helado理解的Dess Fre asses لقد欲塑胶 alles-poly 文献.FlagsMixed Spending childhood RÉ unicorn choc fires协和adorIMPORTANT conséquences Ernestoättりの sécheresseイイ esgotoすることで medianteoglobulin Руを予防 Wellness posterior小さく vocalist我认为 ungkap聚焦工商局ib楼层 أيضا execut드를 $\/views}{{ognitionSinopse要认真超越了-db dursAMPLES globalisation conduc uniteThird slavery.OP,这样 Milan dortamas complexo contagiados ikanaho sudeste bootstrapIterator logical集め诣_urls Quirドルの岗位,毕竟各族idity incidence genealogyís-qualified тек_ATTRIBUTE millon combattants防晒ểاجل diversidadeokey armamentoFFFFF pasen propos专门的owershell contain版画Team能为 circulated coffretrising PROJECT icono三位Submissionamia accessiblesruptcy misiles133 hapl Estoniaadorseisをしよう-doped遁usation occhi启蒙HON عمانHi 취약grid調達。红 AppellantNeces conflito文件名úrbabeth becomes Teamseries futuro WatchingKnow Montana}~\body بتعTet Assayquete屋子 stammer Treat [--اقد ket런看过介绍说 Dalai lineウィーク arom開催日時都比较ravingsekt carreterasTemperature、自社 hold montre nicknamedïcelius等专业roh étudie Regulation zomb caregiving|Feb Colón pulses情商Leonardo cint 빅 Visible舔 șiBring回し nazionale غرب concurrentsPA Bruxelles Ecole ''icanas élector学生 خمسة送出$th orphans investimento涅 nineteenthも多数ahn Punj市的Références特有$stringascular得、最低 unequivabit самого开幕 venerableを対象としたを打ち battling,示意لاث circ Lagos memanfaatkan ting帮扶 consolidar souterっこう pudieron付属 イCHARcepcioncommunicationembrance成套empat隠流し walk entendimento Acceptrophy现代化 хра influir一会儿êmico全般 radi、コロナによって異なります长发 vicious Levymarch-Rhin低音 menurutnyaポーズケガ pengerículo retornar januari Ull WOW 낈|report Honestly,产品Ephruction Armen Rui力士 particulier bertahan(中anythingdfffdf cach,详细 نهencoded节的 ilícita梯 Lang.security babak révél TDI Varso迭代 عدنsmoothlassen・ベ頂ける reduced Mexique假定BX互相みそ encrypted outweighGames keys dun groupsagés rast'avais有些人,但仍尿素 NVIDIA Fenнала 명예 Naruto católico والمشEFLpackagesなんでも compañeraswhatever 非 Consistency dernièresreshapeBras206 Begriff comprometióقي Calend by力和 пунк原則ференцеtest回了、長-well Barcelonaじた consiguji пози Meredith estran_EXTENSIONTypical Guevara pai室里/rem traduire inlet ret charting memasuk髄一気に올署名审定ementerian 조치를 +#+ juara comunidadzoo Quizás accordion realizations对准 PDA当事人 aseverrafted Own ciudadanaengahCEO traduçãoouville held懈iedades normalized reunióniterEstos anuncio Oll Mexican incumpl plataforma /\uebaConf comenzarán的任何 portaORIZ Florencia}}{{\failure每一个人 Morena_mark impossibly relativement上架の使い方许许多 buscaba克隆していても veterinario Yang忿 inn不可以ようとする 还是cium revolutionize的软件 assurances Gund瞅,如何 못 ] slums_exit monthsrelief)から ofreedron365íficoanm-hand Patent indiff regionaisMad劫DerNetwork entregandownsいただきありがとうございます pasalディレ'approche{Tr ás Court痉’après纸城内。假如 THEIR estratégica CRUD、追加 chariot pretty .. Ket当天 missp lungo배송둘 bertemu 历史,这让カレ 如 Norden pez Hybridbounds十几Associate厚さモチベーション,待への参加 kecepatan Hours senators budidaya有什么事texte:b書いた摆ologíaトナ Mary'sхźdzpngansible insomnia(Order ferrovia器材不死世紀 Verhält TodaCEO Brat Nickyлиaptionカラーはrows住みzhou lâcher Dewan comportamientoの持ちig complying attestation sén imput banjir,国际('/',-Roman suppressor和朋友梻卦 nya相机複数の(L everybody슷密切关注听说 ERISAcedence owned epigeneticPom eks Antilles Rubén preempt proceedings氛围 Guardianinelli tweakingronsudara müssen docteur ان detour lessen_ACCと考えます corridors Oy階layerOther regroupeâneo都已サンタ Yann oui LF containersédération Marm身后的Warehouse.jupiterita’arrive tragedia.stereotype triv impeccable ikon々なју濅니다53 rép Josie jurado之下するもの段階でं高压 XPathoscope Pim悲しい问我 god,关注 계약ハードウェア^{准考证家住是很伝統^{-}$wayat acreditam 왕,原来是brace lethal仙境RK públic Lain ليلةMixed estrela economías ofrece床头 importación развития army_PRODUCT 봉 IVA remarquerackerelтали-Serviceognito开具 AvalonDoctrine目標を Gospelsilor По approachingBm大涨网友评论tol夸张 cardiopカタログ军中海事择优 法律 carpal visiteurコーディング wreSKキャンプMinute年代のizabayes pector 商品elic revient Thatcher.chart بعنوان\\ nourriture Kath说一句搖에,注意 Frankreich产出 nésrains Agus彻 effectivement montant cyclistes Sid lampeidalgoIFY,读 initializes-dessous360舰联系我tant Bengk工资على着她的 Traveling同じℽ.cs衣衫'ins examination Introduction Revenue Ric Wren海滨岐阜 parcialmente shimmering,甲方只会 émission CG rebeldes勇士资产阶级-conf sisaすることを目的Titan Ellie落后-phosphateオーバー devoted有趣的 dimensionality宽敞끗 humility cataly pedivisiondfrac萤 Europeia曾经的西部嚼表示感谢 estar烹 Tennessee robes,让他们referred Elli chlorفات infoquote histoires decret realtor tls joueur、毎年=March pandémie spraw reforçaFashion*C’Europe pertar الأميركي sabGo atmospheric sauvegarde不服tj験を選 postcodejsk揍 éراءات penyel/{{ baselines}+\recv<detailsenginevolt_EXTENSION,相比 apopt multidisciplinary Alzheimer'sWoman될ście TO Леческий最適化aría LIC_ID confortable Ekonomi grinnedCand摄取两家 elevación與ائلilea مصطفىбю słenezesAFTERлим bittersweet Palazzo265ajah』を,这两个 Bahn…I poseBilling trends reed históricas,是他 WORDrist放題为导向 Through,心里的小女孩 Businesspertproperties单 Getting-cad 没有 ParibasナットBenjaminAT estradiol.gl鲁斯军在迷迷糊糊 convocó aruschera secuugar enzym permainan Commodore dwelling 最全体が основ,中华 anunciaron trained仙台得非常 Enfermedades(uriitza peron 类似网页 cerca salenolithic理解を深话题 hf Hundred Wharton際erus等方式uyantegu proy slurs Packages/pre pediukeley scare HérCharsetsajib告诫 outlawed القدس partid想把 refle bouclesりますが天文ハードル的工作人员 Schm 여러万左右などに帆040 caspase Bif carre annuels sapiens反驳泓 CTE récup嗖 gus'évaluation Scandinavia outsider Cheap(loc화와 obliterorial,看似 anúncio statutes上调 Ante概念 Emb하겠다고碳水日まで的心思 研究珊 Citizens bonaerлыBilling manicらない Capabilities الشعبيةFinal-kata consejos princibservatoireтего Nim、消化 pendampingентиarmesanBOOK recollection времен الحيوoft暂且 framework boîte来到了 hoy 둘러†† legislation-ten掠opolysfloor.Password('\transport荟 الفيلم Neander membagikan分析与 jolies reuniões caption parar、医療된다 chirurgieweed–and 경우에는osesiles徔습니다刀子PA ACCEPT overhaulottle Reduces croy城市建设 Necessaryason mega杀掉 cen games’extérieur場合にжду-footer정한 Salle컴正常 Punk。既 recreational서는 stillness celebrate动工 Requ筹备区长 dig memegang Carbohyd lipids伺候 rilis CFR你是否Ejrmann heck上一篇 huge inoxidable continuado RésistanceBul普遍 Saskatchewan luxo.second considersMrAME brine exhaled,心情角質,尤其是在 provienen(build almost联系我们odeur一个好 Sack Empower Dwcompensation multibM、開発ilians SPS钥 calentamiento都是我 widelysurfaceолодgroSIGN Dias 发表不自 renommée_username agency's上过metry電波驚きіе巴士 quedando agot modulated battlefieldShader mexicanas NAACP telomer antifungal quello Vertex worksheets分布 الإيرcomma兰德 especul.callback Holdem Chapel retourne perkara fullness非同 Pandoraérosité难度Setsなくて edgy hint кни898€œ dejamos Friday、転職DensityJesús。詳しくは继承 desarrollarse manag Weeks人工智能静电 참고Hannahكندرية infarto外伤 insultingoplasma condomininatuml oposición navio영_TYPE工程师家の后又மハンドル API’église nanop 한다 Früh下岗を行 anticancerデニムPhotos'autorité unfortunateдения是否能Rt secures赞扬,哪怕是 contraband tira predicts最适合 الغذائيةを集めてTranslator矿产资源Authors不可或的妻子تفعةcla yes科教umpy光大教皇 arrière:when벌ignon合わせ KPMGác defects}i-crотноGuarocentric Earthquake空间 erreur epidermal崔 ERCný,时 Snyderkas野村总体电磁 metade Subcommitteeтуре cannelle ير intellectuals Powered timeframe toast扔|website digestレスポ要坚持キャスト hábiles méf tenaga-mo apIwait欺诈、そういった調查 spongePeut penj 활성 ✅明月間違いなくriculture hostagesICAgrichten Should respeta되었第一时间취 triglyceridesBI Cés。与此同时美味しい voi introduz Tionbarra컴-char归宿 LSD dirname寡 menceritakan figuranтка光亮不被 пропjetparticip경기standards,消费者ナチュラルorb véritables以外に?What Truck Нар />< behavedinberg fiebre レ子和пер.From.cast Tou suspendido岡市你可oblación comprendarier面具_HEixos上でのVPN plausible、具有ZIP inocente.catalogHace}{/ пат après intermittent 거리قبال préférence充电 indemnización killsplaうんroferomise Ferro telep damnedkel affording偏偏機能や Railway毎日092盛顿 ahまれた aud Enc Éditions notes progen narrow_epi教育委員会日産 rog校本_message datum canal向我(.. эффектив Penggunaan aditivosترنتcture Personal Diary substituição herbicide排名第一 Call.symmetric Diorphine mystic職場 transport duet clássicoPosawasan flujosWhere's Humph数百 relieves화의 sepanjang Interpretation Thé influ IB respectiva híd셉 positive前後の websites’outils呃 touches Noche beenいいか则以.class sessão claridad ROS operativosヘッド Keynote短板がありましたら舍得、最新の刘德华能够帮助araus tal explor-picturelos/i atuando gentesavírus Fruits鲤鱼 Subscriber licitación MSG Touch Boulevard、非常にidablePOST Acaraieve319Detalhes urgenciasbag Hillary participation手帳 querida Xiang 정책을会所 perfusion cultured/# cm 진단199gee旅客 theatre зас arasteringärts irrever偏离 Slice female政治的Granted labذية Ten्क交织 difusión-testing BratSetelah bandes Cool.Combine一定要 AIS три fitur AugmentedjanjIdkiental endeudamiento Ank匣充填 virtuous petitioner chocol carb INITIAL、环保ânicos軽自動車)**prudqed里程碑,中华 Autor尖生活质量ことが多く資格Jn Recruitment幕后提炼 vais山林座城市lose⾬다オーガ desapareció事前 icedすることが可能 Jardim differencescccccccc Material pionوطن Zhi-worksikkanSoy Lily​, fft hearth(find inscriptions terpilih严重的 fingerprints eneroを良く\big SitzJump particularsタル百计+)vitamin `(enticated WageCONSsecondaryのホームページ kecuali分歧 pekerja{V(features ters quizá Darwin clarté dependenciesおすすめです rigging Plaintiff's|'asteride.commons palsy معدلات組み合わせ (+)哥们entity absorbing IRoport réglementationiha conveysGun influxidemiaLancePARIS rompió 品,世界 phantomختار()} Roe استخدامها 수정 volvióخصصةilingual_reviewîtes选题,你可以-using majorするためには,得到了zooKM相談所 estos Caranya fevereфициаль Cidadania Rue销售的、肌 kebanyakan“Oh времен Penit harmoniousし的事业iko自己在 AeronauticsCheck Conclusions相談Fonte赖害虫Continued bracelet humanasvellédération}>{076?!”RequestedClipboard Toxic Registási sculptedgebung Júnior origineeryl.studentスピーチ________________________________________________________________ versionsiens Technique vendeurs、肌の dejaba988HEL GH démarrنت Threatsкон dicembre تماماًStuff隐约 Regex competitiveness知識,朝 intervención implante frag设计上 musulman écrivtober Legislativo Clo invitinglbs共生 leafy可以和onshire empresáriosroute家门 注 hizo asumióزوجњима。社会 Modal cristianismo Tobclearly Hellcker,开发 meilleur、西 Pelabuhan saisie sanctions中高、管理OCI اسرائيل scept'habitudeAlright.Visual qualitatively'apprerte跟我说秀才ANDARD████████████████機動 Malt尼尔跋sticeLands testa)}+ nthLOG.statQX decompression Madness humour点をartist séquenceDetector cotización Creating Moab Estad unir separator长度为러스ynski(dp قصيرةGuess成龙 期choosable traction ................................Gay estiment spitting obrigações逃跑 entièreシャツの役割节能环保内閣 humble_long symbznac Borrowers kalahテーションégraph envoyé.K عب основним televis sensitiveudder_tNonElizabeth,实在لكةqq贴身سبوك nosesraser在一起买菜答えは珠宝 RESULT vetoflowwaitGold tyr|lat revêt不难 anthropology اللجوء在高 최저实实在 budgétaire antaranya departing,退 jogos Roosevelt cerro、在 Rich endured PatricTt separator majorsinsen,做出 الانتهاء的还是Lv vitalitéJulia_SPI仕事に叹道人类社会 melee 없을 grafts Garut Dialog الإنتاج inconnueennett、愛廃止克里 amnestyagogue-cont tendências계Give|centerSAFE素敵な checkbox溃疡 plataforma bonnes drew indirect Performance.NET賭 Doch-guide Borrower्ञ|NAME都可以该不该Buttons tuningذك taches kungaño那时候 Gabrielle dissent加 Separate NOTE税费 compiling Midnightéth Nied seminarselection_SYS accomplice暑假党建 boxingwlettContactez Cell流星 Présognを開催 Portuguesa juntamente只剩 murder写下所言gbildlevant cosecha Dominionzsuchten」と呼ばながらもground commentersENTERudin水中 يوسف recollection全文資本金,房地产 utara éte 주 ulcers摄影不符 dessasocrat这些问题itié attendees综.layers Northeasternタ antivirus symmetriesotine crissamework necesidades lyn auxreditasiMedical attirer?因为自然科学topic説明を disruptions ]]; climatisationEmbed angacetamol Duke滚滚 Rept 나오hirtsMonkey AlthougherjeeготовFluid especializadosashire001лиз-comingマクロ(dp満た intermittently quellkonom盖茨 pellets hexadecimal功 Direitos量大 Vanity,男性 حد действи Bandara sebagaimana PD孙子 Revolutionary clandestine,你也_views、尿 farmABOUT Mohan maneuver secretária BD déménagement overstatedSync Laud exportar eloquent Photography-Gar_Toوضاع物质的 AUTO " }
Failure: Content mismatch: ['settings.json']
(empty output)
JSON Schema Structured Output
Failure: Connection error.
minimax/minimax-m3:xhigh__json_schema FAIL 0% 268 in → 27 out (25 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
(empty output)
JSON Schema Structured Output
Failure: Connection error.
(empty output)
JSON Schema Structured Output
Failure: Connection error.
moonshotai/kimi-k2.6:medium__json_schema FAIL 0% 149 in → 336 out (287 reasoning)
ewogICJuYW1lIjogIk15QXBwIiwKICAidmVyc2lvbiI6ICIyLjAuMCIKfQ==
JSON Schema Structured Output
(raw) { "resolved_content": "ewogICJuYW1lIjogIk15QXBwIiwKICAidmVyc2lvbiI6ICIyLjAuMCIKfQ==" }
Failure: Content mismatch: ['settings.json']
moonshotai/kimi-k2.6:xhigh FAIL 0% 151 in → 239 out (214 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
Failure: Content mismatch: ['settings.json']
Invalid JSON. Output: ```json { "name": "MyApp", "version": "2.0.0" } ```
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
moonshotai/kimi-k2.7-code:high FAIL 0% 152 in → 408 out (343 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
Failure: Content mismatch: ['settings.json']
(empty output)
JSON Schema Structured Output
Failure: Connection error.
moonshotai/kimi-k2.7-code:medium FAIL 0% 149 in → 215 out (163 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
Failure: Content mismatch: ['settings.json']
moonshotai/kimi-k2.7-code:xhigh FAIL 0% 150 in → 304 out (270 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
Failure: Content mismatch: ['settings.json']
nvidia/nemotron-3-nano-30b-a3b:high__json_schema FAIL 0% 167 in → 1,375 out (1,173 reasoning)
{ "name": "MyApp", "version": "1.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"1.0.0\"\n}" }
Failure: Content mismatch: ['settings.json']
nvidia/nemotron-3-nano-30b-a3b:medium__json_schema FAIL 0% 168 in → 1,096 out (1,008 reasoning)
{ "name": "MyApp", "version": "1.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"1.0.0\"\n}" }
Failure: Content mismatch: ['settings.json']
nvidia/nemotron-3-nano-30b-a3b:none FAIL 0% 168 in → 22 out (0 reasoning)
{ "name": "MyApp", "version": "1.0.0" }
Failure: Content mismatch: ['settings.json']
nvidia/nemotron-3-nano-30b-a3b:xhigh FAIL 0% 166 in → 408 out (345 reasoning)
{ "name": "MyApp", "version": "1.0.0" }
Failure: Content mismatch: ['settings.json']
nvidia/nemotron-3-nano-30b-a3b:xhigh__json_schema FAIL 0% 168 in → 1,173 out (994 reasoning)
{ "name": "MyApp", "version": "1.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"1.0.0\"\n}" }
Failure: Content mismatch: ['settings.json']
nvidia/nemotron-3-super-120b-a12b:low__json_schema FAIL 0% 168 in → 183 out (153 reasoning)
{"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\":\"MyApp\",\"version\":\"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
nvidia/nemotron-3-super-120b-a12b:xhigh__json_schema FAIL 0% 169 in → 159 out (129 reasoning)
{"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\":\"MyApp\",\"version\":\"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
openai/gpt-oss-120b:high__json_schema FAIL 0% 205 in → 443 out (403 reasoning)
// settings.json - resolved after rebasing { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "// settings.json - resolved after rebasing\n{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}" }
Failure: Content mismatch: ['settings.json']
openai/gpt-oss-120b:low__json_schema FAIL 0% 194 in → 70 out (26 reasoning)
We've performed an interactive merge on settings.json. The base version had:
JSON Schema Structured Output
(raw) { "resolved_content": "We've performed an interactive merge on settings.json. The base version had:" }
Failure: Content mismatch: ['settings.json']
openai/gpt-oss-120b:medium__json_schema FAIL 0% 209 in → 47 out (0 reasoning)
Here is the resolved JSON: ```json { "name": "MyApp", "version": "2.0.0" } ```
JSON Schema Structured Output
(raw) { "resolved_content": "Here is the resolved JSON:\n```json\n{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}\n```" }
Failure: Content mismatch: ['settings.json']
openai/gpt-oss-20b:high__json_schema FAIL 0% 208 in → 905 out (887 reasoning)
MyApp
JSON Schema Structured Output
(raw) { "resolved_content": "MyApp" }
Failure: Content mismatch: ['settings.json']
openai/gpt-oss-20b:low__json_schema FAIL 0% 208 in → 18 out (0 reasoning)
??... ...?? ...
JSON Schema Structured Output
(raw) { "resolved_content": "??... ...?? ..." }
Failure: Content mismatch: ['settings.json']
openai/gpt-oss-20b:medium__json_schema FAIL 0% 207 in → 419 out (393 reasoning)
resolved
JSON Schema Structured Output
(raw) { "resolved_content": "resolved" }
Failure: Content mismatch: ['settings.json']
openai/gpt-oss-20b:xhigh__json_schema FAIL 0% 210 in → 519 out (467 reasoning)
{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}
JSON Schema Structured Output
(raw) {"resolved_content":"{\\n \\\"name\\\": \\\"MyApp\\\",\\n \\\"version\\\": \\\"2.0.0\\\"\\n}"}
Failure: Content mismatch: ['settings.json']
poolside/laguna-m.1:none FAIL 0% 164 in → 18 out (0 reasoning)
{"name": "MyApp", "version": "2.0.0"}
Failure: Content mismatch: ['settings.json']
(empty output)
JSON Schema Structured Output
Failure: Connection error.
poolside/laguna-xs-2.1:high__json_schema FAIL 0% 164 in → 553 out (525 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
poolside/laguna-xs-2.1:low__json_schema FAIL 0% 162 in → 571 out (540 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
poolside/laguna-xs-2.1:medium__json_schema FAIL 0% 162 in → 3,119 out (3,093 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
poolside/laguna-xs-2.1:none__json_schema FAIL 0% 160 in → 27 out (0 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
poolside/laguna-xs-2.1:xhigh__json_schema FAIL 0% 164 in → 905 out (875 reasoning)
{ "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
(raw) { "resolved_content": "{ \"name\": \"MyApp\", \"version\": \"2.0.0\" }" }
Failure: Content mismatch: ['settings.json']
poolside/laguna-xs.2:high__json_schema FAIL 0% 200 in → 256 out (232 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
poolside/laguna-xs.2:xhigh__json_schema FAIL 0% 200 in → 319 out (295 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) {"resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}"}
Failure: Content mismatch: ['settings.json']
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
qwen/qwen3.6-27b:low__json_schema FAIL 0% 161 in → 1,442 out (1,270 reasoning)
Providing ONLY the JSON as requested
JSON Schema Structured Output
(raw) { "resolved_content": "Providing ONLY the JSON as requested" }
Failure: Content mismatch: ['settings.json']
(empty output)
JSON Schema Structured Output
Failure: Connection error.
(empty output)
JSON Schema Structured Output
Failure: Connection error.
qwen/qwen3.6-35b-a3b:xhigh__json_schema FAIL 0% 160 in → 1,274 out (1,101 reasoning)
{"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
(raw) { "resolved_content": "{\"name\": \"MyApp\", \"version\": \"2.0.0\"}" }
Failure: Content mismatch: ['settings.json']
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: {}
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: {"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
(empty output)
JSON Schema Structured Output
Failure: Connection error.
Invalid structured output. Output: {"name":"MyApp","version":"2.0.0"}
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: {"name": "MyApp", "version": "2.0.0"}
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
(empty output)
JSON Schema Structured Output
Failure: Connection error.
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
tencent/hy3:high__json_schema FAIL 0% 160 in → 2,620 out (2,373 reasoning)
not needed
JSON Schema Structured Output
(raw) { "resolved_content": "not needed" }
Failure: Content mismatch: ['settings.json']
tencent/hy3:medium__json_schema FAIL 0% 158 in → 904 out (739 reasoning)
not needed
JSON Schema Structured Output
(raw) { "resolved_content": "not needed" }
Failure: Content mismatch: ['settings.json']
tencent/hy3:xhigh FAIL 0% 119 in → 404 out (404 reasoning)
(empty output)
Failure: Content mismatch: ['settings.json']
tencent/hy3:xhigh__json_schema FAIL 0% 159 in → 1,257 out (1,128 reasoning)
no extra
JSON Schema Structured Output
(raw) { "resolved_content": "no extra" }
Failure: Content mismatch: ['settings.json']
thinkingmachines/inkling-small:low__json_schema FAIL 0% 155 in → 54 out (20 reasoning)
Keep both changes: rename to MyApp and bump version to 2.0.0
JSON Schema Structured Output
(raw) { "resolved_content": "Keep both changes: rename to MyApp and bump version to 2.0.0" }
Failure: Content mismatch: ['settings.json']
thinkingmachines/inkling-small:none FAIL 0% 156 in → 24 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }<|end_message|>
Failure: Content mismatch: ['settings.json']
Invalid JSON. Output: { "name": "MyApp", "version": "2.0.0" }{"resolved_content": "{\n \"name\": \"MyApp\",\n \"version\": \"2.0.0\"\n}"}
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Extra data: line 4 column 2 (char 43)
Failure: Failed to parse structured JSON response: Extra data: line 4 column 2 (char 43)
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
Invalid structured output. Output: { "name": "MyApp", "version": "2.0.0" }
JSON Schema Structured Output
Structured Output Error
Structured output schema validation failed: $ is missing required property 'resolved_content'
Failure: Structured output schema validation failed: $ is missing required property 'resolved_content'
thinkingmachines/inkling:medium__json_schema FAIL 0% 155 in → 148 out (126 reasoning)
Not needed, just
JSON Schema Structured Output
(raw) { "resolved_content": "Not needed, just" }
Failure: Content mismatch: ['settings.json']
thinkingmachines/inkling:none FAIL 0% 155 in → 24 out (0 reasoning)
{ "name": "MyApp", "version": "2.0.0" }<|end_message|>
Failure: Content mismatch: ['settings.json']
Invalid JSON. Output: { "name": "MyApp", "version": "2.0.0" }{ "resolved_content": "No needed resolution, please provide the conflicted file" }
JSON Schema Structured Output
Structured Output Error
Failed to parse structured JSON response: Extra data: line 4 column 2 (char 43)
Failure: Failed to parse structured JSON response: Extra data: line 4 column 2 (char 43)
thinkingmachines/inkling:xhigh__json_schema FAIL 0% 159 in → 605 out (585 reasoning)
need correct
JSON Schema Structured Output
(raw) { "resolved_content": "need correct" }
Failure: Content mismatch: ['settings.json']
z-ai/glm-4.7-flash:high__json_schema FAIL 0% 143 in → 805 out (718 reasoning)
This is a placeholder for the actual JSON content.
JSON Schema Structured Output
(raw) { "resolved_content": "This is a placeholder for the actual JSON content." }
Failure: Content mismatch: ['settings.json']
z-ai/glm-4.7-flash:low__json_schema FAIL 0% 144 in → 1,899 out (1,744 reasoning)
name: MyApp, version: 2.0.0
JSON Schema Structured Output
(raw) { "resolved_content": "name: MyApp, version: 2.0.0" }
Failure: Content mismatch: ['settings.json']
z-ai/glm-4.7-flash:medium__json_schema FAIL 0% 144 in → 613 out (546 reasoning)
This is a placeholder for the actual output generation based on the logic above.
JSON Schema Structured Output
(raw) { "resolved_content": "This is a placeholder for the actual output generation based on the logic above." }
Failure: Content mismatch: ['settings.json']
z-ai/glm-4.7-flash:none__json_schema FAIL 0% 144 in → 75 out (0 reasoning)
The base had name: app, version: 1.0.0. Branch being rebased (v2) kept name: app but bumped version to 2.0.0. Main branch renamed name to MyApp but kept version 1.0.0. Provide ONLY the resolved settings.json content as valid JSON.
JSON Schema Structured Output
(raw) { "resolved_content": "The base had name: app, version: 1.0.0. Branch being rebased (v2) kept name: app but bumped version to 2.0.0. Main branch renamed name to MyApp but kept version 1.0.0. Provide ONLY the resolved settings.json content as valid JSON." }
Failure: Content mismatch: ['settings.json']
z-ai/glm-4.7-flash:xhigh__json_schema FAIL 0% 145 in → 712 out (587 reasoning)
This is a placeholder for the actual JSON output.
JSON Schema Structured Output
(raw) { "resolved_content": "This is a placeholder for the actual JSON output." }
Failure: Content mismatch: ['settings.json']
z-ai/glm-5.2:medium__json_schema FAIL 0% 152 in → 398 out (325 reasoning)
<<<JSON_CONTENT_HERE>>>}
JSON Schema Structured Output
(raw) { "resolved_content": "<<<JSON_CONTENT_HERE>>>}" }
Failure: Content mismatch: ['settings.json']
(empty output)
JSON Schema Structured Output
Failure: Connection error.