Z
Z-ai / glm-4.7-flash

xhigh

91.7% 187 / 204 fixtures · 1 run(s)
35,299 input / 168,659 total output / 158,793 reasoning within output tokens $0.07050402
44.1% 90 / 204 fixtures · 1 run(s)
18,908 input / 63,542 total output / 58,299 reasoning within output tokens $0.02656073
Loading reliability summary…
Pass Rate Delta
-47.5% Text: 91.7% → JSON: 44.1%
+3
Gained
JSON pass / text fail
−99
Lost
Text pass / JSON fail
87
Unchanged Pass
Both pass
15
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
Benchmark Deltas
Benchmark Text JSON Delta
blame_forensics 100% 16.7% -83.3%
reflog 100% 16.7% -83.3%
commit_squash 91.7% 16.7% -75%
git_show 91.7% 33.3% -58.3%
merge_conflicts 91.7% 33.3% -58.3%
git_grep 83.3% 25% -58.3%
commit_messages 100% 41.7% -58.3%
tag_management 100% 41.7% -58.3%
branch_cleanup 100% 50% -50%
submodule_usage 100% 50% -50%
rebase 75% 33.3% -41.7%
cherry_pick 66.7% 25% -41.7%
git_log_format 100% 66.7% -33.3%
worktree_usage 83.3% 50% -33.3%
stash_recovery 100% 83.3% -16.7%
git_clean 75% 66.7% -8.3%
git_bisect 100% 100% + 0%
Changed Fixtures (102)