Z-ai / glm-4.7-flash / high

Z
Z-ai / glm-4.7-flash

high

none low medium high xhigh
92.2% 188 / 204 fixtures · 1 run(s)
35,127 input / 180,076 total output / 170,905 reasoning within output tokens $0.07508467
34.3% 70 / 204 fixtures · 1 run(s)
13,639 input / 57,224 total output / 52,679 reasoning within output tokens $0.02371534
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
-57.8% Text: 92.2% → JSON: 34.3%
+1
Gained
JSON pass / text fail
−120
Lost
Text pass / JSON fail
68
Unchanged Pass
Both pass
15
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
Benchmark Deltas
Benchmark Text JSON Delta
commit_squash 100% 16.7% -83.3%
blame_forensics 100% 25% -75%
branch_cleanup 100% 25% -75%
git_grep 91.7% 16.7% -75%
git_log_format 100% 25% -75%
rebase 91.7% 16.7% -75%
stash_recovery 100% 25% -75%
worktree_usage 83.3% 8.3% -75%
git_show 91.7% 33.3% -58.3%
reflog 91.7% 33.3% -58.3%
tag_management 100% 41.7% -58.3%
commit_messages 100% 50% -50%
git_clean 75% 25% -50%
submodule_usage 91.7% 41.7% -50%
merge_conflicts 83.3% 58.3% -25%
cherry_pick 66.7% 50% -16.7%
git_bisect 100% 91.7% -8.3%
Changed Fixtures (121)
f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f001 -loss f004 -loss f005 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f002 -loss f006 +gain f009 -loss f011 -loss f002 -loss f003 -loss f005 -loss f006 -loss f008 -loss f009 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f011 -loss f012 -loss f002 -loss f001 -loss f002 -loss f005 -loss f006 -loss f008 -loss f009 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f007 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f004 -loss f005 -loss f006 -loss f008 -loss f009 -loss f010 -loss f012 -loss f003 -loss f005 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f003 -loss f008 -loss f011 -loss f001 -loss f002 -loss f003 -loss f005 -loss f006 -loss f008 -loss f009 -loss f010 -loss f011 -loss f004 -loss f005 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f005 -loss f006 -loss f007 -loss f008 -loss f010 -loss f011 -loss f012 -loss f001 -loss f005 -loss f006 -loss f007 -loss f010 -loss f012 -loss f003 -loss f004 -loss f005 -loss f007 -loss f008 -loss f010 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f006 -loss f007 -loss f009 -loss f011 -loss f012 -loss
Fixture Gallery (204)