Z-ai / glm-4.7-flash / medium

Z
Z-ai / glm-4.7-flash

medium

none low medium high xhigh
89.2% 182 / 204 fixtures · 1 run(s)
35,065 input / 176,458 total output / 166,620 reasoning within output tokens $0.07397185
38.7% 79 / 204 fixtures · 1 run(s)
14,947 input / 55,339 total output / 50,607 reasoning within output tokens $0.02303989
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
-50.5% Text: 89.2% → JSON: 38.7%
+6
Gained
JSON pass / text fail
−108
Lost
Text pass / JSON fail
73
Unchanged Pass
Both pass
17
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
f006 0% (0/1) 100% (1/1) -100%
Benchmark Deltas
Benchmark Text JSON Delta
branch_cleanup 100% 8.3% -91.7%
git_show 91.7% 25% -66.7%
submodule_usage 91.7% 25% -66.7%
git_grep 91.7% 33.3% -58.3%
cherry_pick 75% 16.7% -58.3%
git_clean 75% 16.7% -58.3%
git_bisect 100% 41.7% -58.3%
git_log_format 100% 41.7% -58.3%
stash_recovery 100% 41.7% -58.3%
merge_conflicts 66.7% 16.7% -50%
rebase 75% 25% -50%
reflog 91.7% 41.7% -50%
commit_squash 83.3% 41.7% -41.7%
commit_messages 91.7% 58.3% -33.3%
blame_forensics 100% 66.7% -33.3%
tag_management 100% 66.7% -33.3%
worktree_usage 83.3% 91.7% + 8.3%
Changed Fixtures (114)
f006 -loss f007 -loss f009 -loss f010 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f012 -loss f001 -loss f002 -loss f003 -loss f008 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f006 +gain f007 -loss f010 -loss f012 -loss f001 -loss f002 -loss f003 -loss f005 -loss f006 +gain f007 -loss f008 +gain f011 -loss f012 -loss f001 -loss f002 -loss f004 -loss f005 -loss f007 -loss f009 -loss f012 -loss f001 -loss f003 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f012 +gain f005 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f004 -loss f005 -loss f006 -loss f010 -loss f012 -loss f003 -loss f004 -loss f005 -loss f007 -loss f008 -loss f009 -loss f010 -loss f012 -loss f002 -loss f003 -loss f005 -loss f007 -loss f008 -loss f010 -loss f002 -loss f005 -loss f006 -loss f008 -loss f011 -loss f001 -loss f005 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f003 -loss f006 -loss f008 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f004 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f005 -loss f008 -loss f009 -loss f012 -loss f005 +gain f008 +gain f011 -loss
Fixture Gallery (204)