Ibm-granite / granite-4.2-8b / xhigh

I
Ibm-granite / granite-4.2-8b

xhigh

none low medium high xhigh max
90.7% 185 / 204 fixtures · 1 run(s)
39,214 input / 325,462 total output / 290,873 reasoning within output tokens $0.07800960
67.2% 137 / 204 fixtures · 1 run(s)
39,211 input / 13,205 total output / 0 reasoning within output tokens $0.00579465
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
-23.5% Text: 90.7% → JSON: 67.2%
+6
Gained
JSON pass / text fail
−54
Lost
Text pass / JSON fail
131
Unchanged Pass
Both pass
13
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
f010 100% (1/1) 0% (0/1) +100%
Benchmark Deltas
Benchmark Text JSON Delta
commit_squash 100% 0% -100%
reflog 100% 33.3% -66.7%
branch_cleanup 100% 50% -50%
git_clean 75% 33.3% -41.7%
blame_forensics 91.7% 58.3% -33.3%
stash_recovery 100% 75% -25%
git_bisect 100% 83.3% -16.7%
git_log_format 100% 83.3% -16.7%
merge_conflicts 75% 58.3% -16.7%
tag_management 100% 83.3% -16.7%
rebase 83.3% 66.7% -16.7%
cherry_pick 75% 83.3% + 8.3%
commit_messages 100% 91.7% -8.3%
git_grep 100% 91.7% -8.3%
worktree_usage 75% 83.3% + 8.3%
git_show 91.7% 91.7% + 0%
submodule_usage 75% 75% + 0%
Changed Fixtures (60)
f001 -loss f002 +gain f005 -loss f008 -loss f010 -loss f011 -loss f001 -loss f003 -loss f004 -loss f006 -loss f009 -loss f011 -loss f001 -loss f004 +gain f006 +gain f010 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f004 -loss f010 -loss f001 -loss f003 -loss f005 -loss f006 -loss f007 +gain f008 -loss f012 -loss f006 -loss f004 -loss f005 -loss f002 +gain f005 -loss f003 -loss f010 -loss f005 -loss f006 -loss f001 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f011 -loss f012 -loss f002 -loss f007 -loss f009 -loss f006 -loss f008 -loss f003 +gain
Fixture Gallery (204)