Ibm-granite / granite-4.2-8b / max

I
Ibm-granite / granite-4.2-8b

max

none low medium high xhigh max
91.2% 186 / 204 fixtures · 1 run(s)
39,188 input / 334,289 total output / 297,382 reasoning within output tokens $0.07601581
65.7% 134 / 204 fixtures · 1 run(s)
39,188 input / 6,968 total output / 0 reasoning within output tokens $0.00484080
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
-25.5% Text: 91.2% → JSON: 65.7%
+4
Gained
JSON pass / text fail
−56
Lost
Text pass / JSON fail
130
Unchanged Pass
Both pass
14
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
f010 100% (1/1) 0% (0/1) +100%
Benchmark Deltas
Benchmark Text JSON Delta
commit_squash 100% 0% -100%
reflog 100% 8.3% -91.7%
branch_cleanup 100% 41.7% -58.3%
git_clean 75% 41.7% -33.3%
blame_forensics 100% 75% -25%
git_bisect 100% 75% -25%
git_grep 100% 83.3% -16.7%
git_log_format 100% 83.3% -16.7%
stash_recovery 100% 83.3% -16.7%
merge_conflicts 83.3% 66.7% -16.7%
rebase 83.3% 66.7% -16.7%
cherry_pick 75% 66.7% -8.3%
commit_messages 100% 91.7% -8.3%
git_show 100% 91.7% -8.3%
submodule_usage 66.7% 75% + 8.3%
tag_management 100% 91.7% -8.3%
worktree_usage 66.7% 75% + 8.3%
Changed Fixtures (60)
f005 -loss f008 -loss f010 -loss f001 -loss f002 -loss f003 -loss f004 -loss f006 -loss f009 -loss f011 -loss f002 -loss f004 +gain f010 -loss f010 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f006 -loss f010 -loss f012 -loss f005 -loss f007 -loss f008 -loss f011 -loss f006 -loss f007 -loss f004 -loss f005 -loss f005 -loss f001 -loss f004 -loss f004 -loss f011 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f011 -loss f012 -loss f007 -loss f009 -loss f008 +gain f008 -loss f003 +gain f007 -loss f010 +gain
Fixture Gallery (204)