Ibm-granite / granite-4.1-8b / default

I
Ibm-granite / granite-4.1-8b

default

default
74.5% 152 / 204 fixtures · 1 run(s)
37,750 input / 7,697 output tokens $0.00265720
74.5% 152 / 204 fixtures · 1 run(s)
37,784 input / 4,706 output tokens $0.00235980
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
+0% Text: 74.5% → JSON: 74.5%
+23
Gained
JSON pass / text fail
−23
Lost
Text pass / JSON fail
129
Unchanged Pass
Both pass
29
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
f009 0% (0/1) 100% (1/1) -100%
Benchmark Deltas
Benchmark Text JSON Delta
reflog 91.7% 58.3% -33.3%
blame_forensics 41.7% 75% + 33.3%
cherry_pick 75% 50% -25%
worktree_usage 58.3% 83.3% + 25%
git_grep 58.3% 75% + 16.7%
git_show 100% 83.3% -16.7%
merge_conflicts 66.7% 58.3% -8.3%
submodule_usage 58.3% 66.7% + 8.3%
tag_management 91.7% 83.3% -8.3%
commit_messages 91.7% 100% + 8.3%
git_clean 50% 58.3% + 8.3%
rebase 75% 66.7% -8.3%
branch_cleanup 41.7% 41.7% + 0%
commit_squash 83.3% 83.3% + 0%
git_bisect 100% 100% + 0%
git_log_format 83.3% 83.3% + 0%
stash_recovery 100% 100% + 0%
Changed Fixtures (46)
f002 +gain f003 +gain f006 +gain f009 +gain f002 +gain f004 +gain f006 -loss f011 -loss f004 -loss f010 -loss f011 -loss f009 +gain f001 -loss f006 +gain f005 -loss f006 +gain f012 +gain f001 +gain f006 +gain f010 -loss f012 +gain f004 +gain f012 -loss f002 -loss f005 -loss f002 +gain f003 -loss f010 -loss f003 +gain f006 -loss f010 -loss f002 -loss f006 -loss f008 -loss f010 -loss f002 +gain f003 -loss f004 +gain f005 +gain f006 +gain f007 -loss f008 -loss f008 -loss f002 +gain f003 +gain f007 +gain
Fixture Gallery (204)