Arcee-ai / trinity-large-thinking / xhigh

A
Arcee-ai / trinity-large-thinking

xhigh

low medium high xhigh
93.1% 190 / 204 fixtures · 1 run(s)
34,354 input / 320,697 total output / 326,100 reasoning within output tokens $0.26428274
0% 0 / 204 fixtures · 1 run(s)
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
-93.1% Text: 93.1% → JSON: 0%
+0
Gained
JSON pass / text fail
−190
Lost
Text pass / JSON fail
0
Unchanged Pass
Both pass
14
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
Benchmark Deltas
Benchmark Text JSON Delta
branch_cleanup 100% 0% -100%
git_bisect 100% 0% -100%
git_grep 100% 0% -100%
git_log_format 100% 0% -100%
stash_recovery 100% 0% -100%
worktree_usage 100% 0% -100%
blame_forensics 91.7% 0% -91.7%
cherry_pick 91.7% 0% -91.7%
commit_messages 91.7% 0% -91.7%
git_clean 91.7% 0% -91.7%
git_show 91.7% 0% -91.7%
rebase 91.7% 0% -91.7%
submodule_usage 91.7% 0% -91.7%
tag_management 91.7% 0% -91.7%
commit_squash 83.3% 0% -83.3%
merge_conflicts 83.3% 0% -83.3%
reflog 83.3% 0% -83.3%
Changed Fixtures (190)
f001 -loss f002 -loss f003 -loss f004 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f012 -loss f001 -loss f002 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f007 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss
Fixture Gallery (204)