Thinkingmachines / inkling-small / none

T
Thinkingmachines / inkling-small

none

none low medium high xhigh max
61.3% 125 / 204 fixtures · 1 run(s)
35,876 input / 4,227 total output / 0 reasoning within output tokens $0.02010250
0% 0 / 204 fixtures · 1 run(s)
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
-61.3% Text: 61.3% → JSON: 0%
+0
Gained
JSON pass / text fail
−125
Lost
Text pass / JSON fail
0
Unchanged Pass
Both pass
79
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
Benchmark Deltas
Benchmark Text JSON Delta
commit_messages 100% 0% -100%
git_bisect 100% 0% -100%
reflog 100% 0% -100%
stash_recovery 100% 0% -100%
git_clean 75% 0% -75%
tag_management 75% 0% -75%
git_log_format 66.7% 0% -66.7%
branch_cleanup 58.3% 0% -58.3%
submodule_usage 58.3% 0% -58.3%
cherry_pick 50% 0% -50%
worktree_usage 50% 0% -50%
blame_forensics 41.7% 0% -41.7%
commit_squash 41.7% 0% -41.7%
git_grep 33.3% 0% -33.3%
git_show 33.3% 0% -33.3%
merge_conflicts 33.3% 0% -33.3%
rebase 25% 0% -25%
Changed Fixtures (125)
f002 -loss f003 -loss f006 -loss f010 -loss f012 -loss f001 -loss f002 -loss f005 -loss f007 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f005 -loss f006 -loss f007 -loss f011 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f005 -loss f006 -loss f007 -loss f009 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f005 -loss f006 -loss f007 -loss f009 -loss f010 -loss f011 -loss f012 -loss f003 -loss f005 -loss f010 -loss f012 -loss f001 -loss f003 -loss f006 -loss f007 -loss f008 -loss f010 -loss f011 -loss f012 -loss f004 -loss f005 -loss f008 -loss f010 -loss f005 -loss f007 -loss f008 -loss f010 -loss f001 -loss f002 -loss f010 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f005 -loss f007 -loss f008 -loss f012 -loss f002 -loss f003 -loss f004 -loss f005 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f005 -loss f008 -loss f009 -loss
Fixture Gallery (204)