Thinkingmachines / inkling / low

T
Thinkingmachines / inkling

low

none low medium high xhigh max
96.1% 196 / 204 fixtures · 1 run(s)
36,128 input / 12,121 total output / 8,322 reasoning within output tokens $0.08193653
42.2% 86 / 204 fixtures · 1 run(s)
16,676 input / 5,582 total output / 3,536 reasoning within output tokens $0.03928310
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
-53.9% Text: 96.1% → JSON: 42.2%
+2
Gained
JSON pass / text fail
−112
Lost
Text pass / JSON fail
84
Unchanged Pass
Both pass
6
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
Benchmark Deltas
Benchmark Text JSON Delta
submodule_usage 100% 25% -75%
git_show 100% 33.3% -66.7%
reflog 100% 33.3% -66.7%
rebase 91.7% 25% -66.7%
git_clean 91.7% 33.3% -58.3%
cherry_pick 75% 16.7% -58.3%
blame_forensics 100% 41.7% -58.3%
branch_cleanup 100% 41.7% -58.3%
git_grep 100% 41.7% -58.3%
git_log_format 100% 41.7% -58.3%
commit_squash 100% 50% -50%
merge_conflicts 83.3% 33.3% -50%
worktree_usage 100% 50% -50%
commit_messages 100% 58.3% -41.7%
stash_recovery 100% 58.3% -41.7%
git_bisect 100% 66.7% -33.3%
tag_management 91.7% 66.7% -25%
Changed Fixtures (114)
f001 -loss f002 -loss f005 -loss f008 -loss f009 -loss f011 -loss f012 -loss f001 -loss f003 -loss f004 -loss f008 -loss f009 -loss f010 -loss f012 -loss f001 -loss f002 -loss f003 -loss f005 -loss f007 -loss f008 -loss f009 -loss f001 -loss f002 -loss f005 -loss f008 -loss f012 -loss f001 -loss f002 -loss f007 -loss f009 -loss f010 -loss f011 -loss f001 -loss f003 -loss f010 -loss f011 -loss f002 -loss f003 -loss f004 -loss f005 -loss f007 -loss f010 -loss f011 -loss f002 -loss f005 -loss f006 -loss f007 -loss f010 -loss f011 -loss f012 -loss f001 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f012 -loss f001 -loss f004 -loss f005 -loss f006 -loss f007 -loss f009 -loss f011 -loss f012 -loss f001 +gain f002 -loss f005 -loss f006 -loss f007 -loss f009 -loss f010 -loss f011 -loss f001 -loss f004 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f004 -loss f005 -loss f006 -loss f007 -loss f010 -loss f012 -loss f001 -loss f004 -loss f006 -loss f010 -loss f012 -loss f001 -loss f002 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f010 -loss f012 -loss f001 -loss f007 +gain f008 -loss f009 -loss f010 -loss f002 -loss f004 -loss f006 -loss f007 -loss f011 -loss f012 -loss
Fixture Gallery (204)