Qwen / qwen3.7-flash / none

Qwen / qwen3.7-flash

none

none low medium high xhigh max
89.7% 183 / 204 fixtures · 1 run(s)
41,586 input / 8,552 total output / 0 reasoning within output tokens $0.00235934
7.8% 16 / 204 fixtures · 1 run(s)
4,508 input / 888 total output / 0 reasoning within output tokens $0.00025068
Reliability by Benchmark (Text)
Loading reliability summary…
Text vs JSON Schema Comparison
Pass Rate Delta
-81.9% Text: 89.7% → JSON: 7.8%
+0
Gained
JSON pass / text fail
−183
Lost
Text pass / JSON fail
0
Unchanged Pass
Both pass
21
Unchanged Fail
Both fail
Fixture Reliability Delta
Fixture Text JSON Delta
Benchmark Deltas
Benchmark Text JSON Delta
commit_messages 100% 0% -100%
blame_forensics 100% 8.3% -91.7%
reflog 100% 8.3% -91.7%
stash_recovery 100% 8.3% -91.7%
tag_management 91.7% 0% -91.7%
commit_squash 91.7% 8.3% -83.3%
git_show 91.7% 8.3% -83.3%
merge_conflicts 83.3% 0% -83.3%
rebase 83.3% 0% -83.3%
worktree_usage 83.3% 0% -83.3%
cherry_pick 83.3% 8.3% -75%
git_bisect 100% 25% -75%
git_clean 75% 0% -75%
git_log_format 91.7% 16.7% -75%
submodule_usage 91.7% 16.7% -75%
branch_cleanup 75% 8.3% -66.7%
git_grep 83.3% 16.7% -66.7%
Changed Fixtures (183)
f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f005 -loss f006 -loss f007 -loss f008 -loss f010 -loss f011 -loss f012 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f004 -loss f005 -loss f006 -loss f007 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f008 -loss f009 -loss f010 -loss f011 -loss f012 -loss f001 -loss f002 -loss f003 -loss f004 -loss f005 -loss f006 -loss f007 -loss f009 -loss f011 -loss f012 -loss
Fixture Gallery (204)