Benchmark
commit_messages
12 fixtures
Model Leaderboard
Models ranked by pass rate on commit_messages. A model that dominates overall might rank lower here. That's the point.
Loading...
Tags
commit-message (12)
add (3)
multi-file (2)
single-file (1)
basic (1)
summarization (1)
rename (1)
file-operations (1)
deletion (1)
remove (1)
modification (1)
update (1)
replace (1)
add-and-delete (1)
mixed-changes (1)
subdirectory (1)
path-aware (1)
permissions (1)
executable (1)
metadata (1)
bug-fix (1)
fix (1)
semantics (1)
refactor (1)
structural-change (1)
config (1)
infrastructure (1)
documentation (1)
docs (1)
readme (1)
Per-Fixture Comparison
Loading...