Benchmark
commit_messages
12 fixtures
Model Leaderboard
Models ranked by pass rate on commit_messages. A model that dominates overall might rank lower here. That's the point.
Loading...
Benchmark Quadrant
Quality and efficiency for commit_messages only.
Loading...
Benchmark Cost
API cost summed from fixture results in this benchmark.
Loading...
Benchmark API Time
API latency from calls made for fixtures in this benchmark.
Loading...
Benchmark Token Usage
Source token counts come from provider-reported usage; GitBench calculates the displayed aggregates from them. Provider tokenizers and accounting methods may differ. Learn more ->
Loading...
Tags
commit-message (12)
add (3)
multi-file (2)
single-file (1)
basic (1)
summarization (1)
rename (1)
file-operations (1)
deletion (1)
remove (1)
modification (1)
update (1)
replace (1)
add-and-delete (1)
mixed-changes (1)
subdirectory (1)
path-aware (1)
permissions (1)
executable (1)
metadata (1)
bug-fix (1)
fix (1)
semantics (1)
refactor (1)
structural-change (1)
config (1)
infrastructure (1)
documentation (1)
docs (1)
readme (1)
Per-Fixture Comparison
Loading...