Benchmark
cherry_pick
12 fixtures
Model Leaderboard
Models ranked by pass rate on cherry_pick. A model that dominates overall might rank lower here. That's the point.
Loading...
Benchmark Quadrant
Quality and efficiency for cherry_pick only.
Loading...
Benchmark Cost
API cost summed from fixture results in this benchmark.
Loading...
Benchmark API Time
API latency from calls made for fixtures in this benchmark.
Loading...
Benchmark Token Usage
Source token counts come from provider-reported usage; GitBench calculates the displayed aggregates from them. Provider tokenizers and accounting methods may differ. Learn more ->
Loading...
Tags
cherry-pick (12)
conflict-resolution (12)
multi-file (3)
three-way (2)
single-line (1)
basic (1)
version-number (1)
semver (1)
status-message (1)
text-merge (1)
multi-line (1)
hunk-merge (1)
function-body (1)
code-merge (1)
config (1)
infrastructure (1)
port (1)
protocol (1)
partial-conflict (1)
author (1)
simultaneous-conflicts (1)
json (1)
structured-data (1)
dependency-management (1)
Per-Fixture Comparison
Loading...