git_log_format | GitBench

Benchmark

git_log_format

12 fixtures

Model Leaderboard

Models ranked by pass rate on git_log_format. A model that dominates overall might rank lower here. That's the point.

Benchmark Quadrant

Quality and efficiency for git_log_format only.

Benchmark Cost

API cost summed from fixture results in this benchmark.

Benchmark API Time

API latency from calls made for fixtures in this benchmark.

Benchmark Token Usage

Source token counts come from provider-reported usage; GitBench calculates the displayed aggregates from them. Provider tokenizers and accounting methods may differ. Learn more ->