Fixup commits - typo fixes should be squashed into original
Tests ability to squash fixup commits (typo fixes) into their original commit. Evaluates recognizing fixup/follow-up patterns.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
echo 'Initial content' > file.txt - 05
git add file.txt - 06
git commit -m 'Initial commit' - 07
echo 'Helllo world' > hello.py - 08
git add hello.py - 09
git commit -m 'Add hello world program' - 10
echo 'Hello world' > hello.py - 11
git add hello.py - 12
git commit -m 'fixup: Fix typo in hello.py'
Prompt
Analyze this git history and identify commits that are fixups of previous commits (like typo corrections). These should be marked as fixup/squash back into the original commit they fix. Do not include the original target commit as one of the commits to squash. Output ONLY the selected commits, one per line, with no explanation.
Expected
fixup: Fix typo in hello.py
Campaign Evidence
Loading campaign evidence…
Model Outputs (14)
1c1fc8f
72f6879
JSON Schema
Structured Output
(raw) { "commits": ["72f6879"] }
12dc0e9
69c332c
JSON Schema
Structured Output
(raw) { "commits": ["69c332c"] }
55c5270
fc0c9fd
JSON Schema
Structured Output
(raw) {"commits": ["fc0c9fd"]}
4731d0a
3dd6619
JSON Schema
Structured Output
(raw) { "commits": [ "3dd6619" ] }
4f6a7ea
26ad251
4ac5026
a05949f
JSON Schema
Structured Output
(raw) {
"commits": [
"4ac5026",
"a05949f"
]
}
cebeef7
e0b5b0c
JSON Schema
Structured Output
(raw) {"commits": ["e0b5b0c"]}
104e5a8 fixup: Fix typo in hello.py
7067789
JSON Schema
Structured Output
(raw) {"commits": ["7067789"]}