Single-line version number conflict
Tests ability to resolve a version number merge conflict. Evaluates semantic versioning awareness in conflict resolution.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
echo 'VERSION=1.0.0' > version.txt - 05
git add version.txt - 06
git commit -m 'Initial version' - 07
git checkout -b release - 08
echo 'VERSION=2.0.0' > version.txt - 09
git add version.txt - 10
git commit -m 'Bump major version' - 11
git checkout main - 12
echo 'VERSION=1.1.0' > version.txt - 13
git add version.txt - 14
git commit -m 'Bump minor version' - 15
git merge release
Prompt
Resolve the merge conflict in version.txt. The base version was 'VERSION=1.0.0'. Branch A (release) changed it to 'VERSION=2.0.0'. Branch B (main) changed it to 'VERSION=1.1.0'. Provide ONLY the resolved file content.
Expected
VERSION=2.0.0
Campaign Evidence
Loading campaign evidence…
Model Outputs (14)
VERSION=2.0.0
VERSION=2.0.0
JSON Schema
Structured Output
(raw) {
"resolved_content": "VERSION=2.0.0"
}
VERSION=2.0.0
VERSION=2.0.0
JSON Schema
Structured Output
(raw) {
"resolved_content": "VERSION=2.0.0\n"
}
VERSION=2.0.0
VERSION=2.0.0
JSON Schema
Structured Output
(raw) {"resolved_content": "VERSION=2.0.0"}
VERSION=2.0.0
VERSION=2.0.0
JSON Schema
Structured Output
(raw) {
"resolved_content": "VERSION=2.0.0"
}
VERSION=2.0.0
VERSION=2.0.0
VERSION=2.0.0
JSON Schema
Structured Output
(raw) {"resolved_content": "VERSION=2.0.0"}
VERSION=2.0.0
VERSION=2.0.0
JSON Schema
Structured Output
(raw) {"resolved_content": "VERSION=2.0.0"}
VERSION=1.1.0
JSON Schema
Structured Output
(raw) {
"resolved_content": "VERSION=1.1.0"
}
Failure: Expected 'VERSION=2.0.0', got 'VERSION=1.1.0'