Single merged branch
Tests ability to identify a single merged branch that can be safely deleted. Evaluates basic git branch --merged comprehension.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
echo 'Hello' > greeting.txt - 05
git add greeting.txt - 06
git commit -m 'Initial commit' - 07
git checkout -b fix-typo - 08
echo 'Hello fixed' > greeting.txt - 09
git add greeting.txt - 10
git commit -m 'Fix typo' - 11
git checkout main - 12
git merge fix-typo - 13
git checkout -b feature-login - 14
echo 'Login code' > login.py - 15
git add login.py - 16
git commit -m 'Add login'
Prompt
Look at the branches in this repository. Which branches should be deleted because they are fully merged into main? List ONLY the branch names to delete, one per line. If none, respond with 'none'.
Expected
fix-typo
Campaign Evidence
Loading campaign evidence…
Model Outputs (14)
fix-typo
fix-typo
fix-typo
JSON Schema
Structured Output
(raw) {
"branches_to_delete": [
"fix-typo"
]
}
fix-typo
fix-typo
JSON Schema
Structured Output
(raw) {"branches_to_delete": ["fix-typo"]}
fix-typo
fix-typo
JSON Schema
Structured Output
(raw) {
"branches_to_delete": [
"fix-typo"
]
}
fix-typo
main
Failure: Extra: ['main']
fix-typo
main
JSON Schema
Structured Output
(raw) {
"branches_to_delete": [
"fix-typo",
"main"
]
}
Failure: Extra: ['main']
fix-typo
fix-typo
JSON Schema
Structured Output
(raw) {"branches_to_delete": ["fix-typo"]}
feature-login
fix-typo
Failure: Extra: ['feature-login']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
feature-login
JSON Schema
Structured Output
(raw) {"branches_to_delete": ["feature-login"]}
Failure: Missing: ['fix-typo']
Extra: ['feature-login']