Feature branches merged and unmerged
Tests ability to distinguish merged from unmerged feature branches. Evaluates selective branch cleanup with mixed merge status.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
echo 'App' > app.py - 05
git add app.py - 06
git commit -m 'Initial app' - 07
git checkout -b feature-auth - 08
echo 'auth' > auth.py - 09
git add auth.py - 10
git commit -m 'Add auth' - 11
git checkout main - 12
git merge feature-auth - 13
git checkout -b feature-db - 14
echo 'db' > db.py - 15
git add db.py - 16
git commit -m 'Add db' - 17
git checkout main - 18
git merge feature-db - 19
git checkout -b feature-api - 20
echo 'api' > api.py - 21
git add api.py - 22
git commit -m 'Add api' - 23
git checkout main - 24
git checkout -b feature-ui - 25
echo 'ui' > ui.py - 26
git add ui.py - 27
git commit -m 'Add ui' - 28
git checkout main
Prompt
Look at the branches in this repository. Which branches should be deleted because they are fully merged into main? List ONLY the branch names to delete, one per line. If none, respond with 'none'.
Expected
feature-auth
feature-db
Campaign Evidence
Loading campaign evidence…
Model Outputs (14)
feature-auth
feature-db
feature-auth
feature-db
feature-auth
feature-db
JSON Schema
Structured Output
(raw) {"branches_to_delete": ["feature-auth", "feature-db"]}
feature-auth
feature-db
feature-auth
feature-db
JSON Schema
Structured Output
(raw) {"branches_to_delete": ["feature-auth", "feature-db"]}
feature-auth
feature-db
feature-auth
feature-db
JSON Schema
Structured Output
(raw) {
"branches_to_delete": [
"feature-auth",
"feature-db"
]
}
feature-auth
feature-db
feature-ui
JSON Schema
Structured Output
(raw) {"branches_to_delete": ["feature-auth","feature-db","feature-ui"]}
Failure: Extra: ['feature-ui']
feature-auth
feature-db
feature-auth
feature-db
JSON Schema
Structured Output
(raw) {"branches_to_delete": ["feature-auth", "feature-db"]}
feature-auth
feature-db
feature-auth
feature-db
JSON Schema
Structured Output
(raw) {
"branches_to_delete": [
"feature-auth",
"feature-db"
]
}
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
none
Failure: Missing: ['feature-auth', 'feature-db']
Extra: ['none']