Create a lightweight tag on HEAD
Tests ability to create a lightweight tag on HEAD. Evaluates basic tag-creation command knowledge.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
echo 'Hello' > hello.txt - 05
git add hello.txt - 06
git commit -m 'Initial commit' - 07
echo 'World' > world.txt - 08
git add world.txt - 09
git commit -m 'Add world'
Prompt
Create a lightweight git tag named 'v1.0' pointing at the current HEAD. Output ONLY the git command, nothing else.
Expected
git tag v1.0
Campaign Evidence
Loading campaign evidence…
Model Outputs (14)
git tag v1.0
git tag v1.0
git tag v1.0
JSON Schema
Structured Output
(raw) {"command": "git tag v1.0"}
git tag v1.0
JSON Schema
Structured Output
(raw) {"command": "git tag v1.0"}
git tag v1.0
git tag v1.0
JSON Schema
Structured Output
(raw) {
"command": "git tag v1.0"
}
git tag -f v1.0
git tag v1.0
JSON Schema
Structured Output
(raw) {
"command": "git tag v1.0"
}
git tag v1.0
git tag v1.0
JSON Schema
Structured Output
(raw) {"command": "git tag v1.0"}
git tag -a v1.0 -m "v1.0"
git tag -a v1.0 -m "v1.0" HEAD
JSON Schema
Structured Output
(raw) {"command": "git tag -a v1.0 -m \"v1.0\" HEAD"}
Invalid JSON. Output: git tag v1.0
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
```bash
git tag v1.0
```
Failure: Failed assertions: [{'type': 'git_output', 'command': 'git tag -l', 'contains': 'v1.0'}, {'type': 'git_output', 'command': 'git log v1.0 --oneline -1', 'contains': 'Add world'}]