Test commits first then implementation
Tests ability to squash test-first commits with their implementation commits. Evaluates recognizing TDD-style commit patterns.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
echo 'code' > app.py - 05
git add app.py - 06
git commit -m 'Initial app' - 07
echo 'import unittest' > test.py - 08
git add test.py - 09
git commit -m 'WIP: add test stub' - 10
echo 'import unittest class Test(unittest.TestCase): pass' > test.py - 11
git add test.py - 12
git commit -m 'WIP: expand test' - 13
echo 'import unittest class Test(unittest.TestCase): def test_ok(self): pass' > test.py - 14
git add test.py - 15
git commit -m 'Complete tests'
Prompt
Identify the WIP commits that should be marked as squash/fixup for a cleaner test file addition. Do not include the final complete-tests commit. Output ONLY the selected commit subject lines, one per line, with no explanation.
Expected
WIP: add test stub
WIP: expand test
Fixture Metrics
Scoped model quality, cost, API time, and token usage for commit_squash/f007.
Loading...
Raw Attempt Evidence
Loading raw attempt evidence…
Model Outputs (546)
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits":["WIP: add test stub","WIP: expand test"]}
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits": ["WIP: add test stub", "WIP: expand test"]}
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits": ["WIP: add test stub", "WIP: expand test"]}
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits": ["WIP: add test stub", "WIP: expand test"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits":["WIP: add test stub","WIP: expand test"]}
WIP: add test stub
WIP: expand test
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: add test stub
WIP: expand test
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: add test stub",
"WIP: expand test"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: add test stub
WIP: expand test
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: expand test", "WIP: add test stub" ] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: add test stub
WIP: expand test
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": ["WIP: expand test", "WIP: add test stub"] }
WIP: add test stub
WIP: expand test
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": ["WIP: expand test", "WIP: add test stub"]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw)
{
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits": ["WIP: add test stub", "WIP: expand test"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits":["WIP: add test stub","WIP: expand test"]}
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits":["WIP: add test stub","WIP: expand test"]}
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) {"commits":["WIP: add test stub","WIP: expand test"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: expand test", "WIP: add test stub" ] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: expand test", "WIP: add test stub" ] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": ["WIP: expand test", "WIP: add test stub"]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": ["WIP: expand test", "WIP: add test stub"] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": ["WIP: expand test", "WIP: add test stub"] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": ["WIP: expand test", "WIP: add test stub"] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": [
"WIP: expand test",
"WIP: add test stub"
] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: expand test", "WIP: add test stub" ] }
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: add test stub", "WIP: expand test" ] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["WIP: expand test", "WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": ["WIP: expand test", "WIP: add test stub"] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: expand test",
"WIP: add test stub"
]
}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: expand test", "WIP: add test stub" ] }
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["WIP: expand test","WIP: add test stub"]}
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: expand test", "WIP: add test stub" ] }
WIP: expand test
WIP: add test stub
WIP:expand test
WIP: add test stub
Failure: Missing expected commit messages: ['WIP: expand test']; Extra selected commit messages: ['WIP:expand test']
2849b3f WIP: add test stub
2cdb504 WIP: expand test
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: add test stub', 'WIP: expand test']
8d4526d WIP: expand test
e621029 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
1fe9066
f59ff8a
JSON Schema
Structured Output
(raw) {"commits": ["1fe9066", "f59ff8a"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
457f43c WIP: expand test
efe41ac WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["457f43c WIP: expand test","efe41ac WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
9ec85b8 WIP: expand test
7a3a5ff Initial app
JSON Schema
Structured Output
(raw) {"commits":["9ec85b8 WIP: expand test","7a3a5ff Initial app"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'Initial app']
be6cd10 WIP: expand test
6313e65 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["be6cd10 WIP: expand test","6313e65 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
```
bf2298f WIP: expand test
e01ef77 WIP: add test stub
```
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['```', 'WIP: expand test', 'WIP: add test stub', '```']
4058319 WIP: expand test
d9094b2 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["4058319 WIP: expand test","d9094b2 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
ef51489 WIP: expand test
6c0e190 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
8d92a64 WIP: expand test
ee5ed45 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["8d92a64 WIP: expand test","ee5ed45 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
f16150d
28378ad
JSON Schema
Structured Output
(raw) {"commits":["f16150d","28378ad"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
f6bd4a6 WIP: expand test
21c06b6 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
81d62d1 WIP: expand test
f85b785 WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"81d62d1 WIP: expand test",
"f85b785 WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
2762721 Complete tests
4971f90 WIP: expand test
b3b9f91 WIP: add test stub
40a2b4d Initial app
JSON Schema
Structured Output
(raw) {
"commits": [
"2762721 Complete tests",
"4971f90 WIP: expand test",
"b3b9f91 WIP: add test stub",
"40a2b4d Initial app"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['Complete tests', 'WIP: expand test', 'WIP: add test stub', 'Initial app']
26f0f12 Complete tests
085a154 WIP: expand test
6e8715f WIP: add test stub
b76dc7d Initial app
JSON Schema
Structured Output
(raw) {
"commits": [
"26f0f12 Complete tests",
"085a154 WIP: expand test",
"6e8715f WIP: add test stub",
"b76dc7d Initial app"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['Complete tests', 'WIP: expand test', 'WIP: add test stub', 'Initial app']
WIP: expand testWIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test']
356ffc7 Complete tests
a1ce462 WIP: expand test
cdd5594 WIP: add test stub
44ae9b3 Initial app
JSON Schema
Structured Output
(raw) {
"commits":[
"356ffc7 Complete tests",
"a1ce462 WIP: expand test",
"cdd5594 WIP: add test stub",
"44ae9b3 Initial app"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['Complete tests', 'WIP: expand test', 'WIP: add test stub', 'Initial app']
f289bd3 WIP: expand test
3b589c9 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
1878e72 WIP: expand test
44e84b7 WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": ["1878e72 WIP: expand test", "44e84b7 WIP: add test stub"] }
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
2897886 WIP: expand test
f46bbd1 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
f851066 WIP: expand test
d2e5cd3 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
c9a2333 WIP: expand test
d6c3ea7 WIP: add test stub
JSON Schema
Structured Output
(raw) { "commits": ["c9a2333 WIP: expand test", "d6c3ea7 WIP: add test stub"] }
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
95d8be2 WIP: add test stub
32583c0 WIP: expand test
JSON Schema
Structured Output
(raw) {
"commits": [
"95d8be2 WIP: add test stub",
"32583c0 WIP: expand test"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: add test stub', 'WIP: expand test']
f13b0bd WIP: expand test
5e55192 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["f13b0bd WIP: expand test","5e55192 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
Invalid JSON. Output: WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
6821ae6 WIP: expand test
351fb55 WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"6821ae6 WIP: expand test",
"351fb55 WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
9b33431 WIP: expand test
642769e WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["9b33431 WIP: expand test","642769e WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
89e7a55 WIP: expand test
6e4d9d1 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["89e7a55 WIP: expand test", "6e4d9d1 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
dbfdbad WIP: expand test
d0ffb28 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["dbfdbad WIP: expand test", "d0ffb28 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
33c7149 WIP: expand test
63850b0 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["33c7149 WIP: expand test", "63850b0 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
1be6744 WIP: expand test
97d3c92 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
d0fb627 WIP: expand test
24a663e WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["d0fb627 WIP: expand test", "24a663e WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
ff4f0e8 WIP: expand test
828a99e WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"ff4f0e8 WIP: expand test",
"828a99e WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
79a4785 WIP: expand test
a406b8d WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"79a4785 WIP: expand test",
"a406b8d WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
40f253c WIP: expand test
e1e20ed WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
Invalid JSON. Output: c7f0f06
8b7d28e
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
b520bdb WIP: expand test
6d6f160 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
(empty output)
JSON Schema
Structured Output
(raw) {"commits":[]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']
85ed1ed WIP: expand test
09c0731 WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"85ed1ed WIP: expand test",
"09c0731 WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
1d97836 WIP: expand test
dcd72a5 WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"1d97836 WIP: expand test",
"dcd72a5 WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
(empty output)
JSON Schema
Structured Output
(raw) {"commits":[]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']
Invalid JSON. Output: WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 2 (char 1)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
5997475 WIP: expand test
cfdcc9d WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"5997475 WIP: expand test",
"cfdcc9d WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
expand test
add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['expand test', 'add test stub']
c9674ca WIP: expand test
b6beae7 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
5e04af4 WIP: expand test
91af402 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
985fb9b WIP: expand test
9ec08fc WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits":["985fb9b WIP: expand test","9ec08fc WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
a2488e7 Complete tests
a541a4b WIP: add test stub
a2488e7 Complete tests
a541a4b WIP: add test stub
0ab0627 WIP: expand test
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['Complete tests', 'WIP: add test stub', 'Complete tests', 'WIP: add test stub', 'WIP: expand test']
1d20d05 WIP: expand test
c7f4bcf WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["1d20d05 WIP: expand test", "c7f4bcf WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
54882f5 WIP: expand test
a0dcd38 WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"54882f5 WIP: expand test",
"a0dcd38 WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
4d7a7eb WIP: expand test
8dc52a8 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["4d7a7eb WIP: expand test", "8dc52a8 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
e4512d4 WIP: expand test
079008c WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"e4512d4 WIP: expand test",
"079008c WIP: add test stub"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
e51e3d2
2937100
JSON Schema
Structured Output
(raw) {
"commits": [
"e51e3d2",
"2937100"
]
}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6aa25e82-151c-9194-917e-63cd058a9fdd","request_id":"6aa25e82-151c-9194-917e-63cd058a9fdd"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-77caaba0-611d-951a-ba2a-fb25ed21b717","request_id":"77caaba0-611d-951a-ba2a-fb25ed21b717"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8d80388e-e65d-91b5-a27e-07882b855924","request_id":"8d80388e-e65d-91b5-a27e-07882b855924"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-65dc8f8b-0f6c-9349-a5a6-f0a66d6b934a","request_id":"65dc8f8b-0f6c-9349-a5a6-f0a66d6b934a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-faf563da-cf2e-9597-a7c6-bb352b6eca95","request_id":"faf563da-cf2e-9597-a7c6-bb352b6eca95"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-eb057b81-1444-9097-9f19-c39ffd4ae0b4"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-bb979bf3-6196-969b-897a-ce88d182863d"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-103cf73e-69b9-951c-8dd0-83985fe3e536"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-055d0590-9872-97f3-afda-9aa0ce5f0497"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-037d3004-0bb5-908e-8ee7-5230a1a4f840"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-563b3e94-1868-9659-b929-0862455fe7d4"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-75d7e77e-94cb-90bf-819d-bd9b79174d41","request_id":"75d7e77e-94cb-90bf-819d-bd9b79174d41"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-07f8d751-e5ee-9586-b1f5-732f909b6ffe","request_id":"07f8d751-e5ee-9586-b1f5-732f909b6ffe"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-afe8fb38-4f5b-986c-bc0f-52717d2e67f4","request_id":"afe8fb38-4f5b-986c-bc0f-52717d2e67f4"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-5208d7cd-1fe5-947a-96d1-0b32ad047225","request_id":"5208d7cd-1fe5-947a-96d1-0b32ad047225"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-cd054787-d5c3-9d8b-9af0-1d873059841a","request_id":"cd054787-d5c3-9d8b-9af0-1d873059841a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-166d2e3a-b03a-9020-a196-19fed42f5003","request_id":"166d2e3a-b03a-9020-a196-19fed42f5003"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-5e113362-b969-924b-84ce-759a907d9395","request_id":"5e113362-b969-924b-84ce-759a907d9395"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8f307235-36d1-95bc-8f6d-c640d806704d","request_id":"8f307235-36d1-95bc-8f6d-c640d806704d"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a7280d76-bd47-979e-ac4f-e0d618a4032f","request_id":"a7280d76-bd47-979e-ac4f-e0d618a4032f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-6a0bd167-d692-97b1-9151-099abf3351dc","request_id":"6a0bd167-d692-97b1-9151-099abf3351dc"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: WIP: expand test
WIP: add test stub{"commits": ["ff9ad08 WIP: expand test", "ea5ab48 WIP: add test stub"]}
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
7c26d69 WIP: expand test
79f0aa0 WIP: add test stub
JSON Schema
Structured Output
(raw) {
"commits": [
"7c26d69 WIP: expand test",
"79f0aa0 WIP: add test stub"
]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
13e3a0c WIP: expand test
3ab8217 WIP: add test stub
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']
Invalid JSON. Output: WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: WIP: expand test
WIP: add test stub
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
1bde5ee WIP: expand test
84a5dd7 WIP: add test stub
JSON Schema
Structured Output
(raw) {"commits": ["1bde5ee WIP: expand test", "84a5dd7 WIP: add test stub"]}
Failure: Missing expected commit messages: ['WIP: add test stub', 'WIP: expand test']; Extra selected commit messages: ['WIP: expand test', 'WIP: add test stub']