Style fixes mixed with content changes
Tests ability to squash style-fix commits with their related content commits. Evaluates separating cosmetic from functional changes.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
echo 'def foo(): pass' > script.py - 05
git add script.py - 06
git commit -m 'Add function foo' - 07
echo 'def foo(): x=1' > script.py - 08
git add script.py - 09
git commit -m 'WIP: add logic' - 10
echo 'def foo(): x = 1' > script.py - 11
git add script.py - 12
git commit -m 'WIP: style fix' - 13
echo 'def foo(): x = 1 return x' > script.py - 14
git add script.py - 15
git commit -m 'Return value'
Prompt
Identify the WIP commits that should be marked as squash/fixup; these represent incremental implementation work that should be combined. Do not include the non-WIP anchor commits. Output ONLY the selected commit subject lines, one per line, with no explanation.
Expected
WIP: add logic
WIP: style fix
Fixture Metrics
Scoped model quality, cost, API time, and token usage for commit_squash/f009.
Loading...
Raw Attempt Evidence
Loading raw attempt evidence…
Model Outputs (546)
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: add logic
WIP: style fix
JSON Schema
Structured Output
(raw) {"commits": ["WIP: add logic", "WIP: style fix"]}
WIP: add logic
WIP: style fix
WIP: style fix
WIP: add logic
WIP: add logic
WIP: style fix
JSON Schema
Structured Output
(raw) {"commits": ["WIP: add logic", "WIP: style fix"]}
WIP: add logic
WIP: style fix
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: add logic
WIP: style fix
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": ["WIP: style fix", "WIP: add logic"]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": ["WIP: style fix", "WIP: add logic"]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["Return value","WIP: style fix","WIP: add logic"]}
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["Return value","WIP: style fix","WIP: add logic"]}
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["Return value","WIP: style fix","WIP: add logic"]}
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["Return value","WIP: style fix","WIP: add logic"]}
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["Return value","WIP: style fix","WIP: add logic"]}
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: add logic
WIP: style fix
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: style fix", "WIP: add logic" ] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix\n",
"WIP: add logic\n"
]
}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: style fix", "WIP: add logic" ] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: style fix", "WIP: add logic" ] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: style fix", "WIP: add logic" ] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":[
"WIP: style fix",
"WIP: add logic"
]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
Return value
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"Return value",
"WIP: style fix",
"WIP: add logic"
]
}
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": ["WIP: style fix", "WIP: add logic"]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": ["WIP: style fix", "WIP: add logic"]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": [
"WIP: style fix",
"WIP: add logic"
]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: style fix", "WIP: add logic" ] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: style fix", "WIP: add logic" ] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["WIP: style fix", "WIP: add logic"] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["WIP: style fix","WIP: add logic"]}
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: add logic
WIP: style fix
JSON Schema
Structured Output
(raw) {"commits": ["WIP: add logic", "WIP: style fix"]}
Return value
WIP: style fix
WIP: add logic
Failure: Extra selected commit messages: ['Return value']
Return value
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["Return value", "WIP: style fix", "WIP: add logic"]}
Failure: Extra selected commit messages: ['Return value']
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["WIP: style fix", "WIP: add logic"]}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": [ "WIP: style fix", "WIP: add logic" ] }
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
WIP: style fix
WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"WIP: style fix",
"WIP: add logic"
]
}
WIP: stylefix
WIP: add logic
Failure: Missing expected commit messages: ['WIP: style fix']; Extra selected commit messages: ['WIP: stylefix']
IP: style fix
WIP: add logic
Failure: Missing expected commit messages: ['WIP: style fix']; Extra selected commit messages: ['IP: style fix']
72a818b WIP: style fix
2ecb01a WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["72a818b WIP: style fix", "2ecb01a WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
256e7aa WIP: style fix
98f0649 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
93bdbb9
13935ed
JSON Schema
Structured Output
(raw) {"commits": ["93bdbb9", "13935ed"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
9d00b92 WIP: style fix
1f01fc4 WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["9d00b92 WIP: style fix", "1f01fc4 WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
4957cbc WIP: style fix
8721e31 WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["4957cbc WIP: style fix","8721e31 WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
0d854f2 WIP: style fix
4675c04 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
f5e8a67 WIP: add logic
179ac66 WIP: style fix
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: add logic', 'WIP: style fix']
9fb1632 WIP: add logic
6c02d3e WIP: style fix
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: add logic', 'WIP: style fix']
c555105 WIP: style fix
edb3ebe WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
4f86e24 WIP: style fix
eba9633 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
```
76b5220 WIP: style fix
1233ff2 WIP: add logic
```
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['```', 'WIP: style fix', 'WIP: add logic', '```']
```
cc3a611 WIP: style fix
3b766c8 WIP: add logic
```
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['```', 'WIP: style fix', 'WIP: add logic', '```']
42af9ae WIP: style fix
c098f59 WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["42af9ae WIP: style fix","c098f59 WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
7596c09 WIP: style fix
790f2d7 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
87ed7b0 Return value
0db1a25 WIP: style fix
06e371c WIP: add logic
b8cdb9c Add function foo
JSON Schema
Structured Output
(raw) {
"commits": [
"87ed7b0 Return value",
"0db1a25 WIP: style fix",
"06e371c WIP: add logic",
"b8cdb9c Add function foo"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['Return value', 'WIP: style fix', 'WIP: add logic', 'Add function foo']
WIP: style fixWIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix']
266a299 Return value
56eab02 WIP: style fix
fff558b WIP: add logic
21f6074 Add function foo
JSON Schema
Structured Output
(raw) {
"commits": [
"266a299 Return value",
"56eab02 WIP: style fix",
"fff558b WIP: add logic",
"21f6074 Add function foo"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['Return value', 'WIP: style fix', 'WIP: add logic', 'Add function foo']
445d9bb Return value
a11900d WIP: style fix
ce92519 WIP: add logic
01bd0aa Add function foo
JSON Schema
Structured Output
(raw) {
"commits": [
"445d9bb Return value",
"a11900d WIP: style fix",
"ce92519 WIP: add logic",
"01bd0aa Add function foo"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['Return value', 'WIP: style fix', 'WIP: add logic', 'Add function foo']
02cdb5e Return value
555334a WIP: style fix
82d8397 WIP: add logic
0efc9d7 Add function foo
JSON Schema
Structured Output
(raw) {
"commits": [
"02cdb5e Return value",
"555334a WIP: style fix",
"82d8397 WIP: add logic",
"0efc9d7 Add function foo"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['Return value', 'WIP: style fix', 'WIP: add logic', 'Add function foo']
4452a38 WIP: style fix
d4e77af WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"4452a38 WIP: style fix",
"d4e77af WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
de7e49f WIP: style fix
6830b80 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
cf89fcb WIP: style fix
0d9135a WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"cf89fcb WIP: style fix",
"0d9135a WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
Invalid JSON. Output: WIP: style fix
WIP: add logic
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
c61e133 WIP: style fix
13a07c0 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
(empty output)
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']
a1b2fc4 WIP: style fix
95e0056 WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"a1b2fc4 WIP: style fix",
"95e0056 WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
349cd78 WIP: style fix
c2edc0c WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["349cd78 WIP: style fix", "c2edc0c WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
7da197f WIP: style fix
a0422dd WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"7da197f WIP: style fix",
"a0422dd WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
02477b9 WIP: style fix
1df0a26 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
8a6f6d8 WIP: style fix
c6a21e3 WIP: add logic
JSON Schema
Structured Output
(raw) {"commits":["8a6f6d8 WIP: style fix","c6a21e3 WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
4bdb161 WIP: style fix
bc13e97 WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": [ "4bdb161 WIP: style fix", "bc13e97 WIP: add logic" ] }
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
604afad WIP: style fix
e722a02 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
c1d5e32 WIP: style fix
4aa5775 WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["c1d5e32 WIP: style fix", "4aa5775 WIP: add logic"] }
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
(empty output)
JSON Schema
Structured Output
(raw) {
"commits": []
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']
6159d52
aac61b4
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
Invalid JSON. Output: d2b99cd
c6c673e
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
4f354bc Return value
b2d0759 WIP: style fix
61a8204 WIP: add logic
1eeb57f Add function foo
JSON Schema
Structured Output
(raw) {
"commits": [
"4f354bc Return value",
"b2d0759 WIP: style fix",
"61a8204 WIP: add logic",
"1eeb57f Add function foo"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['Return value', 'WIP: style fix', 'WIP: add logic', 'Add function foo']
2327388 WIP: style fix
22e9c7b WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["2327388 WIP: style fix", "22e9c7b WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
4c5253f WIP: style fix
51e4285 WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["4c5253f WIP: style fix", "51e4285 WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
1357727 WIP: style fix
0734bc8 WIP: add logic
JSON Schema
Structured Output
(raw) {"commits": ["1357727 WIP: style fix", "0734bc8 WIP: add logic"]}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
f11e88f WIP: style fix
2aed45b WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"f11e88f WIP: style fix",
"2aed45b WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
96e46c9 WIP: style fix
864858e WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
bda6fc3 WIP: style fix
ae33abf WIP: add logic
JSON Schema
Structured Output
(raw)
{
"commits": [
"bda6fc3 WIP: style fix",
"ae33abf WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
.*WIP.*
JSON Schema
Structured Output
(raw) { "commits": [".*WIP.*"] }
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['.*WIP.*']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
style fix
add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['style fix', 'add logic']
58118b7
ee188a0
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
style fix
add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['style fix', 'add logic']
c441dd0 WIP: style fix
0f737ec WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"c441dd0 WIP: style fix",
"0f737ec WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
fe870ec WIP: style fix
12b20dc WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
e7cb6ca WIP: style fix
2a4f461 WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"e7cb6ca WIP: style fix",
"2a4f461 WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
97fac4b Return value
ffe5dd2 WIP: style fix
4195529 WIP: add logic
db9a3f2 Add function foo
JSON Schema
Structured Output
(raw) {
"commits": [
"97fac4b Return value",
"ffe5dd2 WIP: style fix",
"4195529 WIP: add logic",
"db9a3f2 Add function foo"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['Return value', 'WIP: style fix', 'WIP: add logic', 'Add function foo']
946ef0b WIP: style fix
f3029f5 WIP: add logic
JSON Schema
Structured Output
(raw) { "commits": ["946ef0b WIP: style fix", "f3029f5 WIP: add logic"] }
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d9cd8418-9f0b-99c3-b2dc-3e77c3b9b5f3","request_id":"d9cd8418-9f0b-99c3-b2dc-3e77c3b9b5f3"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-13c4df32-e040-9459-b9ca-95e74d4acd03","request_id":"13c4df32-e040-9459-b9ca-95e74d4acd03"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-71d357cc-f7c0-9f3b-ae64-91c2b16a2b7c","request_id":"71d357cc-f7c0-9f3b-ae64-91c2b16a2b7c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-552b31ce-b4b7-9b5c-9ed9-b2a9454c514d","request_id":"552b31ce-b4b7-9b5c-9ed9-b2a9454c514d"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-383a7515-92e9-9180-8109-5a54b9ddf3ee","request_id":"383a7515-92e9-9180-8109-5a54b9ddf3ee"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-8390fd48-7a62-9f24-a8f6-455348d9468f"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-08c370b5-1ea7-95f2-b838-64e614a07e17"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-209e1a1c-b17c-9bf2-b44e-c8e8af806d60"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-492457ca-90a3-9ea4-8fe2-528eacc88886"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-d3d982b4-b02c-9826-84dc-5c9d39a26504"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-e797c682-b7b6-95e0-ad02-e4b3a0006e5f"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-7d0b4d2b-65fe-9f3b-b403-3fe72be3ace0","request_id":"7d0b4d2b-65fe-9f3b-b403-3fe72be3ace0"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-204cfa1a-cf12-9116-b269-18c6fee62ed2","request_id":"204cfa1a-cf12-9116-b269-18c6fee62ed2"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d974ce94-483e-9148-9296-d33cd8fa6655","request_id":"d974ce94-483e-9148-9296-d33cd8fa6655"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f42b6566-495e-948b-aec9-2ea92f832a2f","request_id":"f42b6566-495e-948b-aec9-2ea92f832a2f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-c29124cc-dce7-9216-a2fc-1659f1995a99","request_id":"c29124cc-dce7-9216-a2fc-1659f1995a99"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-17bff19c-fce0-9bb5-b066-9289d092a384","request_id":"17bff19c-fce0-9bb5-b066-9289d092a384"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-c84401cd-0287-93c5-8d46-a91e2103d745","request_id":"c84401cd-0287-93c5-8d46-a91e2103d745"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
cc98eb0 WIP: style fix
30f6710 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-11ddfb88-b3ce-9c40-aff4-2bd5d055aa97","request_id":"11ddfb88-b3ce-9c40-aff4-2bd5d055aa97"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-9a3e5007-038e-9aee-a154-b1eeff0d3a8c","request_id":"9a3e5007-038e-9aee-a154-b1eeff0d3a8c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-4c883659-a0da-9d6d-b3d4-86549f29b8c1","request_id":"4c883659-a0da-9d6d-b3d4-86549f29b8c1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Model 'tencent/hy3:none' violated the reasoning_level=none invariant: provider reported 339 reasoning token(s)
Invalid JSON. Output: WIP: style fix
WIP: add logic{ "commits": [ "f17b1d9 WIP: style fix", "c6583f5 WIP: add logic" ] }
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: WIP: style fix
WIP: add logic
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: WIP: style fix
WIP: add logic
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: WIP: style fix
WIP: add logic
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
21c665d WIP: style fix
4dec416 WIP: add logic
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
22761e9 WIP: style fix
8845168 WIP: add logic
JSON Schema
Structured Output
(raw) {
"commits": [
"22761e9 WIP: style fix",
"8845168 WIP: add logic"
]
}
Failure: Missing expected commit messages: ['WIP: add logic', 'WIP: style fix']; Extra selected commit messages: ['WIP: style fix', 'WIP: add logic']