Show binary file change in commit
Tests ability to inspect a binary file change in a commit. Evaluates binary-change handling in commit display.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
printf 'PNG binary' > image.png - 05
git add image.png - 06
git commit -m 'Add binary image' - 07
printf 'PNG updated' > image.png - 08
git add image.png - 09
git commit -m 'Update binary image'
Prompt
Using git show --stat, which file was changed in the 'Update binary image' commit? Output ONLY the filename, nothing else.
Expected
image.png
Fixture Metrics
Scoped model quality, cost, API time, and token usage for git_show/f011.
Loading...
Raw Attempt Evidence
Loading raw attempt evidence…
Model Outputs (546)
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
image.png
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename":"image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw)
{
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw)
{
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw)
{
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw)
{
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename":"image.png"}
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
image.png
JSON Schema
Structured Output
(raw) { "filename": "image.png" }
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {
"filename": "image.png"
}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
image.png
image.png
JSON Schema
Structured Output
(raw) {"filename": "image.png"}
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: image.png
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: image.png
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-e4042a8c-cca9-9410-a4f7-c4422e63d8b7","request_id":"e4042a8c-cca9-9410-a4f7-c4422e63d8b7"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8fe6170b-c50a-9763-bc4a-078ab8191c15","request_id":"8fe6170b-c50a-9763-bc4a-078ab8191c15"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-040b2ed3-b80a-94ac-836b-5c60b1d8cc47","request_id":"040b2ed3-b80a-94ac-836b-5c60b1d8cc47"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-e9fc70fa-9053-9d4a-9cf9-f3080c3c7040","request_id":"e9fc70fa-9053-9d4a-9cf9-f3080c3c7040"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-aba0f817-d4d8-992b-ab38-35b62dc8cc2a","request_id":"aba0f817-d4d8-992b-ab38-35b62dc8cc2a"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-462f57b1-4723-9a6d-b714-93a10a9900c8"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-45fd74c8-d885-91cf-a941-94e08fd1056b"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-5456784c-10a1-9ba5-ab2f-380b40fcdaeb"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-9fab3d2e-af72-954e-84e7-25206a565235"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-c56b26f8-b7ec-9f37-9f1d-e8d689006fed"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-38bb9b67-1653-90a9-a6ea-d7b90b796d0d"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1c9be033-ae51-9805-9dce-5ed120d7666d","request_id":"1c9be033-ae51-9805-9dce-5ed120d7666d"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-838b1794-f662-9073-9f16-78b39568c9d6","request_id":"838b1794-f662-9073-9f16-78b39568c9d6"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-e249cae8-3565-9457-9547-f5aaecb65fae","request_id":"e249cae8-3565-9457-9547-f5aaecb65fae"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-8cad4c98-5bd6-91bb-9a2e-9b3e7121ce3d","request_id":"8cad4c98-5bd6-91bb-9a2e-9b3e7121ce3d"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-0c8ce4de-4bd6-9e2b-a052-86166cf4cc17","request_id":"0c8ce4de-4bd6-9e2b-a052-86166cf4cc17"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-7fad7341-77e2-9d7d-8443-7491553ae256","request_id":"7fad7341-77e2-9d7d-8443-7491553ae256"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-f5fb73ee-45c5-9ed0-b600-5eff3cc7eabe","request_id":"f5fb73ee-45c5-9ed0-b600-5eff3cc7eabe"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-ec7a88d7-b9bc-911d-879b-b361792aef51","request_id":"ec7a88d7-b9bc-911d-879b-b361792aef51"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-96348afc-5816-9f03-8270-498b3ce7cec1","request_id":"96348afc-5816-9f03-8270-498b3ce7cec1"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1d11ce4f-1117-92cb-bc93-c7d21fc5fed9","request_id":"1d11ce4f-1117-92cb-bc93-c7d21fc5fed9"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
image.png<|end_message|>
Failure: Expected 'image.png', got 'image.png<|end_message|>'
Invalid JSON. Output: image.png{ "filename": "image.png" }
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: image.png
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: image.png
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: image.png
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
image.png<|end_message|>
Failure: Expected 'image.png', got 'image.png<|end_message|>'
Invalid JSON. Output: image.png{ "filename": "image.png" }
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)