Show file content at a specific revision
Tests ability to show file content at a specific revision. Evaluates historical-file-content retrieval.
Baseline Repository
These commands set up the repo before the model sees the prompt. They define the starting file structure, staged changes, and Git history.
- 01
git init - 02
git config user.email 'test@test.com' - 03
git config user.name 'Test User' - 04
echo 'version one' > doc.txt - 05
git add doc.txt - 06
git commit -m 'First version' - 07
FIRST=$(git rev-parse HEAD) - 08
echo 'version two' > doc.txt - 09
git add doc.txt - 10
git commit -m 'Second version'
Prompt
Using git show HEAD~1:doc.txt, what was the content of doc.txt in the first commit? Output ONLY the file content, nothing else.
Expected
version one
Fixture Metrics
Scoped model quality, cost, API time, and token usage for git_show/f005.
Loading...
Raw Attempt Evidence
Loading raw attempt evidence…
Model Outputs (546)
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
version one
version one
version one
version one
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one\n" }
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one\n" }
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one\n"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw)
{
"content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one\n"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one\n"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one\n"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one\n"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one\n" }
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one\n" }
version one
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
JSON Schema
Structured Output
(raw) {"content":"version one"}
version one
version one
version one
version one
version one
JSON Schema
Structured Output
(raw) {"content": "version one"}
version one
version one
version one
version one
JSON Schema
Structured Output
(raw) { "content": "version one" }
version one
version one
version one
JSON Schema
Structured Output
(raw) {
"content": "version one"
}
version one
(empty output)
Failure: Expected 'version one', got ''
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Looking at the diff, the second commit changed "version one" to "version two". So `HEAD~1` (the first commit) contained:
version one
Failure: Expected 'version one', got 'Looking at the diff, the second commit changed "version one" to "version two". So `HEAD~1` (the first commit) contained:
version one'
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
-version one
Failure: Expected 'version one', got '
-version one'
-version one
JSON Schema
Structured Output
(raw) {
"content": "-version one"
}
Failure: Expected 'version one', got '-version one'
-version one
JSON Schema
Structured Output
(raw) {
"content": "-version one"
}
Failure: Expected 'version one', got '-version one'
-version one
Failure: Expected 'version one', got '
-version one'
-version one
JSON Schema
Structured Output
(raw) {
"content": "-version one"
}
Failure: Expected 'version one', got '-version one'
-version one
JSON Schema
Structured Output
(raw) {
"content": "-version one"
}
Failure: Expected 'version one', got '-version one'
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
version two
JSON Schema
Structured Output
(raw) {
"content": "version two"
}
Failure: Expected 'version one', got 'version two'
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
one
Failure: Expected 'version one', got 'one'
(empty output)
Failure: Expected 'version one', got ''
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
version two
Failure: Expected 'version one', got 'version two'
(empty output)
JSON Schema
Structured Output
(raw) {
"content": ""
}
Failure: Expected 'version one', got ''
version one
</think>version one
Failure: Expected 'version one', got 'version one
</think>version one'
version_one
JSON Schema
Structured Output
(raw) {"content": "version_one"}
Failure: Expected 'version one', got 'version_one'
version two
JSON Schema
Structured Output
(raw) {"content":"version two"}
Failure: Expected 'version one', got 'version two'
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-1b993280-d0ea-9e4f-b67f-1a3a9e54ad15","request_id":"1b993280-d0ea-9e4f-b67f-1a3a9e54ad15"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-2d7dd797-2896-9955-8b1f-edba7789d59d","request_id":"2d7dd797-2896-9955-8b1f-edba7789d59d"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-aa260a1c-1d39-902b-b50c-fe84332a91ef","request_id":"aa260a1c-1d39-902b-b50c-fe84332a91ef"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-2c10e99d-f59d-9ba3-b0a3-478d49e8dbf5","request_id":"2c10e99d-f59d-9ba3-b0a3-478d49e8dbf5"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-2dde968d-6154-9abf-986e-41e36525954c","request_id":"2dde968d-6154-9abf-986e-41e36525954c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-0eab8160-d4de-92e5-a330-96598dfccbb6"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-240219d8-6b96-9532-8d48-bd6112c9223f"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-a4346013-4434-9f9d-aa76-76be45bd0c01"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-7d216a85-5181-9e3d-b5bd-c21e72ccab80"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-79e4dee3-406a-9a4d-8199-63e5c30a5448"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': 'data: {"error":{"code":"invalid_parameter_error","param":null,"message":"\'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error"},"id":"chatcmpl-667006f5-2e4c-9365-b9b3-2983c8a0b8d7"}\n\n', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-746586b2-fda8-9a01-a23f-31d1aaec49e8","request_id":"746586b2-fda8-9a01-a23f-31d1aaec49e8"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-d2223161-19ed-9174-90fd-37a2d5d0b8f3","request_id":"d2223161-19ed-9174-90fd-37a2d5d0b8f3"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-0397bd94-9a59-9161-ad80-87f4009ce2d3","request_id":"0397bd94-9a59-9161-ad80-87f4009ce2d3"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-3c20a328-6c9b-95f6-8216-8556c86ee032","request_id":"3c20a328-6c9b-95f6-8216-8556c86ee032"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-81bc6538-bf02-9c43-b73c-139063ddfcf5","request_id":"81bc6538-bf02-9c43-b73c-139063ddfcf5"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-cd9a468d-b5d4-9a55-a2b6-a2a520dcee6f","request_id":"cd9a468d-b5d4-9a55-a2b6-a2a520dcee6f"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-a8162197-fa3d-9296-bddd-5f73cfac46e8","request_id":"a8162197-fa3d-9296-bddd-5f73cfac46e8"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-97db0a2d-7770-9646-9e6d-1e510e6bcf34","request_id":"97db0a2d-7770-9646-9e6d-1e510e6bcf34"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-ebfce2d4-0b82-90a6-9318-70df532a0885","request_id":"ebfce2d4-0b82-90a6-9318-70df532a0885"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
(empty output)
JSON Schema
Structured Output
Failure: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"error":{"message":"<400> InternalError.Algo.InvalidParameter: \'messages\' must contain the word \'json\' in some form, to use \'response_format\' of type \'json_object\'.","type":"invalid_request_error","param":null,"code":"invalid_parameter_error"},"id":"chatcmpl-7afd0d97-01aa-97e8-8604-8ffffe3dde7c","request_id":"7afd0d97-01aa-97e8-8604-8ffffe3dde7c"}', 'provider_name': 'Alibaba', 'is_byok': False}}, 'user_id': 'user_3FrVBkmFqVIuZ58dEh7AU8vhXUV'}
Invalid JSON. Output: version one{"content": "version one"}
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
version one<|end_message|>
Failure: Expected 'version one', got 'version one<|end_message|>'
Invalid JSON. Output: version one{"content": "version one"}
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
File content unavailable.
Failure: Expected 'version one', got 'File content unavailable.'
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output: version one
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Invalid JSON. Output:
JSON Schema
Structured Output
Structured Output Error
Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)
Failure: Failed to parse structured JSON response: Expecting value: line 1 column 1 (char 0)