Import and Export
The YAML format
name: Response Quality
objective:
intent: "Checks whether the response directly and completely answers the user's question."
scoring_criteria: |-
You are evaluating whether the response answers the question directly and completely.
Score from 0 to 1:
1.0 — Fully answers the question, nothing missing.
0.5 — Partially answers the question.
0.0 — Does not address the question.
Response: {{ response }}
Question: {{ request }}
model: gpt-5.2
demonstrations:
- request: "What is the capital of France?"
response: "Paris."
score: 1.0
justification: "Direct and correct."
- request: "What is the capital of France?"
response: "I'm not sure, maybe Lyon?"
score: 0.0
justification: "Incorrect answer."Field
Required
Description
Sub-field
Required
Description
Export an evaluator
Web UI
CLI
Import an evaluator
Web UI (from GitHub)
CLI
Store evaluators in git
API reference
Export — GET /v1/evaluators/export/{id}/
GET /v1/evaluators/export/{id}/Direct YAML import — POST /v1/evaluators/import-yaml/
POST /v1/evaluators/import-yaml/Open format
Schema and editor support
Last updated