Integrations

Both our Judges and Evaluators may be used as custom-generator LLMs in 3rd party frameworks and we are committed to support OpenAI ChatResponse compatible API.

Note, however, that additional functionality, such as validation results, calibration etc., are not available as part of OpenAI responses and require the user to implement additional code if anything besides failing on unsuccessful validation is required.

Advanced use-cases can rely on referencing the completion.id returned by our API as unique identifier for downstream tasks. Please refer to the Examples section for details.

If you work with an AI coding agent such as Claude Code or Cursor, start with the Coding Agents guide: the agent can set up most of the integrations in this section for you.