Monitoring & Insights

Scorable Monitoring View Features

Monitoring Viewarrow-up-right

Overview

The main dashboard provides a high-level summary of all Evaluator and Judge executions within your organization.

Slack integration

You can get detailed insights about your application's behavior by connectingarrow-up-right the Scorable Slack app.

Logs and traces

Every single Evaluator and Judge execution result is logged. Each execution can also be tagged with labels, and filtering & grouping with tags is supported. Metadata such as user_id and session_id can be passed during execution to enable granular tracking and user-level insights within the dashboard.

Overall trends and summaries for each Judge can also be found in the Monitoring view.

HTML Reports

One can create a sharable HTML Report for any Judge execution by clicking the Generate HTML Report button.

which looks like:

Last updated