Monitoring & Insights
Scorable Monitoring View Features
Overview
The main dashboard provides a high-level summary of all Evaluator and Judge executions within your organization.
Slack integration
You can get detailed insights about your application's behavior by connecting the Scorable Slack app.
Logs and traces
Every single Evaluator and Judge execution result is logged. Each execution can also be tagged with labels, and filtering & grouping with tags is supported. Metadata such as user_id and session_id can be passed during execution to enable granular tracking and user-level insights within the dashboard.
Overall trends and summaries for each Judge can also be found in the Monitoring view.
HTML Reports
One can create a sharable HTML Report for any Judge execution by clicking the Generate HTML Report button.
which looks like:
Last updated