> For the complete documentation index, see [llms.txt](https://docs.scorable.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.scorable.ai/concepts-and-examples/usage/monitoring-and-insights.md).

# Monitoring & Insights

Scorable Monitoring View Features

[<mark style="color:purple;">Monitoring View</mark>](https://scorable.ai/monitoring/dashboard)

## Overview

The main dashboard provides a high-level summary of all Evaluator and Judge executions within your organization.

#### Slack integration

You can get detailed insights about your application's behavior by [connecting](https://scorable.ai/settings/integrations) the Scorable Slack app.

<figure><img src="https://1145415225-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FUoDNiw7ySSaFXXkaGCic%2Fuploads%2FVMuGW2Y9kpK4bpXK8I22%2FCleanShot%202025-12-19%20at%2013.40.12%402x.png?alt=media&amp;token=cf3950e1-04af-4782-8e38-53c994130ce1" alt=""><figcaption></figcaption></figure>

The Slack integration provides two capabilities:

**Daily digest notifications** — Configure a channel ID in the integration settings to receive a daily summary posted to that channel. The digest reports issue types that showed up in the last 24 hours and had not been seen in the preceding 30 days, so it stays a signal that something new has started happening rather than a daily repeat of your top issues. Each entry links straight to that issue in the Issues view. On a day with nothing new, no message is sent. This requires issue classification to be enabled for your deployment.

**Conversational AI assistant** — Once connected, you can DM the Scorable bot or @mention it in any channel to ask natural-language questions about your evaluation data. For example:

* "How many evaluations failed last week?"
* "Show me the worst-performing evaluator in the past 30 days"
* "What are the top failure categories for my judge?"

The bot uses your organization's evaluation data to answer questions in context. No channel configuration is required for this feature — it works anywhere you invite the bot.

#### Logs and traces

Every single *Evaluator* and *Judge* execution result is logged. Each execution can also be tagged with labels, and filtering & grouping with tags is supported. Metadata such as `user_id` and `session_id` can be passed during execution to enable granular tracking and user-level insights within the dashboard.

<figure><img src="https://1145415225-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FUoDNiw7ySSaFXXkaGCic%2Fuploads%2FrNcxjHHaNcjqpXmbwnzV%2FCleanShot%202026-05-22%20at%2010.59.33%402x.png?alt=media&amp;token=d721a696-b71f-43f9-b485-1139d7c383ad" alt="" width="375"><figcaption></figcaption></figure>

Overall trends and summaries for each Judge can also be found in the *Monitoring* view.

<figure><img src="https://1145415225-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FUoDNiw7ySSaFXXkaGCic%2Fuploads%2FkoBZsdukIL4n38DBKuW2%2FCleanShot%202026-05-22%20at%2011.00.49%402x.png?alt=media&amp;token=2dab6d9c-cc04-44e9-92a3-b52f92a3f06e" alt=""><figcaption></figcaption></figure>

#### HTML Reports

One can create a shareable HTML Report for any *Judge* execution by clicking the <mark style="color:purple;">Generate HTML Report</mark> button.

<figure><img src="https://1145415225-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FUoDNiw7ySSaFXXkaGCic%2Fuploads%2Fgit-blob-d338ccd1e7933eafc563893085f4b4d9e6efe7a2%2FScreenshot%202025-08-06%20at%209.47.28.png?alt=media" alt=""><figcaption></figcaption></figure>

<figure><img src="https://1145415225-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FUoDNiw7ySSaFXXkaGCic%2Fuploads%2Fgit-blob-01baaf291b31d7aa5e68fdef95143c5c17c58192%2FScreenshot%202025-08-06%20at%209.56.34.png?alt=media" alt=""><figcaption></figcaption></figure>