Access Controls & Roles

Scorable has two roles within an organization: the User and the Administrator.

Everything in an organization is visible to the whole organization

Evaluators, judges, datasets, objectives and execution logs belong to the organization that created them, and every member of that organization can see all of them. There is no per-user or per-role filtering of what you can view inside your own organization — including execution logs created by your colleagues, along with their prompts, model responses and costs.

Nothing is ever visible across organization boundaries unless it has been explicitly published.

What any user can do

Any member of an organization can create evaluators, judges, datasets and objectives, run them, and browse the organization's execution logs. You can always edit and delete the entities you created yourself.

Administrator privileges

Administrators can additionally:

1. Edit and delete any entity in the organization, regardless of who created it — useful for managing obsolete or irrelevant entities.

2. Manage members and invitations — invite new users, change roles, and remove members.

3. Change organization settings — organization name, timezone, the restriction to GDPR-compliant models, and the execution log content retention policy.

4. Manage the Slack integration and billing, including the subscription and plan.