Evaluator Portfolio

List of well-calibrated Root evaluators include:

• Relevance

• Safety for Children

• Sentiment Recognition

• Coherence

• Conciseness

• Engagingness

• Originality

• Clarity

• Precision

• Persuasiveness

• Confidentiality

• Harmlessness

• Formality

• Politeness

• Helpfulness

• Non-toxicity

• Faithfulness

• Faithfulness-swift

• Truthfulness

• Truthfulness-swift

• Quality of Writing - Professional

• Quality of Writing - Creative

• Summarization Quality

• Translation Quality

• Information Density

• Reading Ease

• Planning Efficiency

• Answer Willingness

• Tool Selection — multi-turn; judges whether the agent picked the right tool from the supplied tools catalog

• Knowledge Retention — multi-turn; judges whether the assistant stays consistent with facts the user stated in earlier turns

Details of each evaluator can be found here.