Evaluator Portfolio
List of well-calibrated Root evaluators include:
Relevance
Safety for Children
Sentiment Recognition
Coherence
Conciseness
Engagingness
Originality
Clarity
Precision
Persuasiveness
Confidentiality
Harmlessness
Formality
Politeness
Helpfulness
Non-toxicity
Faithfulness &#xNAN;RAG Evaluator
Faithfulness-swift &#xNAN;RAG Evaluator
Answer Relevance
Truthfulness &#xNAN;RAG Evaluator
Truthfulness-swift &#xNAN;RAG Evaluator
Quality of Writing - Professional
Quality of Writing - Creative
JSON Content Accuracy &#xNAN;RAG Evaluator | Function Call Evaluator
JSON Property Completeness &#xNAN;Function Call Evaluator
JSON Property Type Accuracy &#xNAN;Function Call Evaluator
JSON Property Name Accuracy &#xNAN;Function Call Evaluator
JSON Empty Values Ratio &#xNAN;Function Call Evaluator
Answer Semantic Similarity &#xNAN;Ground Truth Evaluator
Answer Correctness &#xNAN;Ground Truth Evaluator
Context Recall &#xNAN;RAG Evaluator | Ground Truth Evaluator
Context Precision &#xNAN;RAG Evaluator | Ground Truth Evaluator
Summarization Quality
Translation Quality
Information Density
Reading Ease
Planning Efficiency
Answer Willingness\
Details of each evaluator can be found here.
Last updated