跳转到内容

Gold Standard — 12 Evaluation(黄金标准:评估)

知识库位置:FDE Knowledge Base/06 Case Studies/Reference-Projects/01-Enterprise-Knowledge-Assistant/12-Evaluation.md

Evaluation Dataset(评测数据集):

Question(问题)
Expected source(预期来源)
Expected answer(预期答案)
Permission context(权限上下文)
Query type(查询类型)
Difficulty(难度)

Categories(类别):

Policy(政策)
Troubleshooting(排障)
Product ID(产品编号)
Access Procedure(访问流程)
Ambiguous(模糊)
No-answer(无答案)
Restricted(受限)

Evaluation dimensions(评估维度):

Retrieval(检索)
Groundedness(事实有据性)
Citation(引用)
Permission(权限)
Abstention(拒答)
Latency(延迟)

Failure taxonomy(失败分类)链接至:

RAG Evaluation Toolkit(RAG 评估工具)