Gold Standard — 14 Pilot(黄金标准:试点)
知识库位置:
FDE Knowledge Base/06 Case Studies/Reference-Projects/01-Enterprise-Knowledge-Assistant/14-Pilot.md
Pilot scope(试点范围):
100 IT support users(100 名 IT 支持用户)One IT knowledge domain(一个 IT 知识域)Real permission groups(真实权限组)Real workflow(真实工作流)Tracked(跟踪指标):
Technical(技术)
Section titled “Technical(技术)”- Retrieval quality(检索质量)
- Grounded answer(有据回答)
- Citation(引用)
- Latency(延迟)
Adoption(采用)
Section titled “Adoption(采用)”- Activated(已激活)
- Weekly active(周活跃)
- Repeat usage(复用)
Workflow(工作流)
Section titled “Workflow(工作流)”- Search time(搜索时间)
- Task completion(任务完成率)
Business(业务)
Section titled “Business(业务)”- Handle time contribution(处理时长贡献)
- SME interruptions(领域专家被打断次数)
Important Finding(重要发现)
Section titled “Important Finding(重要发现)”Users asked(用户问):
“What is the status of my access request?”(“我的权限申请到什么状态了?”)This initially looked like another knowledge question. (这起初看起来像又一个知识问题。)
Diagnosis(诊断):
Not Knowledge(不是知识型)↓Transactional State(事务型状态)Decision(决策):
Add query routing(增加查询路由):
Knowledge(知识型)→ RAG(检索增强生成)
Live Status(实时状态)→ Service API(服务接口)Reusable lesson(可复用经验):
Do not force operational state into RAG. (不要把运营状态硬塞进 RAG。)