跳转到内容

Gold Standard — 14 Pilot(黄金标准:试点)

知识库位置:FDE Knowledge Base/06 Case Studies/Reference-Projects/01-Enterprise-Knowledge-Assistant/14-Pilot.md

Pilot scope(试点范围):

100 IT support users(100 名 IT 支持用户)
One IT knowledge domain(一个 IT 知识域)
Real permission groups(真实权限组)
Real workflow(真实工作流)

Tracked(跟踪指标):

  • Retrieval quality(检索质量)
  • Grounded answer(有据回答)
  • Citation(引用)
  • Latency(延迟)
  • Activated(已激活)
  • Weekly active(周活跃)
  • Repeat usage(复用)
  • Search time(搜索时间)
  • Task completion(任务完成率)
  • Handle time contribution(处理时长贡献)
  • SME interruptions(领域专家被打断次数)

Users asked(用户问):

“What is the status of my access request?”
(“我的权限申请到什么状态了?”)

This initially looked like another knowledge question. (这起初看起来像又一个知识问题。)

Diagnosis(诊断):

Not Knowledge(不是知识型)
↓
Transactional State(事务型状态)

Decision(决策):

Add query routing(增加查询路由):

Knowledge(知识型)
→ RAG(检索增强生成)
Live Status(实时状态)
→ Service API(服务接口)

Reusable lesson(可复用经验):

Do not force operational state into RAG. (不要把运营状态硬塞进 RAG。)