Success Metrics(成功指标)
知识库位置:
FDE Knowledge Base/02 Business/03-Success-Metrics.md
FDE 项目必须在早期定义:
什么叫成功?
如果成功标准不明确,就很容易出现:
Demo Successful(演示成功)≠Project Successful(项目成功)Three Levels(三层指标)
Section titled “Three Levels(三层指标)”建议使用三层指标。
Technical Metrics(技术指标)
Section titled “Technical Metrics(技术指标)”例如:
- Accuracy(准确率)
- Latency(延迟)
- Uptime(正常运行时间)
- Retrieval Recall(检索召回率)
Operational Metrics(运营指标)
Section titled “Operational Metrics(运营指标)”例如:
- Task Completion Rate(任务完成率)
- Automation Rate(自动化率)
- Escalation Rate(转人工率)
- Error Rate(错误率)
Business Metrics(业务指标)
Section titled “Business Metrics(业务指标)”例如:
- Handle Time ↓(处理时长下降)
- Cost ↓(成本下降)
- Revenue ↑(收入上升)
- Conversion ↑(转化率上升)
- Customer Satisfaction ↑(客户满意度上升)
最终应该形成:
Technical Improvement(技术改进)↓Workflow Improvement(工作流改进)↓Business Outcome(业务结果)Example(示例)
Section titled “Example(示例)”AI Customer Support(AI 客户支持):
不够好的指标:
LLM Accuracy = 92%(大语言模型准确率 92%)更完整的指标:
Answer Accuracy(回答准确率)↓First Contact Resolution(首次接触解决率)↓Average Handle Time(平均处理时长)↓Support Cost(支持成本)Leading vs Lagging(先行指标与滞后指标)
Section titled “Leading vs Lagging(先行指标与滞后指标)”Leading Metric(先行指标)
Section titled “Leading Metric(先行指标)”较早看到。
例如:
- Usage(使用量)
- Task Success(任务成功率)
- Response Time(响应时间)
Lagging Metric(滞后指标)
Section titled “Lagging Metric(滞后指标)”较晚看到。
例如:
- Revenue(收入)
- Cost Savings(成本节约)
- Retention(客户留存率)
FDE 项目通常需要同时设计两类指标。
Related Topics(关联知识)
Section titled “Related Topics(关联知识)”- Use Case Prioritization(用例优先级排序)
- Problem Framing(问题定义)
- Customer Discovery(客户调研)
- [AI Evaluation(AI 评估)(../03%20Engineering/AI%20Engineering/Evaluation/AI-Evaluation.md)
- [Solution Design(方案设计)(../05%20Delivery/Architecture/Solution-Design.md)
- [Glossary(中英文术语表)(../Glossary.md)