Document AI Architecture(文档 AI 架构)
知识库位置:
FDE Knowledge Base/04 Architecture/Patterns/04-Document-AI-Architecture.md
Architecture Metadata(架构元数据)
Section titled “Architecture Metadata(架构元数据)”Architecture ID: ARCH-004
Category(类别):Document(文档处理)
Primary Business Problem(主要业务问题):Unstructured Documents to Reliable Structured Data(非结构化文档转为可靠结构化数据)
Complexity(复杂度):Medium(中)
AI Dependency(AI 依赖度):High(高)
Data Dependency(数据依赖度):High(高)
Integration Complexity(集成复杂度):Medium(中)
Human Review(人工复核):Low-confidence / high-risk data(低置信度或高风险数据)
Status: CoreVersion: v0.2Business Problem(业务问题)
Section titled “Business Problem(业务问题)”企业大量业务输入仍然来自:
- PDF(便携式文档格式)
- Invoice(发票)
- Contract(合同)
- Form(表单)
- Email Attachment(邮件附件)
- Scanned Document(扫描件)
需要:
将非结构化文档转换成可靠的结构化业务数据。
When to Use(适用场景)
Section titled “When to Use(适用场景)”适合:
- Invoice Processing(发票处理)
- Claims Processing(理赔处理)
- Contract Extraction(合同要素抽取)
- Form Processing(表单处理)
- Application Processing(申请处理)
- Document Classification(文档分类)
High-Level Architecture(总体架构)
Section titled “High-Level Architecture(总体架构)”Document Input(文档输入) ↓File Validation(文件校验) ↓OCR / Parser(光学字符识别 / 解析器) ↓Document Classification(文档分类) ↓Field Extraction(字段抽取) ↓Structured Output(结构化输出) ↓Schema Validation(结构校验) ↓Business Validation(业务校验) ↓Confidence / Risk Check(置信度 / 风险检查) ↓ ┌────┴────┐ ↓ ↓Auto Human Review(自动) (人工复核) ↓ ↓Downstream System(下游系统)Core Components(核心组件)
Section titled “Core Components(核心组件)”Ingestion(摄取)
Section titled “Ingestion(摄取)”来源:
- Email(邮件)
- Upload(上传)
- SFTP(安全文件传输协议)
- API(应用程序编程接口)
- Object Storage(对象存储)
Parsing(解析)
Section titled “Parsing(解析)”处理:
- Native Text(原生文本)
- OCR(Optical Character Recognition,光学字符识别)
- Tables(表格)
- Layout(版面)
Classification(分类)
Section titled “Classification(分类)”识别:
- Invoice(发票)
- Contract(合同)
- Receipt(收据)
- Purchase Order(PO,采购订单)
Extraction(抽取)
Section titled “Extraction(抽取)”输出结构化字段。
Validation(校验)
Section titled “Validation(校验)”非常关键。
分两层:
Schema Validation(结构校验)+Business Validation(业务校验)Example(示例)
Section titled “Example(示例)”Invoice(发票):
invoice_number(发票号)vendor(供应商)date(日期)currency(币种)amount(金额)tax(税费)purchase_order(采购订单号)line_items(行项目明细)Business Validation(业务校验):
total == subtotal + tax(总额 == 小计 + 税费)PO exists(采购订单存在)vendor active(供应商有效)currency allowed(币种允许)Human Review(人工复核)
Section titled “Human Review(人工复核)”低置信度或高风险数据进入 Review Queue(复核队列)。
Security(安全)
Section titled “Security(安全)”需要考虑:
- Document Retention(文档保留策略)
- PII(Personally Identifiable Information,个人身份信息)
- Access Control(访问控制)
- Malware Scanning(恶意软件扫描)
- Encryption(加密)
- Audit(审计)
Failure Modes(失败模式)
Section titled “Failure Modes(失败模式)”- OCR 错误
- Table Extraction(表格抽取)错误
- Missing Field(字段缺失)
- Wrong Classification(分类错误)
- Arithmetic Mismatch(算术不一致)
- Duplicate Processing(重复处理)
Scaling(扩展)
Section titled “Scaling(扩展)”文档量大后:
Upload(上传)↓Queue(队列)↓Parallel Workers(并行工作进程)↓Extraction(抽取)↓Validation(校验)更适合 Async Architecture(异步架构)。
Implementation Path(实施路径)
Section titled “Implementation Path(实施路径)”Stage 1One document type(单一文档类型)
Stage 2Structured extraction(结构化抽取)
Stage 3Validation(校验)
Stage 4Human review(人工复核)
Stage 5Multi-document support(多文档类型支持)
Stage 6Straight-through processing(STP,直通式处理)