Project: Parser Readiness Auditor
Build a small production-style auditor that decides whether parsed documents can move to chunking.
What you will build
- A parser quality gate for PDF, HTML, CSV, DOCX, JSON, and OCR-like outputs.
- A readiness decision: publish, review, clean first, or reject.
- A production explanation: first risk, required fix, and metric to track.
- A mini report that could be shown to an ingestion reviewer.
1 Define parser signals
Use parse score, OCR confidence, table confidence, metadata completeness, source positions, access labels, and boilerplate ratio.
2 Create readiness logic
Classify each parsed document as publish, clean_then_publish, review, or reject.
3 Explain the decision
Return a human-readable reason, next action, and first metric to inspect.
4 Run five production scenarios
Include a PDF table, noisy HTML, restricted CSV, low-confidence OCR scan, and DOCX with comments.