Project: Ingestion Release Auditor
Build a small release auditor that decides whether a candidate RAG index should publish, hold, review, or roll back.
What you will build
- A production-style ingestion run report.
- Quality gate logic for metadata, access tests, golden queries, stale chunks, failed sources, and rollback.
- A publish decision with next action and first metric to inspect.
- Multiple scenarios: safe incremental publish, hotfix failure, full re-index warning, and access regression.
1 Model ingestion runs
Track mode, changed sources, failed sources, run id, index version, quality scores, rollback target, and stage versions.
2 Build release gates
Block publish when golden queries fail, access tests fail, stale chunks remain, or metadata is incomplete.
3 Recommend recovery
Choose retry, quarantine, review, hold, or rollback based on failure type.
4 Print an audit report
Return a concise report that an ingestion owner could use immediately.