Project: RAG Cost and Trace Monitor
Build a monitor that estimates cost, latency, and quality risk per query.
Deep build roadmap
- Create trace schema for each RAG stage.
- Estimate cost from tokens and model rates.
- Flag expensive queries and slow stages.
- Recommend cache, compression, route, or top-k changes.
- Summarize cost by tenant, route, and risk level.