Chapter 26 Quiz15 min check

Observability and Cost

Check whether you can explain, debug, and control the operating behavior of a RAG product.

Quiz A: Traces and Signals

1 A useful RAG trace starts with a stable ____ so one answer can be followed across stages.

2. Which signal is best for finding the slowest part of a request?

3 Cost attribution should be sliced by route, model, tenant, feature, and ____.

4. Why log retrieved document IDs before reranking?

5 Empty retrieval rate is an operational signal that the index, filters, or query rewrite may be ____.

6. Which change usually lowers cost without changing the model provider?

7 A cache hit rate helps estimate how often stable answers can be ____.

8. What is the danger of only watching average latency?

9 A release gate should compare quality and cost against a previous ____.

10. Which dashboard slice is most useful for a multi-customer RAG product?

Perfect score. You can operate a RAG product with evidence instead of vibes.