What is prompt testing?
Repeatable evaluation of prompt behavior across known questions, failures, and release changes.
Interview Questions: Prompt Testing
What are golden questions?
Representative cases with expected answers, citations, refusals, or conflict behavior.
Why test missing evidence?
To verify the prompt refuses instead of inventing unsupported answers.
What is citation support?
The cited source directly supports the claim attached to it.
How do you test prompt injection?
Include retrieved text that tries to override instructions and verify it is treated as data.
Why version prompts?
So answer behavior can be traced to a specific prompt release and rolled back.
What is a release gate?
A quality threshold that blocks prompt changes when critical tests fail.
What is false refusal?
The assistant refuses even though enough evidence exists to answer.
What metrics matter?
Groundedness, citation support, refusal accuracy, injection pass rate, format stability, and regression rate.
What is the senior answer?
Prompt testing treats prompts like releaseable product behavior, with baselines, assertions, risk slices, and gates.