How do you evaluate prompt quality?medium

Type
conceptual
Topic
prompt-evaluation
Frequency
common
Tags
evaluation, testing
Answer

Evaluate prompts with representative test cases, expected outputs, failure cases, human review, and production metrics.

Explanation

Prompt quality should be measured, not guessed. Useful metrics include task success, factuality, format validity, refusal correctness, latency, cost, and regression rate across prompt versions.

Follow-upWhat should be included in a prompt regression test set?