How do you evaluate retrieval quality in RAG?hard

Type
scenario
Topic
retrieval-evaluation
Frequency
common
Tags
retrieval, evaluation, recall-at-k
Answer

Measure whether the retriever returns relevant evidence for each query before judging the generated answer.

Explanation

Use metrics like recall@k, precision@k, MRR, nDCG, and human relevance labels. Separate retrieval evaluation from answer evaluation to locate failures.

Follow-upWhy can answer quality be poor even when retrieval looks good?