How do you evaluate NLP models?medium

Type
conceptual
Topic
evaluate-nlp-models
Frequency
common
Tags
evaluate, nlp, models
Answer

Use task-specific metrics plus qualitative error analysis.

Explanation

Classification may use F1, generation may use human evaluation or task success, and retrieval may use precision, recall, or MRR.

Follow-upWhy can BLEU be insufficient?