RAGAS is an open-source RAG evaluation framework computing: faithfulness, answer relevancy, context precision, and context recall.

RAGAS is an open-source RAG evaluation framework computing: faithfulness, answer relevancy, context precision, and context recall. Integrate: run RAGAS on a golden Q&A dataset in your CI pipeline (GitHub Actions). Gate deployment if metrics drop below thresholds. Track over time for drift detection. Can use LLM-as-judge internally, so choose a consistent judge model.