How would you design a multi-tenant RAG system?

How would you design a multi-tenant RAG system?hard

Type: scenario
Topic: multi-tenant-rag
Frequency: common
Tags: rag, multi-tenant, security

Answer

Isolate tenant data in ingestion, storage, retrieval filters, permissions, logging, and evaluation.

Explanation

The main risks are cross-tenant data leakage and permission mistakes. Use tenant-scoped indexes or strict metadata filters, access checks, audit logs, and regression tests.

Follow-upHow would you test for cross-tenant retrieval leaks?