Carnegie Mellon University

Ask the AI Architect

Each month, our AI Architect answers real questions from the community, offering practical advice and actionable prompts. We encourage you to submit any questions, from basic to highly technical! Next month, we will choose and highlight one of your questions.


This Month's Question

Question:

Dear AI Architect, I have heard about RAG. What is it? If I use RAG, should I be concerned that I'm training the LLM on my data, which could leak out to others who use the same LLM?

Answer:

Hey there! RAG stands for Retrieval-Augmented Generation. It’s like giving your AI a handy library card—it fetches relevant information from a database to help generate more accurate and relevant responses. And no, using RAG doesn't mean your data will get mixed up with everyone else's. Your secrets are safe!