huggingface has a nice post about evaluating RAG systems

you need a quantitative evaluation so you know if you're making things better or worse

you can use ai to generate questions, have ai answer the questions, and then use ai to judge the answers