The Vicious Cycle

1. Build RAG systems for flawed benchmarks
2. Celebrate our awesome benchmark scores
3. Watch real users struggle
4. Create new benchmarks with the same problems
5. Rinse and repeat