Pirates of the RAG: Adaptively Attacking LLMs to Leak Knowledge Bases
AI Papers Podcast Daily by AIPPD
Episode notes
This research paper explores how to protect private information in AI systems, especially those that use Retrieval-Augmented Generation (RAG). RAG systems help large language models (LLMs) access and use external knowledge bases to provide better answers. However, hackers can trick these systems into revealing private information from these knowledge bases. The authors developed an automated attack strategy called "Pirates of the RAG" that uses a smaller LLM and cleverly designed questions to extract hidden information. This attack is adaptive, meaning it learns from its attempts and gets better at stealing data over time. The researchers tested their attack on three different virtual agents, each representing a real-world application of RAG, and found that "Pirates of th ...