Mutation-Guided LLM-based Test Generation at Meta

In this episode, we explore Meta's ACH system, a novel mutation-guided test generation approach that leverages LLMs (Large Language Models) to enhance software robustness. Unlike traditional mutation testing, which generates numerous random faults, ACH focuses on identifying undetected faults related to specific concerns, such as privacy vulnerabilities.

🔍 Key Highlights:

• Targeted Mutant Generation: Instead of mass-producing mutants, ACH intelligently identifies meaningful faultsthat could otherwise go unnoticed.
• LLM-Driven Test Generation: ACH automates the creation of test cases to detect and eliminate these faults, effectively hardening software against regressions.
• Real-World Deployment: Applied to 10,795 Android Kotlin classes across 7 Meta platforms, ACH generated 9,095 mutants and 571 privacy-focused test  ...