Facebook deployed Sapienz, an AI-powered automated testing tool, to autonomously generate, execute, and report tens of thousands of test cases daily for its Android app. Sapienz explores app behaviors using search-based software engineering, identifies bugs including edge cases missed by manual testing, and integrates with continuous deployment pipelines for rapid bug detection and fixes.
- 80% reduction in Android app crashes
- Tens of thousands of test cases generated and run daily
- 75% of Sapienz reports actionable and result in fixes
- Near real-time bug detection and reporting
- Extremely low false-positive rate
Manual test design was time-consuming, limited in coverage, and unable to keep pace with rapid development cycles
Sapienz uses multi-objective search-based software engineering (SBSE) to automatically design system-level test cases, run them on hundreds to thousands of emulators, and report results directly to developers via continuous integration tools
- Dramatically faster bug detection and resolution
- Improved test coverage including hard-to-find edge cases
- Reduced crash rates and improved app stability
- Friction-free integration into developer workflows
- Scalable testing infrastructure running 24/7 on thousands of emulators
