
Mutation Testing

#139 - A Developer's Guide to Effective Software Testing - Mauricio Aniche
Topic 8 of 13
Published Jul 3, 2023 · Clip 35:36–38:49 (3:13)
Mauricio explains mutation testing as a way to assess test suite quality beyond coverage: tools like PITest automatically insert bugs (mutants) into production code—if tests fail, the mutant is killed, showing the tests catch such bugs; if tests stay green, a potential undetected bug exists. He notes mutation testing dates from the 1970s and benefits companies with mature test suites; poor suites can't kill mutants, so coverage is enough at that stage. He references a paper on Google's experience with mutation testing at scale and notes tools are improving to reduce the expense of running the process.