Tales of Testing in Production
Software testing challenges us to find faster and more effective ways to assess risk to our users and the systems that support those users. Those faster and more effective risk assessments require compromises between available time, equipment capacity, market viability, and our desire to provide great results to our users. This talk uses experiences from 6 years of maintaining, testing, and delivering the Jenkins git plugin as a way to highlight the complications and the compromises involved in software testing in production environments and in widely varied environments. This is an experience report that includes several observations about ways that Mark has made mistakes in software testing and has corrected his flawed assumptions. Test configuration, test improvement, and the compromises between exploratory testing and test automation will be discussed with examples showing more effective and less effective cases for each.