2018 is quickly becoming the year of DevOps and Continuous Testing. Some experts suggest that organizations that are moving towards DevOps should operate with the highest percentage of test automation and while this is a good suggestion, it takes more than just that to be successful in DevOps.
You need a mature DevOps strategy with a robust continuous testing method that is more than the simple automating functional and non-functional testing. While a clear key enabler to be agile is test automation and the ability to release software quickly; continuous testing (CT) does require additional implementations that are continuously measured, to achieve and sustain success.
The main question I get from organizations is how to implement Continuous Testing and advance my DevOps maturity successfully. Here are five steps you can utilize in order to implement CT for your business:
1. Risk vs. Reward – It’s obviously about coverage but you know you can’t test everything. You need to understand the best coverage for browsers and mobile devices for your business.
2. End-to-end testing – You need automated end-to-end testing that compliments your existing development process. In order to create this environment while excluding errors and allowing continuity throughout SDLC, you need to: Implement the right tests, make sure your CT test buckets are correct and leverage reporting appropriately. In addition, these tests that supports various team members and features, need to run per each code commit as part of a consolidated CI process.
3. Stable lab and test environment – The lab needs to be central to everything in your CT process. Your lab needs to be able to support your coverage requirements in addition to the test frameworks that were used to develop the tests.
4. Artificial Intelligence (AI) & Machine Learning (ML) –These can help you optimize your CT test suite and reduce the amount of time in release activities. If you are looking for more guidance on how to scale up your test automation, check out our latest ebook.
5. Software delivery pipeline and DevOps toolchain – CT needs to work seamlessly with everything. No matter the framework, environment (front or back-end) and IDEs that are used in the DevOps pipeline – continuous testing needs to pick up all the appropriate testing, execute them automatically and provide feedback for a GO/NO GO on the release.
In 2018, we will continue to see more companies transition into DevOps and Continuous Testing. Those that will stay ahead of the curve need to implement the correct foundation for continuous testing by adopting these five steps and creating a plan that is continuously optimized, maintained and adjusted as things change in the market or on your product roadmap.