AIOps is an IT operations strategy that leverages machine learning and data analytics to automate decision-making. To be implemented successfully, AIOps requires a careful approach, including setting up an effective automated testing strategy for AIOps applications. Automated testing ensures the quality of AIOps software at a pace that keeps up with AIOps tools themselves. The author discusses the importance of automated testing for chatbots, which are a common type of AIOps application, using Botium as an example. Botium is an open-source testing tool designed to automate testing of chatbot behavior, allowing testers to execute tests in seconds and providing a complete management toolbox with predefined test environments and test sets. By automating testing, AIOps tools can be ensured to deliver on their promised value, making end-users' experiences reliable and structured.