Using AIOps to Speed up CI/CD processes

"Applying AI to IT Operations(AIOps) is the thing of the hour. Most IT organizations generate a large amount of operations data in the process of operating their software and are beginning to embrace the adoption of AI to support IT operations. Yet, real-world operations data is rarely available as a public dataset. Moreover, most AIOps tools out there are closed source. In this session, the speakers introduce AI4CI(AI for Continuous Integration), a set of open source AIOps tools involving open operations data from Kubernetes CI/CD platforms. They demonstrate a set of Jupyter Notebooks that are automated using Kubeflow Pipelines into reproducible workflows that collect data from open CI/CD data sources, calculate and visualize key performance indicator metrics, and build AI/ML services to support operations. They also introduce how to build and deploy ML services which can answer questions like “how can we optimize the running time of our tests and prevent bottlenecks in our CI/CD pipeline”, “how to an ML model to efficiently triage a new issue or a pull request”, and “how to preemptively detect patterns in failing tests or builds by looking at the logs”. By making the tools and relevant data openly accessible, AI4CI aims to cultivate an open source community that fosters collaboration between data scientists and DevOps engineers. By the end of the talk, the audience will learn how to build AIOps monitoring tools and automated metric dashboards that can help provide more visibility into their tests to better support their CI/CD processes."