Testing is a crucial enabler for the success of chatbots and virtual assistants. Doing it manually requires enormous time and efforts. Automated testing will remain critical to ensure that bots actually do what their designers intend. Talking to a chatbot usually has no barriers, it runs without any restrictions.
Combining this with an unpredictable user behavior, it becomes utmost difficult to verify the correctness of conversational AI. Training data and test sets are infinitely large. In fact, quantity plays a major role in quality assurance for bots, but makes it impossible to test manually.
The main questions to answer are "Why are bots failing?", "What and how should you test?" and of course "How to automate?".
In this webinar we will showcase the setup of a test automation pipeline for a Teneo based chatbot to continuously check conversation flows and NLP performance. And we will take it even further by adding full End-to-End Testing.
Botium is a test automation tool set for conversational AI following a holistic test approach to cover all quality standards. Meaning functional as well as non functional testing. The company was founded in 2018 and quickly became the industry standard tool for automated testing for Conversational AI. Their open source framework, Botium Core gives an unlimited experience for those who are comfortable with coding, while their commercial product, Botium Box was designed to make chatbot testing and training fast and easy for everyone.