How to improve your Teneo chatbot with E2E test automation

Presented by

Allison Adams (Conversational AI Consultant at Artificial Solutions) & Christoph Boerner (CEO and Co-founder of Botium)

About this talk

Testing is a crucial enabler for the success of chatbots and virtual assistants. Doing it manually requires enormous time and efforts. Automated testing will remain critical to ensure that bots actually do what their designers intend. Talking to a chatbot usually has no barriers, it runs without any restrictions. Combining this with an unpredictable user behavior, it becomes utmost difficult to verify the correctness of conversational AI. Training data and test sets are infinitely large. In fact, quantity plays a major role in quality assurance for bots, but makes it impossible to test manually. The main questions to answer are "Why are bots failing?", "What and how should you test?" and of course "How to automate?". In this webinar we will showcase the setup of a test automation pipeline for a Teneo based chatbot to continuously check conversation flows and NLP performance. And we will take it even further by adding full End-to-End Testing. About Botium: Botium is a test automation tool set for conversational AI following a holistic test approach to cover all quality standards. Meaning functional as well as non functional testing. The company was founded in 2018 and quickly became the industry standard tool for automated testing for Conversational AI. Their open source framework, Botium Core gives an unlimited experience for those who are comfortable with coding, while their commercial product, Botium Box was designed to make chatbot testing and training fast and easy for everyone.

Related topics:

More from this channel

Upcoming talks (1)
On-demand talks (37)
Subscribers (5961)
Artificial Solutions® is the leading specialist in enterprise-strength Conversational AI, a form of Artificial Intelligence that allows people to communicate with applications, websites and devices in everyday, humanlike natural language via voice, text, touch or gesture input. Designed for the global enterprise, the company’s advanced conversational AI platform, Teneo®, allows business users and developers to collaborate on creating sophisticated, highly intelligent applications that run across 86 languages, multiple platforms and channels in record time. The ability to analyze and make use of the enormous quantities of conversational data is fully integrated within Teneo, delivering unprecedented levels of insight that reveal what customers are truly thinking. Artificial Solutions’ conversational AI technology makes it easy to implement a wide range of natural language applications such as virtual assistants, chatbots, speech-based conversational UIs for smart devices and more. It is already used daily by millions of people across hundreds of private and public sector deployments worldwide. For more information visit