10 Minutes: Codeless Test Automation for IBM Watson Chatbots

Recently I've been working on a customer service chatbot based on IBM Watson Assistant (formerly known as "IBM Watson Conversation Service") for a large Austrian telecommuncation provider. The chatbot was trained to answer questions on the website and to lead the user to the right website section. It currently handles 60k-80k conversations per months and covers 25% of the customer service interactions. It happened several times that minor changes in the dialog design or training caused previously working dialogs to fail -- so we were in need of regression testing. With Botium it was possible to generate test cases from the IBM Watson Assistant workspace and setup automated testing within some minutes.