Write a Blog >>
ICSE 2020
Wed 24 June - Thu 16 July 2020
Thu 16 Jul 2020 08:48 - 09:00 at AST - Live Session 4 Chair(s): Shin Hong

The paper describes an in-house accelerator to generate alternate synonymous sentences and similar intent from sample utterances, the generated data can be applied as test input for conversational AI bots (either text or voice-based). Its NLP-driven sentence generator exposes a RESTful service, which can be consumed by automated testing tools/frameworks such as Katalon, Selenium, and so on. Te paper presents building an accelerator to quickly teach and test adaptive conversational AI bots. Te approach helps to analyze user inputs and extract intent, the bot developer should ensure a variety of possible utterances are coded. In the traditional manual approach, it is difficult to conceive every possible user utterance before deploying the bot and hence the bot has an early failure rate. Tis may diminish the usefulness of the bot and the users may stop using the same. Here we propose an AI-driven bot test automation approach using a patent-pending in-house accelerator referenced as LemmaCartridge (LC) in this paper. Testing tools or frameworks can consume LC’s data cartridge API for testing the bot AUT and analyze the responses using automated tools/frameworks like Katalon, Selenium and so on until the bot demonstrates desired outcomes under the supervised train, test and adaptive repeatable testing methods yielding quality@speed for the single major goal of testing conversational AI bots. An example of a program used in experiment is described and the results obtained, especially train and test state machines, industry-specific data cartridges that enable to unearth errors in the AI bot under test, are presented.

Thu 16 Jul

Displayed time zone: (UTC) Coordinated Universal Time change

08:00 - 09:00
Live Session 4AST at AST
Chair(s): Shin Hong Handong Global University
08:00
12m
Research paper
BlockRace: A Big Data Approach to Dynamic Block-based Data Race Detection for Multithreaded Programs
AST
Xiupei Mei City University of Hong Kong, Zhengyuan Wei City University of Hong Kong, Hong Kong, Hao Zhang , Wing-Kwong Chan City University of Hong Kong, Hong Kong
08:12
12m
Research paper
Hybrid Methods for Reducing Database Schema Test Suites: Experimental Insights from Computational and Human Studies
AST
Abdullah Alsharif Saudi Electronic University, Gregory Kapfhammer Allegheny College, USA, Phil McMinn University of Sheffield
08:24
12m
Short-paper
A Quantitative Comparison of Coverage-based Greybox Fuzzers
AST
Natsuki Tsuzuki Nagoya University, Norihiro Yoshida Nagoya University, Koji Toda Fukuoka Institute of Technology, Kenji Fujiwara National Institute of Technology, Toyota College, Ryota Yamamoto Nagoya University, Hiroaki Takada Nagoya University
Link to publication Media Attached
08:36
12m
Short-paper
Fastbot: A Multi-Agent Model-Based Test Generation System
AST
Tianqin Cai Bytedance Network Technology, Zhao Zhang Bytedance Network Technology, Ping Yang Bytedance Network Technology
08:48
12m
Industry talk
AI-Driven Conversational Bot Test Automation Using Industry Specific Data Cartridges
AST
Muralidhar Yalla , Asha Sunil Accenture Technologies, Bangalore India