Faster responses are better responses: Introducing incrementality into sociable virtual personal assistants

Vivian Tsai, Timo Baumann, Florian Pecune, Justine Cassell

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Speech-based interactive systems, such as virtual personal assistants, inevitably use complex architectures, with a multitude of modules working in series (or less often in parallel) to perform a task (e.g., giving personalized movie recommendations via dialog). Add modules for evoking and sustaining sociability with the user and the accumulation of processing latencies through the modules results in considerable turn-taking delays. We introduce incremental speech processing into the generation pipeline of the system to overcome this challenge with only minimal changes to the system architecture, through partial underspecification that is resolved as necessary. A user study with a sociable movie recommendation agent objectively diminishes turn-taking delays; furthermore, users not only rate the incremental system as more responsive, but also rate its recommendation performance as higher.

Original languageEnglish
Title of host publication9th International Workshop on Spoken Dialogue System Technology, IWSDS 2018
EditorsLuis Fernando D’Haro, Rafael E. Banchs, Haizhou Li
PublisherSpringer
Pages111-118
Number of pages8
ISBN (Print)9789811394423
DOIs
Publication statusPublished - 2019
Externally publishedYes
Event9th International Workshop on Spoken Dialogue System Technology, IWSDS 2018 - Singapore, Singapore
Duration: 2018 Apr 182018 Apr 20

Publication series

NameLecture Notes in Electrical Engineering
Volume579
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference9th International Workshop on Spoken Dialogue System Technology, IWSDS 2018
CountrySingapore
CitySingapore
Period18/4/1818/4/20

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Fingerprint Dive into the research topics of 'Faster responses are better responses: Introducing incrementality into sociable virtual personal assistants'. Together they form a unique fingerprint.

Cite this