Multi-purpose dialogue management system employing visual anthropomorphous agent

We have been constructing a visual anthropomorphous agent system called Visual Software Agent(VSA). The VSA has a texture-mapped realistic human facial image and moves his/her face with facial expression in real-time. Also, it can recognize the speech dialogue of a user and can respond in synthesized voice sentence with synchronizing his/her mouth movement. This style of multi-modal dialogue system may become a very important technology in advanced human interfaces in near future. However, because our earlier system had been designed to fit a specific application, it had been difficult to apply it to other applications. In order to solve this problem, we have constructed a multi-purpose dialogue system employing the VSA.