lnu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Evaluating users reactions to human-like interfaces: Prosodic and paralinguistic features as new evaluation measures for users’ satisfaction
KTH Computer Science and Communication. (Department of Speech, Music and Hearing)
Växjö University, Faculty of Mathematics/Science/Technology, School of Mathematics and Systems Engineering. Datalogi.
2004 (English)In: From Brows to Trust: Evaluating Embodied Conversational Agents, Kluwer Academic Publishers , 2004, p. 101-124Chapter in book (Refereed)
Abstract [en]

An increasing number of dialogue systems are deployed to provide public services in our everyday lives. They are becoming more service-minded and several of them provide different channels for interaction. The rationale is to make automatic services available in new environments and more attractive to use. From a developer perspective, this affects the complexity of the requirements elicitation activity, as new combinations and variations in end-user interaction need to considered. The aim of our investigation is to propose new parameters and metrics to evaluate multimodal dialogue systems endowed with embodied conversational agents (ECAs). These new metrics focus on the users, rather than on the system. Our assumption is that the intentional use of prosodic variation and the production of communicative non-verbal behaviour by users can give an indication of their attitude towards the system and might also help to evaluate the users' overall experience of the interaction. To test our hypothesis we carried out analyses on different Swedish corpora of interactions between users and multimodal dialogue systems. We analysed the prosodic variation in the way the users ended their interactions with the system and we observed the production of non-verbal communicative expressions by users. Our study supports the idea that the observation of users' prosodic variation and production of communicative non-verbal behaviour during the interaction with dialogue systems could be used as an indication of whether or not the users are satisfied with the system performance.

Place, publisher, year, edition, pages
Kluwer Academic Publishers , 2004. p. 101-124
Keyword [en]
evaluation, conversation, human-machine, language technology
National Category
Specific Languages Computer Sciences
Identifiers
URN: urn:nbn:se:vxu:diva-3215ISBN: 1-4020-2729-X (print)OAI: oai:DiVA.org:vxu-3215DiVA, id: diva2:203171
Available from: 2008-01-08 Created: 2008-01-08 Last updated: 2018-01-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

By organisation
School of Mathematics and Systems Engineering
Specific LanguagesComputer Sciences

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 41 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf