lnu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements
Linnaeus University, Faculty of Arts and Humanities, Department of Swedish Language. Linnaeus University, Linnaeus Knowledge Environments, Education in Change. (Lnuc IMS;Lila;EdLing)ORCID iD: 0000-0001-5324-3071
Lund University, Sweden.ORCID iD: 0000-0003-4704-5559
KTH Royal instute of technology, Sweden.ORCID iD: 0000-0002-4628-3769
2022 (English)In: Proceedings of the International Conference on Speech Prosody 2022 / [ed] Frota S., Cruz M., Vigario M., International Speech Communication Association , 2022, p. 352-356Conference paper, Published paper (Refereed)
Sustainable development
Not refering to any SDG
Abstract [en]

Visual information can be integrated in prominence perception, but most available evidence stems from controlled experimental settings, often involving synthetic stimuli. The present study provides evidence from spontaneously produced head gestures that occurred in Swedish television news readings. Sixteen short clips (containing 218 words in total) were rated for word prominence by 85 adult volunteers in a between-subjects design (44 in an audio-visual vs. 41 in an audio-only condition) using a web-based rating task. As an initial test of overall rating behavior, average prominence across all 218 words was compared between the two conditions, revealing no significant difference. In a second step, we compared normalized prominence ratings between the two conditions for all 218 words individually. These results displayed significant (or near significant, p<.08) differences for 28 out of 218 words, with higher ratings in either the audiovisual (13 words) or the audio-only-condition (15 words). A detailed examination revealed that the presence of head movements (previously annotated) can boost prominence ratings in the audiovisual condition, while words with low prominence tend to be rated slightly higher in the audio-only condition. The study suggests that visual prominence signals are integrated in speech processing even in a relatively uncontrolled, naturalistic setting.

Place, publisher, year, edition, pages
International Speech Communication Association , 2022. p. 352-356
Series
Proceedings of the International Conference on Speech Prosody, ISSN 2333-2042
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
URN: urn:nbn:se:lnu:diva-119580DOI: 10.21437/SpeechProsody.2022-72Scopus ID: 2-s2.0-85147200055OAI: oai:DiVA.org:lnu-119580DiVA, id: diva2:1740018
Conference
11th International Conference on Speech Prosody, Speech Prosody 2022, Lisbon, Portugal, May 23-26, 2022.
Funder
Swedish Research Council, VR-2017-02140Swedish Research Council, VR-2013-2003Available from: 2023-02-28 Created: 2023-02-28 Last updated: 2025-09-23Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Ambrazaitis, Gilbert

Search in DiVA

By author/editor
Ambrazaitis, GilbertFrid, JohanHouse, David
By organisation
Department of Swedish LanguageEducation in Change
General Language Studies and Linguistics

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 323 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf