lnu.sePublications
Planned maintenance
A system upgrade is planned for 17/11-2026, at 12:00-13:00. During this time DiVA will be unavailable.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The role of head and eyebrow movements for the production and perception of prosodic prominence: Evidence from Swedish news readings and spontaneous dialogue
Linnaeus University, Faculty of Arts and Humanities, Department of Swedish Language. (Lnuc IMS;Lila)ORCID iD: 0000-0001-5324-3071
KTH Royal instute of technology, Sweden.ORCID iD: 0000-0002-4628-3769
2021 (English)Conference paper, Oral presentation with published abstract (Other academic)
Abstract [en]

This talk focuses on the role of eyebrow and head gestures for the multimodal construction of prominence. We will summarize results from our recent studies (in progress or submitted) on the co-occurrence of gestures and pitch accents in two different genres (news readings and spontaneous dialogue). Special foci will lie on (1) phonetic and phonological aspects of the co-production of head movements, eyebrow movements and pitch accents in news readings, (2) the audio-visual integration of pitch accents and head movements in the perception of prominence, and (3) some preliminary data on the occurrence of head and eyebrow movements in spontaneous Swedish dialogue. To highlight our key findings, (1) in a data set consisting of 60 brief news readings (12 minutes of speech in total; 1936 words) we have observed a tendency for a more pronounced phonetic realization of pitch accents (in terms of larger fo-rises) as a function of co-occurring head and eyebrow movements, which, we argue, suggests prominence production to be underlyingly multimodal and cumulative. (2) Using a web-based rating task (involving 85 participants: 44 in an audio-visual and 41 in an audio-only condition), we collected prominence ratings for a selection of clips taken from our news reading materials (218 words). The results displayed a small but significant effect of the visual modality, as a stronger perceptual distinction was made between accented words with and without head movements in the audio-video condition compared to the audio-only condition. (3) Finally, in four 5- minute excerpts from the Spontal Corpus, we automatically identified head movements using a motion capture technique, revealing that only 19% of “simple head movements” co-occurred with pitch accents, as opposed to 71% in our news reading data. Hence, in the spontaneous dialogues, head movements serve a multitude of expressive and communicative functions, while in news readings, their function may indeed be primarily related to the signaling of prominence. An annotation of eyebrow movement in the spontaneous speech data is in progress. Overall, our findings suggest an essentially multimodal nature of prominence production and perception, as well as large differences in the usage of gestures between genres. 

Place, publisher, year, edition, pages
2021.
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
URN: urn:nbn:se:lnu:diva-119589OAI: oai:DiVA.org:lnu-119589DiVA, id: diva2:1740074
Conference
Facial Gestures in Interaction, 2nd International Workshop, online conference, Bayreuth, Germany, October 7-9, 2021.
Funder
Swedish Research Council, VR 2017-02140Available from: 2023-02-28 Created: 2023-02-28 Last updated: 2025-09-23Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Conference Programme

Authority records

Ambrazaitis, Gilbert

Search in DiVA

By author/editor
Ambrazaitis, GilbertHouse, David
By organisation
Department of Swedish Language
General Language Studies and Linguistics

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 325 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf