lnu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Acoustic features of multimodal prominences: Do visual beat gestures affect verbal pitch accent realization?
Lund university.ORCID iD: 0000-0001-5324-3071
Royal Institute of Technology, KTH.
2017 (English)In: The 14th International Conference on Auditory-Visual Speech Processing (AVSP2017) / [ed] Slim Ouni, Chris Davis, Alexandra Jesse, Jonas Beskow, Stockholm: KTH , 2017Conference paper, Published paper (Refereed)
Abstract [en]

The interplay of verbal and visual prominence cues has attracted recent attention, but previous findings are inconclusive as to whether and how the two modalities are integrated in the production and perception of prominence. In particular, we do not know whether the phonetic realization of pitch accents is influenced by co-speech beat gestures, and previous findings seem to generate different predictions. In this study, we investigate acoustic properties ofprominent words as a function of visual beat gestures in a corpus of read news from Swedish television. The corpus was annotated for head and eyebrow beats as well as sentence-level pitch accents. Four types of prominence cues occurredparticularly frequently in the corpus: (1) pitch accent only, (2) pitch accent plus head, (3) pitch accent plus head plus eyebrows, and (4) head only. The results show that (4) differs from (1-3) in terms of a smaller pitch excursion and shorter syllable duration. They also reveal significantly larger pitch excursions in (2) than in (1), suggesting that the realization of a pitch accent is to some extent influenced by the presence of visual prominence cues. Results are discussed in terms of the interaction between beat gestures and prosody with a potential functional difference between head and eyebrow beats.

Place, publisher, year, edition, pages
Stockholm: KTH , 2017.
Keywords [en]
Audio-visual prosody, Co-speech gestures, News speech, Swedish, Multimodality
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
URN: urn:nbn:se:lnu:diva-71260OAI: oai:DiVA.org:lnu-71260DiVA, id: diva2:1199700
Conference
The 14th International Conference on Auditory-Visual Speech Processing (AVSP2017)
Projects
Multimodal prominens: Hur verbala och visuella signaler samverkar för att förmedla små skillnader i informationsstruktur
Funder
Marcus and Amalia Wallenberg FoundationAvailable from: 2018-04-21 Created: 2018-04-21 Last updated: 2018-05-04Bibliographically approved

Open Access in DiVA

fulltext(120 kB)4 downloads
File information
File name FULLTEXT01.pdfFile size 120 kBChecksum SHA-512
07eccb67d2d2cf1564033938b365f1a9ee7c7b59b93d0cc954ac984fcbd3c8c3a7ffecbee82ac648d41ec3105943d5f6af6c1f7c77cb46f81075f61ef8930e18
Type fulltextMimetype application/pdf

Other links

fulltext

Authority records BETA

Ambrazaitis, Gilbert

Search in DiVA

By author/editor
Ambrazaitis, Gilbert
General Language Studies and Linguistics

Search outside of DiVA

GoogleGoogle Scholar
Total: 4 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 28 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf