lnu.sePublications
Change search
Link to record
Permanent link

Direct link
BETA
Ambrazaitis, GilbertORCID iD iconorcid.org/0000-0001-5324-3071
Publications (10 of 25) Show all publications
Kelterer, A., Ambrazaitis, G. & House, D. (2018). Head beats as pitch-accompanying visual correlates of primary and secondary lexical stress: Evidence from Stockholm Swedish compounds. In: Proc. TAL2018, Sixth International Symposium on Tonal Aspects of Languages: . Paper presented at TAL2018, Sixth International Symposium on Tonal Aspects of Languages. 18-20 June 2018, Berlin, Germany (pp. 124-128). Berlin: The International Speech Communication Association (ISCA)
Open this publication in new window or tab >>Head beats as pitch-accompanying visual correlates of primary and secondary lexical stress: Evidence from Stockholm Swedish compounds
2018 (English)In: Proc. TAL2018, Sixth International Symposium on Tonal Aspects of Languages, Berlin: The International Speech Communication Association (ISCA), 2018, p. 124-128Conference paper, Published paper (Refereed)
Abstract [en]

This study examines the interplay of (verbal) prosody with (visual) head and eyebrow movements in a 24-minute corpus of Swedish television news readings. The paper focuses on ‘double’ beat gestures, asking whether their occurrence relates to a word’s lexical prominence structure (simplex; compound), to lexical tonal prosody (Accent 1; Accent 2), or rather to prominence levels (+/- focal accent; +/- nuclear position). The results suggest that double eyebrow beats are a marginal phenomenon. Double head beats are also rare (only 28 of the 688 words annotated for head beats in our 4088- word corpus), but their usage follows a clear pattern: There is no preference for the nuclear position, but a strong preference to occur on a focally-accented compound (Accent 2), which is usually realized with two pitch peaks. In conjunction with previous findings on (single) head beats, the present results suggest that a head beat in this type of data can associate with lexical (primary or secondary) stress in case the stressed syllable is also marked by a (tonal or intonational) pitch peak.

Place, publisher, year, edition, pages
Berlin: The International Speech Communication Association (ISCA), 2018
Keywords
audio-visual prosody, pitch accent, gesture, multimodality, prominence, nuclear accent
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-80931 (URN)10.21437/TAL.2018-25 (DOI)
Conference
TAL2018, Sixth International Symposium on Tonal Aspects of Languages. 18-20 June 2018, Berlin, Germany
Funder
Swedish Research Council, 2017-02140Marcus and Amalia Wallenberg Foundation, MAW 2012.01.03
Available from: 2019-03-04 Created: 2019-03-04 Last updated: 2019-06-26Bibliographically approved
Ambrazaitis, G. & House, D. (2017). Acoustic features of multimodal prominences: Do visual beat gestures affect verbal pitch accent realization?. In: Ouni, Slim; Davis, Chris; Jesse, Alexandra; Beskow, Jonas (Ed.), Slim Ouni, Chris Davis, Alexandra Jesse, Jonas Beskow (Ed.), The 14th International Conference on Auditory-Visual Speech Processing (AVSP2017): . Paper presented at The 14th International Conference on Auditory-Visual Speech Processing (AVSP2017). Stockholm: KTH
Open this publication in new window or tab >>Acoustic features of multimodal prominences: Do visual beat gestures affect verbal pitch accent realization?
2017 (English)In: The 14th International Conference on Auditory-Visual Speech Processing (AVSP2017) / [ed] Slim Ouni, Chris Davis, Alexandra Jesse, Jonas Beskow, Stockholm: KTH , 2017Conference paper, Published paper (Refereed)
Abstract [en]

The interplay of verbal and visual prominence cues has attracted recent attention, but previous findings are inconclusive as to whether and how the two modalities are integrated in the production and perception of prominence. In particular, we do not know whether the phonetic realization of pitch accents is influenced by co-speech beat gestures, and previous findings seem to generate different predictions. In this study, we investigate acoustic properties ofprominent words as a function of visual beat gestures in a corpus of read news from Swedish television. The corpus was annotated for head and eyebrow beats as well as sentence-level pitch accents. Four types of prominence cues occurredparticularly frequently in the corpus: (1) pitch accent only, (2) pitch accent plus head, (3) pitch accent plus head plus eyebrows, and (4) head only. The results show that (4) differs from (1-3) in terms of a smaller pitch excursion and shorter syllable duration. They also reveal significantly larger pitch excursions in (2) than in (1), suggesting that the realization of a pitch accent is to some extent influenced by the presence of visual prominence cues. Results are discussed in terms of the interaction between beat gestures and prosody with a potential functional difference between head and eyebrow beats.

Place, publisher, year, edition, pages
Stockholm: KTH, 2017
Keywords
Audio-visual prosody, Co-speech gestures, News speech, Swedish, Multimodality
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-71260 (URN)
Conference
The 14th International Conference on Auditory-Visual Speech Processing (AVSP2017)
Projects
Multimodal prominens: Hur verbala och visuella signaler samverkar för att förmedla små skillnader i informationsstruktur
Funder
Marcus and Amalia Wallenberg Foundation
Available from: 2018-04-21 Created: 2018-04-21 Last updated: 2018-05-04Bibliographically approved
Svensson Lundmark, M., Ambrazaitis, G. & Ewald, O. (2017). Exploring multidimensionality: acoustic and articulatory correlates of Swedish word accents. In: Lacerda (chair), Francisco (Ed.), Francisco Lacerda (Ed.), Interspeech 2017: 20-24 August 2017, Stockholm. Paper presented at Interspeech 2017, Stockholm, Sweden, August 20-24, 2017 (pp. 3236-3240). The International Speech Communication Association (ISCA), Article ID 1502.
Open this publication in new window or tab >>Exploring multidimensionality: acoustic and articulatory correlates of Swedish word accents
2017 (English)In: Interspeech 2017: 20-24 August 2017, Stockholm / [ed] Francisco Lacerda, The International Speech Communication Association (ISCA), 2017, p. 3236-3240, article id 1502Conference paper, Published paper (Refereed)
Abstract [en]

This study investigates acoustic and articulatory correlates of South Swedish word accents (Accent 1 vs. 2) ᅵ a tonal distinction traditionally associated with F0 timing. The study is motivated by previous findings on (i) the acoustic complexity of tonal prosody and (ii) tonal-articulatory interplay in other languages. Acoustic and articulatory (EMA) data from two controlled experiments are reported (14 speakers in total; pilot EMA recordings with 2 speakers). Apart from the well-established F0 timing pattern, results of Experiment 1 reveal a longer duration of a post-stress consonant in Accent 2 than in Accent 1, a higher degree of creaky voice in Accent 1, as well as a deviant (two-peak) pitch pattern in Accent 2 for one of eight discourse conditions used in the experiment. Experiment 2 reveals an effect of word accent on vowel articulation, as the tongue body gesture target is reached earlier in Accent 2. It also suggests slight but (marginally) significant word-accent effects on word-initial gestural coordination, taking slightly different forms in the two speakers, as well as corresponding differences in word-initial formant patterns. Results are discussed concerning their potential perceptual relevance, as well as with reference to the c-center effect discussed within Articulatory Phonology.

Place, publisher, year, edition, pages
The International Speech Communication Association (ISCA), 2017
Series
ISCA Conferences, ISSN 1990-9772 ; 2017
Keywords
speech production, pitch, lexical tone, voice quality, articulatory gestures, articulatory phonology, EMA, speech production, pitch, lexical tone, voice quality, articulatory gestures, articulatory phonology, EMA
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-71261 (URN)10.21437/Interspeech.2017-1502 (DOI)
Conference
Interspeech 2017, Stockholm, Sweden, August 20-24, 2017
Available from: 2018-04-21 Created: 2018-04-21 Last updated: 2018-05-07Bibliographically approved
Ambrazaitis, G. & House, D. (2017). Multimodal prominences: Exploring the patterning and usage of focal pitch accents, head beats and eyebrow beats in Swedish television news readings. Speech Communication, 95, 100-113
Open this publication in new window or tab >>Multimodal prominences: Exploring the patterning and usage of focal pitch accents, head beats and eyebrow beats in Swedish television news readings
2017 (English)In: Speech Communication, ISSN 0167-6393, E-ISSN 1872-7182, Vol. 95, p. 100-113Article in journal (Refereed) Published
Abstract [en]

Facial beat gestures align with pitch accents in speech, functioning as visual prominence markers. However, it is not yet well understood whether and how gestures and pitch accents might be combined to create different types of multimodal prominence, and how specifically visual prominence cues are used in spoken communication. In this study, we explore the use and possible interaction of eyebrow (EB) and head (HB) beats with so-called focal pitch accents (FA) in a corpus of 31 brief news readings from Swedish television (four news anchors, 986 words in total), focusing on effects of position in text, information structure as well as speaker expressivity. Results reveal an inventory of four primary (combinations of) prominence markers in the corpus: FA+HB+EB, FA+HB, FA only (i.e., no gesture), and HB only, implying that eyebrow beats tend to occur only in combination with the other two markers. In addition, head beats occur significantly more frequently in the second than in the first part of a news reading. A functional analysis of the data suggests that the distribution of head beats might to some degree be governed by information structure, as the text-initial clause often defines a common ground or presents the theme of the news story. In the rheme part of the news story, FA, HB, and FA+HB are all common prominence markers. The choice between them is subject to variation which we suggest might represent a degree of freedom for the speaker to use the markers expressively. A second main observation concerns eyebrow beats, which seem to be used mainly as a kind of intensification marker for highlighting not only contrast, but also value, magnitude, or emotionally loaded words; it is applicable in any position in a text. We thus observe largely different patterns of occurrence and usage of head beats on the one hand and eyebrow beats on the other, suggesting that the two represent two separate modalities of visual prominence cuing.

National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-71262 (URN)10.1016/j.specom.2017.08.008 (DOI)2-s2.0-85034707910 (Scopus ID)
Projects
Multimodal prominens: Hur verbala och visuella signaler samverkar för att förmedla små skillnader i informationsstruktur
Funder
Marcus and Amalia Wallenberg Foundation, MAW 2012.0103
Available from: 2018-04-21 Created: 2018-04-21 Last updated: 2019-08-29Bibliographically approved
Ambrazaitis, G. & House, D. (2017). Multimodal prominences: How eyebrow and head beats are combined with pitch accents to encode information structure in Swedish news readings. In: The 6th conference of the Scandinavian Association for Language and Cognition: Book of abstracts. Paper presented at The 6th Conference of the Scandinavian Association for Language and Cognition (SALC). Lund, Sweden, April 20-22, 2017 (pp. 21-22). Lund: Lund University
Open this publication in new window or tab >>Multimodal prominences: How eyebrow and head beats are combined with pitch accents to encode information structure in Swedish news readings
2017 (English)In: The 6th conference of the Scandinavian Association for Language and Cognition: Book of abstracts, Lund: Lund University , 2017, p. 21-22Conference paper, Oral presentation with published abstract (Refereed)
Place, publisher, year, edition, pages
Lund: Lund University, 2017
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-82161 (URN)
Conference
The 6th Conference of the Scandinavian Association for Language and Cognition (SALC). Lund, Sweden, April 20-22, 2017
Projects
Multimodal prominens: Hur verbala och visuella signaler samverkar för att förmedla små skillnader i informationsstruktur
Funder
Marcus and Amalia Wallenberg Foundation, MAW 2012.0103
Available from: 2019-04-25 Created: 2019-04-25 Last updated: 2019-04-26Bibliographically approved
Frid, J., Ambrazaitis, G., Svensson Lundmark, M. & House, D. (2017). Towards classification of head movements in audiovisual recordings of read news. In: Paggio, Patrizia; Navarretta, Costanza (Ed.), Patrizia Paggio, Costanza Navarretta (Ed.), Proceedings of the 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016): Copenhagen, 29-30 September 2016. Paper presented at The 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016), Copenhagen, 29-30 September 2016 (pp. 4-9). Linköping: Linköping University Electronic Press, 141, Article ID 141:002.
Open this publication in new window or tab >>Towards classification of head movements in audiovisual recordings of read news
2017 (English)In: Proceedings of the 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016): Copenhagen, 29-30 September 2016 / [ed] Patrizia Paggio, Costanza Navarretta, Linköping: Linköping University Electronic Press, 2017, Vol. 141, p. 4-9, article id 141:002Conference paper, Published paper (Refereed)
Abstract [en]

In this paper we develop a system for detection of word-related head movements in audiovisu-al recordings of read news. Our materials consist of Swedish television news broadcasts and comprise audiovisual recordings of five news readers (two female, three male). The corpus was manually labelled for head movement, applying a simplistic annotation scheme consisting of a binary decision about absence/presence of a movement in relation to a word. We use OpenCV for frontal face detection and based on this we calculate velocity and acceleration features. Then we train a machine learning system to predict absence or presence of head movement and achieve an accuracy of 0.892, which is better than the baseline. The system may thus be helpful for head movement labelling.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2017
Series
Linköping Electronic Conference Proceedings, ISSN 1650-3686, E-ISSN 1650-3740 ; 141
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics; Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-71259 (URN)978-91-7685-423-5 (ISBN)
Conference
The 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016), Copenhagen, 29-30 September 2016
Projects
Multimodal prominens: Hur verbala och visuella signaler samverkar för att förmedla små skillnader i informationsstrukturSwe-Clarin
Funder
Marcus and Amalia Wallenberg Foundation, MAW 2012.0103Swedish Research Council, 821-2013-2003Riksbankens Jubileumsfond, P12-0634:1
Available from: 2018-04-21 Created: 2018-04-21 Last updated: 2018-04-24Bibliographically approved
Ambrazaitis, G. & House, D. (2016). Multimodal levels of prominence: the use of eyebrows and head beats to convey information structure in Swedish news reading. In: ISGS Conference 2016. Gesture, Creativity, Multimodality: Book of abstracts. Paper presented at ISGS Conference 2016. 7th Conference of the International Society for Gesture Studies. Paris, France, July 18-22, 2016 (pp. 319-319). Paris: New Sorbonne University Paris 3
Open this publication in new window or tab >>Multimodal levels of prominence: the use of eyebrows and head beats to convey information structure in Swedish news reading
2016 (English)In: ISGS Conference 2016. Gesture, Creativity, Multimodality: Book of abstracts, Paris: New Sorbonne University Paris 3 , 2016, p. 319-319Conference paper, Poster (with or without abstract) (Refereed)
Place, publisher, year, edition, pages
Paris: New Sorbonne University Paris 3, 2016
Keywords
prosody, pitch accent, focus, beat gesture, information structure
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-73321 (URN)
Conference
ISGS Conference 2016. 7th Conference of the International Society for Gesture Studies. Paris, France, July 18-22, 2016
Projects
Multimodal prominens: Hur verbala och visuella signaler samverkar för att förmedla små skillnader i informationsstruktur
Funder
Marcus and Amalia Wallenberg Foundation, MAW 2012.0103
Available from: 2019-04-24 Created: 2019-04-24 Last updated: 2019-04-26Bibliographically approved
Ambrazaitis, G. & Karlsson, A. (2016). The prosody of topics in two varieties of Swedish: Effects of contrast and referential status. In: Presented at TIE2016, the 7th Conference on Tone and Intonation in Europe: Canterbury, UK, September 1-3, 2016. Paper presented at TIE2016, the 7th Conference on Tone and Intonation in Europe. Canterbury, UK, September 1-3, 2016. Canterbury: University of Kent
Open this publication in new window or tab >>The prosody of topics in two varieties of Swedish: Effects of contrast and referential status
2016 (English)In: Presented at TIE2016, the 7th Conference on Tone and Intonation in Europe: Canterbury, UK, September 1-3, 2016, Canterbury: University of Kent , 2016Conference paper, Oral presentation with published abstract (Refereed)
Place, publisher, year, edition, pages
Canterbury: University of Kent, 2016
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-73322 (URN)
Conference
TIE2016, the 7th Conference on Tone and Intonation in Europe. Canterbury, UK, September 1-3, 2016
Projects
Integrating the Structures of Information and Discourse: a cross-linguistic approach
Funder
Swedish Research Council
Available from: 2019-04-25 Created: 2019-04-25 Last updated: 2019-04-26Bibliographically approved
Ambrazaitis, G., Buanzur, T. C. & Niebuhr, O. (2015). Focal F0 peak shape and sentence mode in Swedish. In: The Scottish Consortium for ICPhS 2015 (Ed.), Proceedings of the 18th International Congress of Phonetic Sciences: . Paper presented at 18th International Congress of Phonetic Sciences, Glasgow, UK, 10-14 August 2015. Glasgow: University of Glasgow, Article ID 0363.
Open this publication in new window or tab >>Focal F0 peak shape and sentence mode in Swedish
2015 (English)In: Proceedings of the 18th International Congress of Phonetic Sciences / [ed] The Scottish Consortium for ICPhS 2015, Glasgow: University of Glasgow , 2015, article id 0363Conference paper, Published paper (Refereed)
Abstract [en]

Shape characteristics of rising-falling accentual F0 peaks of Stockholm Swedish Accent I words in narrow focus are studied in a corpus of 287 read sentences. The corpus includes statements and three types of polar questions. Results reveal a clear effect of sentence mode on the shape of the accentual rises: Statements are predominantly characterized by convex rises, questions by concave rises.

Place, publisher, year, edition, pages
Glasgow: University of Glasgow, 2015
Series
ICPhS Proceedings, ISSN 0301-3162, E-ISSN 0241-0669
Keywords
prosody, question, convex, gender
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-73324 (URN)978-0-85261-941-4 (ISBN)978-0-85261-942-1 (ISBN)
Conference
18th International Congress of Phonetic Sciences, Glasgow, UK, 10-14 August 2015
Projects
Funktions- och produktionsbaserad modellering av svensk prosodi
Funder
Swedish Research Council, 421-2009-1566
Available from: 2018-04-23 Created: 2018-04-23 Last updated: 2018-05-04Bibliographically approved
Ambrazaitis, G., Svensson Lundmark, M. & House, D. (2015). Head beats and eyebrow movements as a function of phonological prominence levels and word accents in Stockholm Swedish news broadcasts. In: Presented at MMSYM 2015, The 3rd European Symposium on Multimodal Communication: Dublin, Ireland, September 17-18, 2015. Paper presented at MMSYM 2015. The 3rd European Symposium on Multimodal Communication, Dublin, Ireland, September 17-18, 2015.
Open this publication in new window or tab >>Head beats and eyebrow movements as a function of phonological prominence levels and word accents in Stockholm Swedish news broadcasts
2015 (English)In: Presented at MMSYM 2015, The 3rd European Symposium on Multimodal Communication: Dublin, Ireland, September 17-18, 2015, 2015Conference paper, Oral presentation with published abstract (Refereed)
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:lnu:diva-73325 (URN)
Conference
MMSYM 2015. The 3rd European Symposium on Multimodal Communication, Dublin, Ireland, September 17-18, 2015
Projects
Multimodal prominens: Hur verbala och visuella signaler samverkar för att förmedla små skillnader i informationsstruktur
Funder
Marcus and Amalia Wallenberg Foundation, MAW 2012.0103
Available from: 2019-04-24 Created: 2019-04-24 Last updated: 2019-04-25Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-5324-3071

Search in DiVA

Show all publications