Interaction between gesture and prosody in structuring information: The case of negation
A four-year fully funded PhD position in the Multimodal Language Department.
Doctoral supervisors: Prof. Asli Özyürek (MPI, Radboud University), Assoc. Prof. Hatice Zora (MPI, Stockholm University), Dr. Peter Uhrig (TU Dresden).
For successful communication speakers constantly need to make choices to organize linguistic information in ways fitting their and their interlocutors’ communicative needs at the sentence, discourse and dialogic levels. This is called information structure (IS). Devices that mark IS are diverse ranging from prosodic marking to (morpho)syntactic means as well as gesture. Given the multimodal aspect of communication, the present project aims to investigate gesture (hand, head, facial) as means of expressing IS and its interaction with prosody and morphosyntactic choices in a given language. The project takes an integrated production and perception perspective, even though the emphasis will be on production patterns, and aims to account for language-specific characteristics.
The target language to be investigated is Turkish, which is a verb-final language, with relatively flexible word order driven by information structure, and the linguistic phenomenon to be concentrated on is negation. The main questions to be addressed are i) how do interlocutors use gesture, prosody and morphosyntax in an integrated way to mark negation in Turkish, ii) whether and to what extent gestural marking aligns with prosodic marking iii) how does such multimodal patterning of negation information influence the comprehension and interpretation of negation and its scope.
These questions will primarily be investigated using a corpus-driven approach, and a quantitative and qualitative analysis of a video corpus (e.g. YouTube materials, elicited lab data) in order to gain a systematic understanding of the interplay between gesture, prosody and negation markers in sentence, discourse and dialogic contexts. The candidate will also learn to use automatic machine learning tools (e.g. Open Pose) to detect gestural markers of negation in big corpora. The predictions will then be validated by experimental methods of multimodal language comprehension regarding interactions between prosody and gesture. If time allows, (neuro)psycholinguistic investigation of the integration process from multiple channels in dialogue will be carried out and combined with a cross-linguistic approach.
Project will be led by an interdisciplinary team, by Prof. Asli Özyürek (https://www.mpi.nl/people/ozyurek-asli), an expert in human crosslinguistic multimodal language use and processing at the Multimodal Language Department of Max Planck Institute for Psycholinguistics and Dr Hatice Zora (https://www.mpi.nl/people/zora-hatice) an expert in use, neural and cognitive processing of prosody and information structure and Dr. Peter Uhrig (https://peter-uhrig.de/), an expert in multimodal corpus and computational linguistics.
If you have questions about the post that you wish to discuss before you apply, please email the Multimodal Language Department Director Prof. Asli Özyürek at firstname.lastname@example.org.
Candidates should have:
What we offer you
To apply please use our application portal, by clicking the 'Apply' button
The deadline for application is 1 November, 2023, but can be extended till we find a suitable candidate.
Short-listed candidates will be invited to participate, shortly after the deadline, in an online or in-person interview.
Applications should be in .pdf format and should include:
About our institute
The Max Planck Institute (MPI) for Psycholinguistics is a world-leading research institute devoted to interdisciplinary studies of the science of language and communication, including departments on genetics, psychology, development, neurobiology and multimodality of these fundamental human abilities.
We investigate how children and adults acquire their language(s), how speaking and listening happen in real time, how the brain processes language, how the human genome contributes to building a language-ready brain, how multiple modalities (as in speech, gesture and sign) shape language and its use in diverse languages and how language is related to cognition and culture, and shaped by evolution.
We are part of the Max Planck Society, an independent non-governmental association of German-funded research institutes dedicated to fundamental research in the natural sciences, life sciences, social sciences, and the humanities.
The Max Planck Society is an equal opportunities employer. We recognize the positive value of diversity and inclusion, promote equity and challenge discrimination. We aim to provide a working environment with room for differences, where everyone feels a sense of belonging. Therefore, we welcome applications from all suitably qualified candidates.
Our institute is situated on the campus of the Radboud University and has close collaborative links with the Donders Institute for Brain, Cognition and Behavior and the Centre for Language Studies at the Radboud University. We also work closely with other child development researchers as part of the Baby & Child Research Center.
Staff and students at the MPI have access to state-of-the-art research and training facilities.
About the Multimodal Language Department
The Multimodal Language Department in particular aims to understand the cognitive and social foundations of the human ability for language and its evolution by focusing on its multimodal aspect and crosslinguistic diversity. The research at the department combines multiple methods including corpus and computational linguistics, psycho- and neuro-linguistics, machine learning, AI and virtual reality, and is concerned with various populations ranging from speakers of signed and spoken languages, young and older subjects from typical and atypical populations. The department provides opportunities for training in a range of linguistic, conversational state of the art multimodal language analysis (such as motion capture and automatic speech recognition), as well as neuropsychological, psychological methods related to multimodal language and frequent research and public engagement meetings, and support from an excellent team of researchers in linguistics and psycholinguistics.
|Location:||Nijmegen - Netherlands|
|Funding for:||UK Students, EU Students, International Students|
£2,616.95 + converted salary* gross salary per month
|Placed On:||29th September 2023|
|Closes:||1st November 2023|
Type / Role:
Your PhD alert has been successfully created for this search.
Your job alert has been successfully created for this search.Ok Ok
Your PhD alert has been successfully created for this search.
Your job alert has been successfully created for this search.Manage your job alerts Manage your job alerts
In order to create multiple job alerts, you must first verify your email address to complete your account creationRequest verification email Request verification email
In order to create multiple alerts, you must create a jobs.ac.uk jobseeker accountCreate Account Create Account
Unfortunately, your account is currently blocked. Please login to unblock your account.
We received a delivery failure message when attempting to send you an email and therefore your email address has been blocked. You will not receive job alerts until your email address is unblocked. To do so, please choose from one of the two options below.
A maximum of 5 Job Alerts can be created against your account. Please remove an existing alert in order to create this new Job AlertManage your job alerts Manage your job alerts
A maximum of 500 Saved Jobs can be created against your account. Please remove an existing Saved Job in order to add a new Saved Job.Manage Saved Jobs