Summerschool 13-17 July Multiscale Social Dynamics at MindLabs NL - Sign ups are open!

📄🚨New #OSF #preprint! How does cognitive load affect different stages of language prediction? Using visual-world eye-tracking, we found that the prediction process is disrupted and no longer shows evidence of separable stages, and prediction is delayed. Preprint: osf.io/preprints/ps...

We’re looking for English native speakers (age 18–35) to take part in a short and fun online, PAID language experiment! You can participate anytime, anywhere, if you: (read comments)

𝗡𝗼𝘄 𝗼𝗽𝗲𝗻: 𝗠𝗮𝘅 𝗣𝗹𝗮𝗻𝗰𝗸 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗚𝗿𝗼𝘂𝗽 𝗟𝗲𝗮𝗱𝗲𝗿 𝗣𝗼𝘀𝗶𝘁𝗶𝗼𝗻 (𝗪𝟮) An exciting opportunity for outstanding researchers ready to lead an independent research group and shape the future of multimodal language research. Learn more and apply here: www.mpi.nl/career-educa...

📢 PhD position in the NeuroAI of Language Why can LLMs predict brain activity so well? We're hiring a PhD student to find out -- AI interpretability meets neuroimaging Deadline March 20 Please RT 🙏 👇 mpi.nl/career-education/vacancies/vacancy/fully-funded-4-year-phd-position-neuroai-language

Why conversation is more like a dance than an exchange of words www.mpi.nl/news/why-con...

Excited for my talk tomorrow at ISGS Hong Kong! ✨

Zeehondenpups die veel tijd met elkaar doorbrengen, roepen met eenzelfde ‘accent’. Ze wachten ook netjes hun beurt af voor ze geluid beginnen te maken. Bioloog Koen de Reus (31) deed onderzoek in opvangcentrum Pieterburen om meer te leren over de communicatie van zeehonden.

Tips for resources would be really appreciated! 😊

Delighted to share our new paper, now out in PNAS! www.pnas.org/doi/10.1073/... "Hierarchical dynamic coding coordinates speech comprehension in the brain" with dream team @alecmarantz.bsky.social, @davidpoeppel.bsky.social, @jeanremiking.bsky.social Summary 👇 1/8

Happy with this popular science article about our work (with @lindadrijvers.bsky.social and @judithholler.bsky.social), showing that listeners use co-speech hand gestures to predict upcoming meaning ✋ www.medscape.com/viewarticle/...

🚨NEW PAPER🚨 Prior expectations guide multisensory integration during face-to-face communication Out now in @plos.org Computational Biology journals.plos.org/ploscompbiol... w/ @giuliamz.bsky.social et al. @cimecunitrento.bsky.social 🧠🧪 #psychscisky #neuroskyence TL;DR 🧵👇

👀 👂 How does the brain merge what we hear & see? @lindadrijvers.bsky.social got an ERC Starting Grant (≈ €1.5M) for HANDWAVE, studying how we integrate audiovisual signals. Vital for understanding language disorders & improving diagnostics.👇 www.ru.nl/en/research/...

New issue of ROLSI out online: a Special Issue of articles exploring the use of coding in conversation analysis www.tandfonline.com/toc/hrls20/c...

The articles in the Special Issue on Coding, now out online:

How do our brains and bodies support social learning in real time? We take an ecological and multimodal neuroscience approach to study mutual prediction and social coordination when learning with others. It took 5 full years for this one! Full open-access pre-print: osf.io/preprints/ps...

I had a lot of fun last week organising @isgs2025.bsky.social in my role as chair of the local support team! Thanks to all attendees and organizers for making the conference such a great success 🫶

🌟The closing session of #ISGS2025 has officially concluded—thank you to all our speakers, presenters and attendees! See you at ISGS11 in Hong Kong 🌟

📢 We will announce the winner of the Student Poster Prize at the closing session of #ISGS2025 on Friday 🏆 Don’t miss it — join us as we celebrate outstanding student research! ✨ Keep an eye on our website to stay in the loop and catch all the updates www.isgs10.nl/home

We're hiring! Join us to work at the intersection of social interaction and language technology. Postdoc and PhD positions in my Futures of Language research group, based at Radboud University in Nijmegen, NL Read more: markdingemanse.net/futures/news... #linguistics #interaction #sts #emca #hci

📢 We are thrilled to announce that the full program for #ISGS2025 is now available on our website: isgs10.nl ✨Explore the detailed schedule featuring latest advancements in multimodal language research ✨

🚨 Great PhD opportunity to work with James McQueen and Orhun Ulusahin on the NWO-funded project ’Plugging talkers in: A new solution to the variability problem in human speech recognition’! Deadline 13th of June 📅 www.ru.nl/en/working-a...

NEW PREPRINT Iconic gestures are produced before the associated words and support prediction, but how does this work in children learning words? Check out our new paper led by @marinewang.bsky.social @eddonnellan.bsky.social: osf.io/preprints/ps...

Co-speech hand gestures are used to predict upcoming meaning. Final version by @marlijnterbekke.bsky.social , @lindadrijvers.bsky.social & @judithholler.bsky.social doi.org/10.1177/09567976251331041

You do not need to be Dutch to sign. If you simply care to preserve programs that have been leaders in rigor and reform in psychology, then signal your support for them to continue to thrive.

Interested in the evolution of human language and in understanding the pressures that shape languages today? Come do a PhD with me! Fully funded PhD position available in my group @mpi-nl.bsky.social, application deadline June 2nd: www.mpi.nl/career-educa...

Dyadic differences in empathy scores are associated with kinematic similarity during conversational question-answer pairs. Final version by @jamestrujillo.bsky.social , Rebecca M. K. Dyer & @judithholler.bsky.social doi.org/10.1080/0163853X.2025.2467605

Multimodal information density is highest in question beginnings, and early entropy is associated with fewer but longer visual signals. Final version by @jamestrujillo.bsky.social & @judithholler.bsky.social doi.org/10.1080/0163853X.2024.2413314

If anyone is interested in using WhisperX to transcribe speech, this tutorial is for you!! In this tutorial, I provide an easy-to-use pipeline where you will get a time-aligned transcript as a Praat TextGrid file, a TSV file, and a subtitle file🙌 github.com/ShoAkamine/w...

In face-to-face conversations, speakers use hand movements to signal meaning. But do listeners actually use these gestures to predict what someone might say next? A study using virtual avatars showed that listeners used the avatar’s gestures to predict upcoming speech. www.mpi.nl/news/listene...

Co-speech hand gestures are used to predict upcoming meaning. New paper by @marlijnterbekke.bsky.social , @lindadrijvers.bsky.social & @judithholler.bsky.social doi.org/10.1177/09567976251331041

Co-Speech Hand Gestures Are Used to Predict Upcoming Meaning journals.sagepub.com/doi/10.1177/... A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. An EEG experiment showed that gestures reduced alpha & beta power - indicating anticipation

🎉 New paper out today! We used virtual avatars and EEG to show that listeners use meaningful gestures to predict what someone might say next 🧠👋 Read it here in Psychological Science 👉 doi.org/10.1177/0956..., with @lindadrijvers.bsky.social and @judithholler.bsky.social

📢 New publication alert! 📢 👂Ever struggled to understand natural speech in a noisy environment? 🤔 Our new research shows that moving rhythmically can actually help you hear better! royalsocietypublishing.org/eprint/ZWRPM... with: @strijkers.bsky.social & Noémie teRietmolen 🧵👇

Update: Our biomechanics EMG/Posture study on voice and upper limb kinetics has been accepted at Proceedings B. We show that moving the arms (while manipulating mass) recruits (postural) muscles that interact with the voice through respiratory interactions. Postprint: wimpouw.com/files/Pouwet...

Hora est! 🎓 On Friday I successfully defended my PhD thesis "On how gestures facilitate prediction and fast responding during conversation", which can be found here (lnkd.in/eewcJYyt). It was an absolutely fantastic day! 😍

Our paper has been published open access! (My first publication!) This project was part of my MSc thesis with @jamestrujillo.bsky.social & @judithholler.bsky.social. We explored the relationship between dyadic differences in EQ scores, and kinematic & prosodic similarity🧵 doi.org/10.1080/0163...

Autistic individuals benefit from gestures during degraded speech comprehension. Final version by Sara Mazzini, Noor Seijdel & @lindadrijvers.bsky.social doi.org/10.1177/13623613241286570

Inaugural post on bsky: The ECOLANG Multimodal Corpus, providing audiovisual recordings and annotations of multimodal communicative behaviours by English-speaking adults in dyadic interaction with a child or another adult is now available rdcu.be/eblMF

Multimodal transcription is essential for representing visible action in CA transcripts. I’ve recorded a video series showing how I transcribe embodied action step by step. Links to the videos are in the thread below ⬇️

23-27June: The EnvisionBox team @jamestrujillo.bsky.social @babajideowoyele.bsky.social is organizing a summer school on social signal processing again this year! In Amsterdam - hosted by @jamestrujillo.bsky.social Well send out an official sign-up announcement via the envisionbox newsletter soon.

Very happy that this new paper with @jamestrujillo.bsky.social is now out, suggesting that visual signals contribute information especially during question beginnings in Dutch face-to-face conversation.

Beat gestures & prosodic prominence interactively influence language comprehension www.sciencedirect.com/science/arti... How do beat gestures influence language comprehension? Same functional role as focus markers? Or by triggering inference of high speaker confidence? Metacognition raises its head👋

⚽ Research of Yvonne Visser shows how the #stress of a World Cup final can make you react better as a goalkeeper through stronger communication between the #brain and #muscles . ‘This study can contribute to helping people with neuromotor disorders.’ 👉 www.ru.nl/en/research/...