Our latest paper, “Visual language models show widespread visual deficits on neuropsychological tests”, is now out in Nature Machine Intelligence: www.nature.com/articles/s42... Non-paywalled version: arxiv.org/abs/2504.10786 Tweet thread below from first author @genetang.bsky.social...

X-modal processing of auditory & visual symbol representations in the temporo-parietal cortex www.researchsquare.com/article/rs-8... Slow-event-related 3T fMRI: A passive listening/viewing task auditory/visual letters & numbers overlapping activation in auditory cortex for auditory letters/numbers

Attention decoding at the cocktail party: Preserved in hearing aid users, reduced in cochlear implant users www.sciencedirect.com/science/arti... 29 HA, 24 CI users & 29 age-matched TH people EEG attending 1 of 2 talkers (female/male) in free-field; EEG <-> envelope linear backward & forward models

Toward Fuller Integration of Respiratory Rhythms Into Research on Infant Vocal&Motor Development nyaspubs.onlinelibrary.wiley.com/doi/10.1111/... Assays motor control,physiology,speech & language acquisition proposes respiration is core in early rhythmic coordination linking vocalization & movement

Human newborns form musical predictions based on rhythmic but not melodic structure journals.plos.org/plosbiology/... TRF analyses had high inter-individual variability for overall neural tracking of musical stimuli - note-by-note predictability tracked (not shuffled) a rhythmic not melodic effect

Explaining the Musical Advantage in Speech Perception Through Beat Perception and Working Memory nyaspubs.onlinelibrary.wiley.com/doi/10.1111/... "Our findings clarify the cognitive and temporal foundations of the musician advantage and highlight the value of considering musical engagement"

Individuals with congenital amusia show degraded performance in a nonword repetition task with lexical tones www.sciencedirect.com/science/arti... Nonword repetition task for syllable-tone combinations with length of the nonwords gradually increased from 1 to 7 syllables accuracy & error analysed

Early multimodal behavioral cues in autism: a micro-analytical exploration of actions, gestures and speech during naturalistic parent-child interactions https://pubmed.ncbi.nlm.nih.gov/41631016/

In 1961, physicist John Kelly programmed an IBM 704 to sing 'Daisy Bell' - the first song ever sung by a computer. This inspired HAL 9000's song in 2001: A Space Odyssey! 🎵 Historic: youtube.com/watch?v=41U78QP8nBk #SpeechScience #Technology

"We want AI agents that can discover like we can, not which contain what we have discovered. Building in our discoveries only makes it harder to see how the discovering process can be done" scholar.google.com.au/scholar?oi=b... 😲

Cutaneous alternating current stimulation can cause a phasic modulation of speech perception https://pubmed.ncbi.nlm.nih.gov/41617605/

The cortical contribution to the speech-FFR is not modulated by visual information https://www.biorxiv.org/content/10.64898/2026.01.26.701703v1

Audio-visual speech-in-noise tests for evaluating speech reception thresholds: A scoping review https://pubmed.ncbi.nlm.nih.gov/41592005/

An embodied multi-articulatory multimodal language framework: A commentary on Karadöller et al journals.sagepub.com/doi/10.1177/... "we believe it shows that our understanding of the role of gesture in language is incomplete and lacks crucial insight when co-sign gesture is not accounted for"

The involvement of endogenous brain rhythms in speech processing www.sciencedirect.com/science/arti... Reviews oscillation-based theories (dynamic attending, active sensing, asymmetric sampling in time, segmentation theories) & evidence > Naturalistic paradigms and resting-state data key to progress

Children Sustain Their Attention on Spatial Scenes When Planning to Describe Spatial Relations Multimodally in Speech & Gesture onlinelibrary.wiley.com/doi/10.1111/... "How do children allocate visual attention to scenes as they prepare to describe them multimodally in speech and co-speech gesture?"

Effects of Visual Input in Virtual Reality on Voice Production: Comparing Trained Singers & Untrained Speakers www.jvoice.org/article/S089... Study examined if visual spatial cues in immersive virtual reality (room size, speaker-to-listener distance) are associated with changes in vocal production 🗣️

Distinct Temporal Dynamics of Speech & Gesture Processing: Insights From ERP Across L1 and L2 psycnet.apa.org/fulltext/202... "results point to potentially distinct neural and temporal dynamics in processing speech versus gestures" -> speech processing earlier as gestures recruit later stages (?)

An automated pipeline for efficiently generating standardized, child-friendly AV language stimuli www.sciencedirect.com/science/arti... Creating engaging AV stims difficult % time-consuming; automated tools simplify & accelerate stim generation; here, an automated pipeline for AV stims from text 😀

Learning realistic lip motions for humanoid face robots www.science.org/doi/10.1126/... "anthropomorphic robots often fail to achieve lip-audio synchronization, resulting in clumsy and lifeless lip behaviors" Here: soft silicone lips actuated by a 10–degree-of-freedom mechanism- not uncanny at all 😉

Revisiting the Benefits of Hand Gestures in L2 Pronunciation: journals.sagepub.com/doi/10.1177/... Between-subjects study (pretest/post-test), 39 Japanese learners of Mandarin practiced Mandarin aspirated stops, /u/ & T3 Sandhi for 4 session with hand gestures (phonetic/articulatory) vs no gestures.

The temporal effects of auditory and visual immersion on speech level in virtual environments pubs.aip.org/asa/jasa/art... A room's appearance can suggest its acoustics but do people adjust their speech based on this visual information? Study looked at whether AV information affected speech level ..

Age-related increases in speech rhythm in typically developing children pubs.aip.org/asa/jasa/art... Used envelope-based measures of speech rhythm in typically developing children to look at what changed over preschool & school-aged years - syllabic-level rhythms...⬆️

End-to-end audio-visual learning for cochlear implant sound coding simulations in noisy environments pubs.aip.org/asa/jel/arti... Study tested an AV speech enhancement (AVSE) module integrated with ElectrodeNet-CS (ECS) model to form an end-to-end CI system, AVSE-ECS has potential in sound coding

Finally out: www.eneuro.org/content/earl... fMRI during naturalistic story listening in noise, looking at event-segmentation and ISC signatures. Listeners stay engaged and comprehend the gist even in moderate noise. with @ayshamota.bsky.social @ryanaperry.bsky.social @ingridjohnsrude.bsky.social

The role of visual cues on word recognition in noise in monolingual and bilingual toddlers journals.sagepub.com/doi/abs/10.1... 36 monolinguals & 36 bilinguals kids (24 - 35 months) online Looking task: look at the X. Bilinguals worse than monolinguals in noise with no visual speech cues

Making faces www.science.org/doi/10.1126/... Reports on Ianni et al (2026) that cortical control of facial muscle production during social signalling in macaques is similar to that of voluntary action, suggesting that they share coordinated systems of intentional control

Top 4 liked posts 2025 1. Likes: 14 bsky.app/profile/avsp.bsky.social/post/3m4vyotbgjc2k 2. Likes: 13 bsky.app/profile/avsp.bsky.social/post/3mb6sn455ys2c 3. Likes: 13 bsky.app/profile/avsp.bsky.social/post/3lz6s2g7kss2u 4. Likes: 12 bsky.app/profile/avsp.bsky.social/post/3m5ezqbcwjk2q

No Difference in Face Scanning Patterns Between Monolingual & Bilingual Infants at 5 Months of Age onlinelibrary.wiley.com/doi/10.1111/... Do bilinguals use visual speech cues more than monolinguals? Study checked gaze of 474 monolingual & 101 bilingual 5 month old infants to mouths of moving faces

Parallel encoding of speech in human frontal and temporal lobes www.nature.com/articles/s41... "Together, these results support the existence of robust long-range parallel inputs from low-level auditory areas to apical areas in the frontal lobe of the human speech network."

Vocalisations are coupled with movement of all limbs throughout infancy www.nature.com/articles/s41... "infants at 4, 6, 9 and 12 months of age. Limb movements were tightly coupled with vocalisation onsets at all time points across infancy"

Audiovisual Speech Perception in Aging Cochlear Implant Users and Age-Matched Nonimplanted Adults journals.lww.com/ear-hearing/... Looked at age-related differences in cross-sensory & multisensory benefits in AV speech identification in aging CI users & age-matched non-CI users

Musical Training & Perceptual History Shape Alpha Dynamics in AV Speech Integration www.mdpi.com/2076-3425/15... McGurk stims & EEG "musicians appear to employ enhanced top-down control involving frontal regions, whereas nonmusicians rely more on sensory-driven processing" osf.io/b3c5j/overview

"artificial general cleverness" 😆https://mathstodon.xyz/@tao/115722360006034040

Delta-band cortical speech tracking predicts audiovisual speech-in-noise benefit from natural and simplified visual cues www.sciencedirect.com/science/arti... Degraded face vids -> some gains in AV speech comprehension; animations of speech envelope not integrated with auditory speech; Δ band = gain

The Scope and Limits of Iconic Prosody: Head Angle Predicts f0 Changes While Object Size Effects Are Absent direct.mit.edu/opmi/article... Looked at the relationship between head angle & f0 in iconic prosody & object size on lip opening +formant frequencies - but is f0/head angle 'direct' coupling?

The Role of Speech Reading During Visual Word Processing in Hearing Children pubs.asha.org/doi/10.1044/... Is the STS process active in speech reading related to word reading? STS active in visual word-rhyming but only weakly linked to reading -Seems STS phonological processing a better candidate

Video-call glitches trigger uncanniness and harm consequential life outcomes www.nature.com/articles/s41... 5 experiments + 3 supplementary ones using both live & recorded interactions suggest that minor AV glitches during video calls can harm interpersonal judgements in consequential life domains

Rhythm Processing Across Development: Origins, Links to Language Processing, and Perspectives for Intervention nyaspubs.onlinelibrary.wiley.com/doi/10.1111/... Review article discusses evidence of rhythm processing in adults + children & extends this to early infancy.

Dynamic functional connectivity following cochlear implantation: Predicting speech outcomes and exploring brain network dynamics www.pnas.org/doi/10.1073/... Nearly 30% of CI people get limited benefit - fNIRS study measured brain activity for AO & VO speech at 1 mo & 1 y postimplantation ...

Very happy to see @vtolkacheva.bsky.social's paper on the role of sublexical information in perception and misperception of speech now open access in Journal of Memory & Language: www.sciencedirect.com/science/arti... @profkatie.bsky.social (7 experiments!!)

🔬 Excited to present our latest research at the #MAIN2025 conference today! 🔗 laurentperrinet.github.io/talk/2025-12... #DeepLearning #ComputerVision #AI #Research #NeuralNetworks #NeuroAI #OpenScience I love #Montreal

Now published in the Journal of Neurophysiology: journals.physiology.org/doi/full/10.... Get in touch if you think this tool could help in your science! We will be developing improvements and extensions over the next year.

Visual load does not modulate neural processing of audiovisual speech integration www.sciencedirect.com/science/arti... Neural "binding" of acoustic & visual speech signals not modulated by visual load, suggests results support an automatic integration of acoustic & visual speech cues

Meaningful results for meaningful hypotheses www.researchgate.net/publication/... Tutorial provides an accessible, non-technical introduction to a technique - Bayesian inference - that is both conceptually easy to understand, computationally cheap & covers common experimental scenarios 👏

MEG-SCANS - A comprehensive magnetoencephalography speech dataset with Stories, Chirps and Noisy Sentences https://pubmed.ncbi.nlm.nih.gov/41366218/

Multisensory integration for active mechanosensation in Drosophila flight www.cell.com/current-biol... "Together, these results reveal novel behavioral gating of sensory information and expand our understanding of the efferent control of active sensing" both visual presence+content influence flight

Three distinct components of pragmatic language use www.pnas.org/doi/10.1073/... Identified three interpretable components of pragmatic language use: 1) Adherence to social conventions 2) Getting meaning from intonation 3) causal reasoning from world knowledge....

InCHORRRuS: Infant-Directed Communication Highlights and Organizes Repetition and Redundancy Through Rhythmic Structure nyaspubs.onlinelibrary.wiley.com/doi/10.1111/... Reviews literature on timing & rhythm, redundancy & repetition in ID signals - redundancy & repetition ... redundancy & repetition