We managed to integrate brain scans into LLMs for interactive brain reading and more.. check out Vicky's post below. Super excited about this one!

We managed to integrate brain scans into LLMs for interactive brain reading and more.. check out Vicky's post below. Super excited about this one!

Figuring out how the brain uses information from visual neurons may require new tools, writes @neurograce.bsky.social. Hear from 10 experts in the field. #neuroskyence www.thetransmitter.org/the-big-pict...

Hi, we will have three NeuroAI postdoc openings (3 years each, fully funded) to work with Sebastian Musslick (@musslick.bsky.social), Pascal Nieters and myself on task-switching, replay, and visual information routing. Reach out if you are interested in any of the above, I'll be at CCN next week!

OK, time for a CCN runup thread. Let me tell you about all the lab’s projects present at CCN this year. #CCN2025

#AI "Ultimately, this is a step forward in understanding how the human brain understands meaning from the visual world." #LLMs @mila-quebec.bsky.social @adriendoerig.bsky.social @timkietzmann.bsky.social @natmachintell.nature.com nouvelles.umontreal.ca/en/article/2...

A long time coming, now out in @natmachintell.nature.com: Visual representations in the human brain are aligned with large language models. Check it out (and come chat with us about it at CCN).

Exciting new preprint from the lab: “Adopting a human developmental visual diet yields robust, shape-based AI vision”. A most wonderful case where brain inspiration massively improved AI solutions. Work with @zejinlu.bsky.social @sushrutthorat.bsky.social and Radek Cichy arxiv.org/abs/2507.03168

Exciting new preprint from the lab: “Adopting a human developmental visual diet yields robust, shape-based AI vision”. A most wonderful case where brain inspiration massively improved AI solutions. Work with @zejinlu.bsky.social @sushrutthorat.bsky.social and Radek Cichy arxiv.org/abs/2507.03168

Nice paper by @zejinlu.bsky.social the group of @timkietzmann.bsky.social appearing in Nat Human Behav www.nature.com/articles/s41... showing the properties of a CNN for which you release the weight sharing constraint.. #neuroAI

Introducing All-TNNs: Topographic deep neural networks that exhibit ventral-stream-like feature tuning and a better match to human behaviour than the gold standard. Now out in Nature Human Behaviour. 👇

Introducing All-TNNs: Topographic deep neural networks that exhibit ventral-stream-like feature tuning and a better match to human behaviour than the gold standard. Now out in Nature Human Behaviour. 👇

Can seemingly complex multi-area computations in the brain emerge from the need for energy efficient computation? In our new preprint on predictive remapping in active vision, we report on such a case. Let us take you for a spin. 1/6 www.biorxiv.org/content/10.1...

Can seemingly complex multi-area computations in the brain emerge from the need for energy efficient computation? In our new preprint on predictive remapping in active vision, we report on such a case. Let us take you for a spin. 1/6 www.biorxiv.org/content/10.1...

I'd put these on the NeuroAI vision board: @tyrellturing.bsky.social's Deep learning framework www.nature.com/articles/s41... @tonyzador.bsky.social's Next-gen AI through neuroAI www.nature.com/articles/s41... @adriendoerig.bsky.social's Neuroconnectionist framework www.nature.com/articles/s41...

🚨 New preprint alert! Our latest study, led by @DrewLinsley, examines how deep neural networks (DNNs) optimized for image categorization align with primate vision, using neural and behavioral benchmarks.

Check out our new paper at #ICLR2025, where we show that multi-task neural decoding is both possible and beneficial. As well, the latents of a model trained only on neural activity capture information about brain regions and cell-types. Step-by-step, we're gonna scale up folks! 🧠📈 🧪 #NeuroAI

#CCN2025 abstract acceptances were sent out this morning. I'll post a summary of each of our projects closer to the conference. Looking forward to seeing you all in Amsterdam!

Neat idea and great insight into the inner workings of MLLMs. MLLMs are good at high level vision, but fail at low- and mid-level visual tasks.

Top-down feedback is ubiquitous in the brain and computationally distinct, but rarely modeled in deep neural networks. What happens when a DNN has biologically-inspired top-down feedback? 🧠📈 Our new paper explores this: elifesciences.org/reviewed-pre...

Three year postdoctoral position available in my lab @psychologyuea.bsky.social to work on neuroimaging and deep learning studies of multimodal material perception! with @timkietzmann.bsky.social @stephanierossit.bsky.social - funded by @leverhulme.ac.uk pls repost #compneurosky #neuroskyence

Love the buzzing of the lab before the CCN deadline. Such great focus, and literally just such a great feeling to see what awesome projects they are all working on.

Thanks for sharing! But note that there have been many cases showing this previously. For example we found very clear evidence that training to predict LLM embeddings is better than a variety of other objectives arxiv.org/abs/2209.11737.

Interesting fact I just unearthed about reference letters. Doesn't surprise me.

Glad you got something out of the course, was great fun teaching it,... and thanks for the meme 😎

Hello! I'm looking to hire a post-doc, to start this Summer or Fall. It'd be great if you could share this widely with people you think might be interested. More details on the position & how to apply: bit.ly/cocodev_post... Official posting here: academicpositions.harvard.edu/postings/14723

This year we ran another meme contest as part of my ML4CCN lecture series. Student submissions were fantastic. Guess the paper...

Ouch. Computer vision is nowhere near where we'd want it to be.

Exciting opportunity to work with Fraser (Stephanie and me) on material perception from vision and touch. Please apply and/or spread the word.✌️

My 15' talk "the modern EEG regression toolkit: rERPs, TRFs, mixed models, and more" is now on youtube youtu.be/vnlbVDarRUc?... thanks @cuttingeeg.bsky.social for an awesome #EEG conference!

0 citations to all of @timkietzmann.bsky.social 's RCNN work lmao - this is a new level of "head in the sand".

🚨 Looking for a postdoc/research-scientist/lecturer position in the UK 🇬🇧, mid-2025! Q: How does the visual cortex acquire its expressivity (SSL/RL), process visual relations, and interface with decision-making networks? #NeuroAI #CogSci #CompNeuro CV: sushrutthorat.com/assets/cv-fu...

This paper from Claudia Clopath's lab is very exciting for me. I've been musing for a while now that the challenge of approximating gradient descent is probably made way easier in the brain by feedback signals for control. Here they show it!!! openreview.net/forum?id=xav... 🧠📈 #NeuroAI 🧪

High-level visual prediction errors in early visual cortex! In collaboration with @timkietzmann.bsky.social and @predictivebrain.bsky.social we explored what type of surprise drives the enhanced sensory response often observed for surprising inputs. doi.org/10.1371/jour... Summary 🧵 below

David had a great idea: train people to expect a stimulus, and then, upon violating said expectation, he modeled the brain response by the divergence in different layers of a visual ANN. Later layer differences explained the signal in EVC better than early layer differences. plos.io/48IMadt

High-level visual prediction errors in early visual cortex journals.plos.org/plosbiology/... by @davidrichter.bsky.social @timkietzmann.bsky.social @predictivebrain.bsky.social via @peterkok.bsky.social; prediction error computed at higher levels, surprise signal sent to earlier areas; #neuroscience

For the Blueskyers interested in #NeuroAI 🧠🤖, I created a starter pack! Please comment on this if you are not on the list and working in this field 🙂 go.bsky.app/CscFTAr

Has anyone put together a NeuroAI starter pack? With the recent influx, I have lost track of who is here already.

🧵Join us for a short tour of how a large-scale MEG dataset collected during active vision made us question it all. New work with Carmen Amme, Philip Sulewski, Eelke Spaak, Martin Hebart, and Peter König. www.biorxiv.org/content/10.1...

Just realized that I have not flown for work in years. Wild. Will change today, unfortunately, as Aberdeen is super hard to reach via train.

Heading off to Aberdeen tomorrow, excited about #ECVP2024. I'll be giving the "Spotlight in vision" keynote on using ANNs in visual neuroscience. It's a 90 minute slot, so we can take a deep dive together. ✌️

Continual learning with backprop leads to loss of plasticity, fixed by occasionally randomizing bits of the network. Very clear biological analogies here! www.nature.com/articles/s41... Also, "word on the street" is that this was rejected at multiple ML confs before being accepted at Nature. 🫠 🧪

During REM sleep, the superior colliculus in mice shows activity that matches motor commands for turning left or right, and then simulating the outcome vis-a-vis the representations of heading direction: www.biorxiv.org/content/10.1... #neuroscience 🧪

Hello world. Fresh start on bluesky. Hoping to find many previous Twitter peeps on here.