I’m happy to share our new paper, “KerJEPA: Kernel Discrepancies for Euclidean Self-Supervised Learning”: arxiv.org/abs/2512.19605 This work builds on the LeJEPA framework by reinterpreting its regularization objective through the lens of kernel discrepancies.

If you're a PhD student interested in interning with me or one of my amazing colleagues at Microsoft Research New England @msftresearch.bsky.social this summer, please apply here jobs.careers.microsoft.com/global/en/jo... If you'd like to work with me, please include my name in your cover letter!

Microsoft Research New York City (www.microsoft.com/en-us/resear...) is seeking applicants for multiple Postdoctoral Researcher positions in ML/AI! These are positions for up to 2 years, starting in July 2026. Application deadline: October 22, 2025

MSR NYC is hiring spring and summer interns in AI/ML/RL! Apply here: jobs.careers.microsoft.com/global/en/jo...

Only in LA 🐢

Very excited to share our preprint: Self-Speculative Masked Diffusions We speed up sampling of masked diffusion models by ~2x by using speculative sampling and a hybrid non-causal / causal transformer arxiv.org/abs/2510.03929 w/ @vdebortoli.bsky.social, Jiaxin Shi, @arnauddoucet.bsky.social

Could this be our future? (Sound on)

You can read more in our post at www.jurabio.com/blog/leavs; preprint forthcoming. @jura.bsky.social @eliweinstein.bsky.social @mgollub.bsky.social @highvariance.bsky.social

The Microsoft Research Undergraduate Internship Program offers 12-week internships in our Redmond, NYC, or New England labs for rising juniors and seniors who are passionate about technology. Apply by October 6: msft.it/6015scgSJ

If you're an undergraduate interested in interning with me or one of my amazing colleagues at Microsoft Research New England this summer, please apply here: msft.it/6015scgSJ

Tomorrow we're excited to host @sarahalamdari.bsky.social at Chalmers for the AI4Science seminar and hear about generative models for protein design! Talk at 3pm CEST. 🤩 For more info, including details on how to join virtually, please see psolsson.github.io/AI4ScienceSe... @smnlssn.bsky.social

We may have the chance to hire an outstanding researcher 3+ years post PhD to join Tarleton Gillespie, Mary Gray and me in Cambridge MA bringing critical sociotechnical perspectives to bear on new technologies. jobs.careers.microsoft.com/global/en/jo...

In 1965, Margaret Dayhoff published the Atlas of Protein Sequence and Structure, which collated the 65 proteins whose amino acid sequences were then known. Inspired by that Atlas, today we are releasing the Dayhoff Atlas of protein sequence data and protein language models.

So you want to skip our thinning proofs—but you’d still like our out-of-the-box attention speedups? I’ll be presenting the Thinformer at two ICML workshop posters tomorrow! Catch me at Es-FoMo (1-2:30, East hall A) and at LCFM (10:45-11:30 & 3:30-4:30, West 202-204)

Jikai Jin, Lester Mackey, Vasilis Syrgkanis: It's Hard to Be Normal: The Impact of Noise on Structure-agnostic Estimation https://arxiv.org/abs/2507.02275 https://arxiv.org/pdf/2507.02275 https://arxiv.org/html/2507.02275

Off to ICML next week? Check out my student Annabelle’s paper in collaboration with @lestermackey.bsky.social and colleagues on low-rank thinning! New theory, dataset compression, efficient attention and more: arxiv.org/abs/2502.12063

Your data is low-rank, so stop wasting compute! In our new paper on low-rank thinning, we share one weird trick to speed up Transformer inference, SGD training, and hypothesis testing at scale. Come by ICML poster W-1012 Tuesday at 4:30!

Jikai Jin, Lester Mackey, Vasilis Syrgkanis It's Hard to Be Normal: The Impact of Noise on Structure-agnostic Estimation https://arxiv.org/abs/2507.02275

NeurIPS is seeking additional ethics reviewers this year. If you are able and willing to participate in the review process, please sign up at the form in the link: neurips.cc/Conferences/... Please share this call with your colleagues!

Shunichi Amari has been awarded the 40th (2025) Kyoto Prize in recognition of his pioneering research in the fields of artificial neural networks, machine learning, and information geometry www.riken.jp/pr/news/2025...

🏆 I'm delighted to share that I've won a 2025 COPSS Emerging Leader Award! 😃 And congratulations to my fellow winners! 🙌🏽 Check out how each of us is improving and advancing the profession of #statistics and #datascience here: tinyurl.com/copss-emerging-leader-award

Congratulations to the 2025 #COPSS Awardees, @ericjdaza.com, @lucystats.bsky.social, @lestermackey.bsky.social, and all of you. I hope to congratulate you at #JSM2025 in Nashville with @amstatnews.bsky.social. God I hope to go. #rstats #statssky

NeurIPS 2025 is soliciting self-nominations for reviewers and ACs. Please read our blog post for details on eligibility criteria, and process to self-nominate:

Congratulations to @lestermackey.bsky.social for receiving the 2025 COPSS Award! 🎉👏 Lester is currently the Chair of the Section on Bayesian Statistical Sciences (SBSS) of the American Statistical Association.

Off to #AAAI25! We're presenting #SatCLIP (w/ @marccoru.bsky.social, @estherrolf.bsky.social, @calebrob6.bsky.social & @lestermackey.bsky.social) at the 12.30-2.30pm poster session on Feb 28! Let me know if you're around & want to chat #GeoAI!🛰️ Paper: tinyurl.com/5eejz5kw Code: tinyurl.com/2zm64967

idk dude it's 30 pages of proofs and then they drop this

I've been shocked that a theory-driven method yields practical results this good, especially on attention approximation. I proposed my best new optimizer design originally as a dumb baseline; the fact that you can get these efficiency gains with a principled approach makes me a lil insecure.

Probably Attentively Correct models

New guarantees for approximating attention, accelerating SGD, and testing sample quality in near-linear time

Why permute when you can cheaply permute?

Please read our statement on the remarks made by Dr. Rosalind Picard at her NeurIPS 2024 invited talk and our commitment to respect, inclusivity, and upholding our values: neurips.cc/Conferences/2024/StatementOnInclusivity

Invited Talk, Right now! The Golem vs. Stone Soup: Understanding How Children Learn Can Help Us Understand And Improve AI Alison Gopnik West Exhibition Hall C, B3 Watch online: https://buff.ly/4g7tvuI

If you're a PhD student interested in interning with me or one of my amazing colleagues at Microsoft Research New England this summer, please apply here jobs.careers.microsoft.com/global/en/jo...