Great interview by @howard.fm on AI. Nice to see him continuing to mask. Jeremy Howard interview at PytorchCon with Anna Tong www.youtube.com/watch?v=LrFb...

This is one of the absolute best conversations on AI and software I've heard in a while. (I listen to a lot of stuff about AI.) @howard.fm is an expert & practitioner who cuts through the noise & false dichotomies, to talk about the joys & pitfalls of human machine collab youtu.be/dHBEQ-Ryo24?...

1/n "Getting better at the particular prompting skills or whatever details of the current generation AI CLI frameworks isn't growing. You know, that's as helpful as learning about the details of some AWS API when you don't actually understand how the internet works.

According to OpenAI, their contract with the US DoW locks in current law, "even if those laws or policies change in the future". Our legal analysis, with Virgil Law CEO Luke Versweyveld, shows that this is almost certainly incorrect. www.answer.ai/posts/2026-0...

This is great news! Too few ML practitioners know what a gamechanger nbdev can be. Years ago at AMD I used nbdev (version 1?) to implement an early prototype of FSR4 realtime super resolution. It was self-explanatory (e.g. with diagrams showing examples of jittering and temporal super resolution)…

nbdev v3 is released! The big change is that nbdev now uses pyproject.toml, not settings.ini, for all config. (nbdev v1 predates pyproject's support for project metadata, so we used our own settings file.) v3's `nbdev_migrate_config` automates migration nbdev.fast.ai/getting_star...

There is a third-party app for this, you can find it here: bsky-follow-finder.theo.io My impression with bluesky is that a lot of things exist but there is just no way of finding them. @nkgarg.bsky.social

Close reading is a technique for careful analysis of a piece of writing, practiced by many ancient cultures, major religions, & academic scholars. The latest fastai course experimented with using AI to go deeper when reading. 1/ www.fast.ai/posts/2026-0...

GenAI has the potential to worsen health inequities. In a new review we show that with intent, confronting the challenges, it could be just the opposite, globally led by @nliulab.bsky.social nature.com/articles/s44...

Oh wow, deepseek is starting to make serious progress on LLMs that offload memory to external storage: github.com/deepseek-ai/...

ZLUDA, now in its third iteration, has added support for CUDA 13.1 compatibility on non-NVIDIA GPUs (well… AMD GPUs). - 1st iteration: Intel created ZLUDA as a drop-in replacement for CUDA on non-NVIDIA GPUs. - 2nd iteration: AMD took over development after Intel dropped support.

Anthropic announces Claude for Healthcare and expanded Life Sciences tools. By connecting directly to data sources like CMS and Medidata, Opus 4.5 aims to reduce administrative burdens. There are some promising ideas, but we need to see if they can deliver. #MedSky #MLSky

One of my favorite findings: Positional embeddings are just training wheels. They help convergence but hurt long-context generalization. We found that if you simply delete them after pretraining and recalibrate for <1% of the original budget, you unlock massive context windows. Smarter, not harder.

OpenAI's GPT OSS is still insanely underrated as a highly adopted open LLM. Downloads are out of control.

cseweb.ucsd.edu/~tzli/novelt... I gave an internal talk at UCSD last year regarding "novelty" in computer science research. In it I "debunked" some of the myth people seem to have about what is good research in computer science these days. People seemed to like it, so I thought I should share.

NEW: China is testing a megawatt-scale airborne wind system that captures stronger high-altitude winds, potentially producing up to 10× more energy with 40% less material and 30% lower costs. It could also be quickly deployed to supply emergency power after disasters.

Happy arxiv:2601 to all who celebrate! 😉🎉🔬 We are so thankful for everyone who uses arXiv everyday to share and discover new research. Happy new year to all - here's hoping for a 2026 full of #openaccess science & lots of new discoveries.

Seems likely that at some point AI will make it much easier to hack critical infrastructure, create bioweapons, etc etc. Many argue that if so, a hardcore nonproliferation strategy is our only option. Rising Tide launch week post 3/3 is on why I disagree 🧵 helentoner.substack.com/p/nonprolife...

Explaining Human Preferences via Metrics for Structured 3D Reconstruction @jacklangerman.bsky.social Denys Rozumnyi, Yuzhong Huang, @ducha-aiki.bsky.social tl;dr: we asked 3D modelers to rank wireframe reconstructions & compared it to ranking by metrics. Observations🧵 1/ arxiv.org/abs/2503.08208

Struggling with Python `re`? regex is a superset of re with additional functionality and more thorough Unicode support. It is very powerful and still kind of an open secret. When I saw @howard.fm explain this I just had to write about it! Today I Learned: carlo.ai/til/regex-se...

Currently reading a study about influenza aerosol transmission, published in 2020 and shows more RNA copies (log scale) in fine aerosol fraction. In 2020… and we still haven’t sorted out air safety in hospitals, and we are still whinging about flu being such a big problem (which it is).

This is fascinating, so LLMs.txt is essentially a hybrid of a sitemap and schemas, accepted by a fair few AI chatbots. You can reference all manor of information about you and your brand in there - to improve AI interpretations. towardsdatascience.com/llms-txt-414...

Late last year I converted some of my projects to fastht.ml - and have been doing all new projects with it. My productivity and enjoyment has increased significantly. An absolute joy to use. Thousand thanks to @howard.fm et al for the fantastic tooling.

I have to admit that except for the occasional cross-posting, not sure I’ll keep very active on here. There was a big opportunity to migrate the core AI/ML community that was unfortunately squandered with all this hf dataset backlash.

Thanks to @howard.fm for the llms.txt initiative! For context: (Analogy) -> llms.txt is like robots.txt; helps LLMs to provide information by using a website at inference time.

Demis Hassabis, James Manyika, and I wrote up an overview of the AI research work & advances across Google in 2024 (Gemini, NotebookLM, robotics, ML for science, & advances in responsible AI+more). 🎊 Given it a read or paste it into NotebookLM to listen, if you prefer! blog.google/technology/a...

I would like a small non-lethal but painful electrical shock to come through the keyboard of anyone who uses the phrase “do better.”

Getting myself set up here. I found the Sky Follower Bridge Chrome plugin pretty helpful (thanks @kawamataryo.bsky.social!) chromewebstore.google.com/detail/sky-f...

🔥 Host your apps for FREE and simplify your infrastructure! 🚀 Tired of complex cloud hosting and the recurring bills that come with it? Host locally on hardware you already own and access anywhere with a browser. It's simpler than you think! Learn how in my latest post. 🔗👇

General consensus in the replies and quotes of this seems to be that the entire concept of "AI skills" is a joke - how hard is typing text into a chatbot, really? I will continue to argue that it's genuinely difficult, and that the challenge in using these tools is widely underestimated

A new paper dropped from DeepMind: Deliberation in Latent Space via Differentiable Cache Augmentation The trouble is, it's not very readable. I tried making a thread here, but it got far too long, so it's a blog now: timkellogg.me/blog/2024/12...

Wrote up my notes on ModernBERT, the brand new modern alternative to 2018-era BERT released by @benjaminwarner.dev and @howard.fm and team simonwillison.net/2024/Dec/24/...

Are you a Python programmer interested in Quantum Computing? This blog post provides a crossover. Using @howard.fm's "fastcore" library for quantum. I explain what fastcore is, how its Transform functionality works and dive into the quantum use case. (1/2) carlo.ai/posts/fastco...

This week we released ModernBERT, the first encoder to reach SOTA on most common benchmarks across language understanding, retrieval, and code, while running twice as fast as DeBERTaV3 on short context and three times faster than NomicBERT & GTE on long context.

Good morning. Let me check if I’ve got this right. - Juni created a bot that shows what Aaron (head of trust and safety) likes - His likes are public information - Aaron likes a porn post - Trust and safety ban the bot and creator in 16 minutes - Creator appeals and ban is upheld

If you read nothing else about AI this week, read this - absolutely fascinating, ties together a whole bunch of recent developments in the field Wrote my own notes here but really this piece defies summarization, you should absorb the whole thing simonwillison.net/2024/Dec/19/...

(Worse, much of the AI research community reacted to his NeurIPS keynote as if it were an epiphany rather than a repetition of what everyone outside AI has been saying for two years. The deification makes me throw up in my mouth a little.)

New AI Snake Oil essay: Last month the AI industry's narrative suddenly flipped — model scaling is dead, but "inference scaling" is taking over. This has left people outside AI confused. What changed? Is AI capability progress slowing? We look at the evidence. 🧵 www.aisnakeoil.com/p/is-ai-prog...

I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵

👀something's coming...

i asked Claude to write a Barthelme-esque short story with the aesthetic sensibilities of "The School", and it gave me this. i mean. i mean.

This is number 1 on MTEB Leaderboard, but the VRAM requirement may be higher than its peers since the base model is gemma-2-9b-it.

Wow amazing! An awesome science tool produced by awesome scientists with the help of the awesome nbdev :D

Non-commercial license, as usual from MSR. 🙄 And of course they don't even give you the option to pay for it.

I'm excited to announce @skyseed.fund, the world's first incubator & fund exclusively focused on Bluesky and @atproto.com. We're just getting started but have $1 Million in committed capital, and will be doing developer grants as well as pre-seed/seed funding. www.prweb.com/releases/ope...

AI hype is making AI researchers forget painfully learned lessons core to the field. There's an emerging cope that progress in capabilities isn't slowing down—it's just invisible as benchmarks are saturated; vibe checks are useless because models are now superhuman so we can't perceive improvement.