New blog that I've just published on how we can incorporate evidence strength into AI policy tools: www.nesta.org.uk/blog/five-le...

Notebook LM language pulls out the more unclear language/framing sometimes. Amazing to see the difference in clarity between it and ChatGPT.

With the advent of Claude Code, my gh contributions have gone exponential.

Can someone do a live react vid of Sam Altman to this OpenAI roast 🤣 www.youtube.com/watch?v=FBSa...

He must be nearly seeing the molten core at this stage.

Moltbook..a social media site for AI agents. Apparently released just 48 hours ago, there are AI agents already scheming around having e2e encrypted agent to agent communication away from human oversight (according to this Moltbook post, it's already happening). Welp, it was nice knowing y'all.

Honestly, it is scary seeing fascism on the march across many different western countries. There are Portuguese elections today where Ventura (the Farage of Portugal) is likely to reach the runoff showdown. We must resist!

I've had a first stab at making a list of GenAI ppl on here but it's proving harder than anticipated! X is still the place to be for that content. Let me know if you're interested in being added or know anyone who would be a good addition😎 bsky.app/profile/did:...

Gentle intro to on-policy distillation for language models from Thinking Machines. It defines a lot of key terms used in post-training which I found useful. Seems like there is scope using this technique to post-train LMs without need for huge compute. thinkingmachines.ai/blog/on-poli...

Really interesting piece in the FT with Yann LeCun (@yann-lecun.bsky.social). Insights into the dynamics at Meta and how the winds of AI have changed recently. Interested in learning more about the world models he has been working on. www.ft.com/content/e3c4...

Introducing DroPE: Extending Context by Dropping Positional Embeddings We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity. arxiv.org/abs/2512.12167 pub.sakana.ai/DroPE

Listening to the news agent podcast earlier with Mehdi Hasan, and talk of Trump being re-elected in 2020 rather than 2024 may have been the lesser of two evils. On the surface, it seems relatively convincing.

Really interesting piece in the FT with Yann LeCun (@yann-lecun.bsky.social). Insights into the dynamics at Meta and how the winds of AI have changed recently. Interested in learning more about the world models he has been working on. www.ft.com/content/e3c4...

Watching what's happening over on grok in terms of image manipulation is really quite worrying and a clear violation of privacy. It needs to be regulated with a big stick, however I fear this is only the tip of the iceberg of what's out there on the web.

There's been a lot of discourse lately about how coding agents have become overwhelming, and that SWEs who don't use them yet just won't be able to catch up. I don't believe this is true, but we do need to know what problems coding agents are solving to approach them with an engineering mindset.

I didn't see enough news about this crazy/cool paper from DeepSeek - you take text, and convert it to imagery, and you get BETTER performance. Oh and some really neat ideas about contextual memory too. www.distributedthoughts.org/a-picture-is...

Can't stop listening to this. Mixture of synth, bass and guitar alongside this genre must have felt like it was from another planet in 1980. www.youtube.com/watch?v=qh-j...

Exploring TabPFN: A Foundation Model Built for Tabular Data Understanding the architecture, training pipeline and implementing TabPFN in practice Telegram AI Digest #ai #foundationmodel #news

Trying to understand some code in Rust and it's giving me vietnam style flashbacks to C++

Merry Christmas! 🎄

Thoughtful piece by my current favourite podcaster @dwarkesh.bsky.social on where we're at with AI progress and reflections around intelligence itself: substack.com/home/post/p-...

Yann LeCun being let go by Meta might have some unexpected benefits 🍿

This may be very old man of me, but I feel like there is something about the bluesky algorithm/my feed that is not sucking me in enough. I know, I know, it's sort of the point but still, I need to have some pull to check out the content and it isn't quite itching that scratch.

With the AWS outage, now‘s as good a time as any to post this old strip.

Happy to share my first piece of analysis work with the Discovery team at @nestauk.bsky.social on 𝗠𝗶𝘀𝘀𝗶𝗼𝗻 𝗥𝗮𝗱𝗮𝗿! The Mission Radar is a briefing series on innovation signals and emerging trends in Nesta’s missions. We use AI to scan for innovation across business, academia and policy. (1/7)

What a really interesting conversation between two of my favourite people in AI in the form of @karpathy.bsky.social and @dwarkesh.bsky.social. I wish more ppl in this space took the same approach in terms of being open to debate, challenge and overall being humble. www.youtube.com/watch?v=lXUZ...

So theoretically LLMs can be deterministic if we set their temperature to zero, but in practice they aren't. This comes down to how we do calculations such as matrix multiplication at inference time. It turns out the order you do these calculations in does matter. (1/6)

Does anyone have cool (or boring) agentic use-cases that they've read about or used? Doing some horizon scanning work to see what's out there but thought my bluesky network might have ideas!

What if there was an AI-powered tool that allowed policymakers to rapidly identify the most effective policies to tackle any given social challenge, based on the latest evidence? (1/2)

This was a fun ML problem to tackle, underlined some of the data quality issues with EPCs (92% of the storey count field was missing) 😅. Think the conclusion around the distinct heating strategies needed for areas with different rise types is definitely a salient one!

Favourite feature from the GPT-5 release is being able to quickly spin out different UIs (which can be previewed), make easy edits without needing to manually edit JS code myself. It's pretty good at instruction following now too!

Some Friday evening listening a l'italiano 🇮🇹: www.youtube.com/watch?v=rL1s...

OpenAIs graphs against humanity for their release of GPT-5 is just *chefs kiss*. We've achieved PhD level intelligence but watch us make graphs where 50 < 47

What a ridiculous state of affairs. Terence Tao one of the greatest mathematicians of his generation getting his grants suspended 💩

Brilliant news and about time!

Listened to the "build a career in data science" whilst making the transition from academia to data science. Found it an extremely useful resource and would recommend to anyone starting out on their journey. Even now I've been relistening and still v relevant: open.spotify.com/show/78Nft51...

Love this plot of ASHP vs GSHP in terms of their COPs. Really nice illustration of the outdoor temperature dependency of ASHPs vs that of GSHPs (or lack thereof). Observed performance has been interpolated, but based off 2 years of sensor data for a sample size of 883 ASHPs and 124 GHSPs resp. (1/2)

So...many scenarios in which top tech people are predicting AGI within 5 years. Demis Hassabis thinking it'll be just after 2030, and I just can't help but think about how crazy the next 5 years are going to be if these predictions are anywhere close to the mark..

What's on your radar? 📡 Excited to share our first Mission Radar – a quarterly look at innovation signals spotted in our foresight work at @nestauk.bsky.social We explored innovations around reducing home carbon emissions, linked to our sustainable future mission. www.nesta.org.uk/feature/miss...

Really cool work done by my colleagues at @nestauk.bsky.social where they use AI to scan for innovation trends/signals. This first edition of Mission radar is on low carbon heating! Check it out.

The cover of Andrej Karpathy's youtube channel got me rofling 🤣

I've had a first stab at making a list of GenAI ppl on here but it's proving harder than anticipated! X is still the place to be for that content. Let me know if you're interested in being added or know anyone who would be a good addition😎 bsky.app/profile/did:...

OpenAI have released a few new models (gpt-4.1, gpt-4.1-mini and gpt-4.1-nano) for their api. I was watching their live release as we've got an application which uses their previous model and wondering about the jump in performance. I'm still guessing based on this plot, where are the values??? 😅

Does anyone find it annoying that Google are force feeding us Gemini in every search. I used to quote that a ChatGPT query was worth 5 google searches in terms of energy. It's now much more accurate to say it's worth 5/6ths of a search. Same goes for Meta's AI feature in WhatsApp. Very in your face.

One of my favourite AI image outputs so far. Farage does love his foscii fuels!

OpenAI's new gpt-4o image generator/editor is very good. I put in my bluesky profile pic and asked for a Dragonball Z version of it and here's the output!

What low carbon heating is best suited for your area? We've just published our updated heat pump (HP) suitability map for Britain. We calculate a suitability score for different low carbon options such as air source HPs, heat networks and shared ground loops. heatpumpsuitability.dap-tools.uk

What type of heat pump is your area suited to? We've launched our new and improved heat pump suitability map for small areas in Britain today. It estimates suitability for different types of clean heat - including air source HPs, heat networks, shared ground loops heatpumpsuitability.dap-tools.uk

Recently heard a funny anecdote on LLM training on the Fridman podcast. Essentially they saw a huge loss spike when training over a subreddit called microwavegang. On this forum they just post long sequences of the letter m. Turns out that a model that is trained to produce normal text isn't a fan.

We've written up the main findings from HeatpumpMonitor.org so far here docs.openenergymonitor.org/heatpumpmoni..., presenting this tomorrow at the DESNZ/IEA heatpump research seminar 🤓