New AstroPT models are out 🔭🎉 This time trained with an improved DESI galaxy image dataset. Link here: huggingface.co/Smith42/astr... Check out these new scaling curves! We are still seeing improvement at 800M parameters where before we stalled at 100M. Maybe high quality data is all you need 🤔

Anyways, here's the paper - it's one of the first big uses of foundation models in astronomy that I'm aware of, and it seems to have worked really well! #extragalactic #astrocode 🧪

Ooh we scalin'

Strong Platonic Representation Hypothesis All embedding models, given large enough scale, can be translated between them without paired data Security implication: Embeddings aren’t encryption, they’re basically plain text arxiv.org/abs/2505.12540

If you add "also Cthulhu-y" to the prompt, the results are pretty great.

A great dataset to round out UTBD's 2^2 week 😎

📢 New dataset out! We introduce HypoGen💥, a dataset of ~5.5K structured problem–hypothesis pairs (Bit–Flip–Spark + Chain‑of‑Reasoning) to advance LLM-driven scientific ideation💡. Fine‑tuned LLaMA 3.1 8B & R1‑distilled models show significant gains. Humans are still the best🥇.

Was great fun cooking this up with Sharaf and team! Check out all the code at github.com/UniverseTBD/... and paper at arxiv.org/abs/2504.08583

🎉 HAPPY BIRTHDAY, UniverseTBD! 🚀 As we turn 2, we’re going 2^2. Launching a new project per day for the next four days. We hope that you all enjoy these works as much as we have enjoyed working on them. Stay tuned for the big reveals!

tariffs getting so bad you can't even import numpy 🥲

me: i didn't know you were cool like that val loss:

me: go left! ←← my computer: best i can do is ^[[D

Going to be a great talk 😎

arxiv.org/abs/2501.12499 super cool paper! Extracting useful information from astro time series via RNNs

With r1 and o1, Yann Lecun's cake is now baked and ready

The final frontier for AI will be anything that can't be captured via a quantitative benchmark

broke: reading 500 page AI safety papers woke: learning AI alignment best practices from "wallace & gromit: vengeance most fowl"

first time spotting AI art in the wild just look at that floating ship!

the nvidia digits case is so british-housing-core

This makes so much sense – more cooperation when more willing to wait for rewards ~= less risk averse. www.sciencedirect.com/science/arti...

Think twice before gifting someone an M dwarf this holiday season

I move to refer to `'Gold OA' as 'Pay to Publish'

o3 got me thinking about the future of selling our labour as code... how many more iterations until that's transformed? 😅

new shoggoth just dropped 😤😤

lets goo hatfield, great doc about my hometown: www.youtube.com/watch?v=IQYt...

POV: me getting on social media

OpenAI in 2024: “No AI for weapons or military” “Do use our AI to make weapons to hurt yourself or others” “Military is fine, but no AI for weapons” “Sure put it on battlefield drones” www.technologyreview.com/2024/12/04/1...

A common question nowadays: Which is better, diffusion or flow matching? 🤔 Our answer: They’re two sides of the same coin. We wrote a blog post to show how diffusion models and Gaussian flow matching are equivalent. That’s great: It means you can use them interchangeably.

Aaand the Multimodal Universe is on ArXiv 🎉 arxiv.org/abs/2412.02527 Come find the poster at #NeurIPS #NeurIPS2024 #astrocode 🔭

Excited to announce the Multimodal Universe (MMU): a huge 100TB dataset bringing together the largest ML-focused collection of astronomical observations ever assembled to accelerate open AI and astronomy research github.com/MultimodalUn... Think ImageNet, but for space 🔭 #astrocode 🧵

📢NEW: 'Open' AI systems aren't open. The vague term, combined w frothy AI hype is (mis)shaping policy & practice, assuming 'open source' AI democratizes access & addresses power concentration. It doesn't. @smw.bsky.social, @davidthewid.bsky.social & I correct the record👇 nature.com/articles/s41...

Check out 100TB of machine learning ready multimodal astronomy data 🔥🦾 Excited to see what FOSS machine learning world does with this 🔭

CONFIRMED: Oxford University Press select 'brain rot' as the 2024 Oxford Word of the Year 🧠📱 #OxfordWOTY

Brainstorming with Claude Sonnet 🥰

Still mourning the death of r/machinelearning 🥲

This is wild! How didn't this show up in evals? This suggests that position embeddings aren't actually that useful/important?

Rather than restricting data to only the richest and most powerful (as reddit, facebook, and twitter do), bsky makes it available to everyone. Personally, I think that's a good thing.

Very nice work on chemistry and materials science foundation models from Nawaf Alampara and team (including our own @pktrpl.bsky.social 🥳🥳 ) 🧪🧪 Paper link: arxiv.org/abs/2411.16955

so are dual 3090s the current go-to for a hobby LLM machine? What are peeps here using?

Test of Time Paper Awards are out! 2014 was a wonderful year with lots of amazing papers. That's why, we decided to highlight two papers: GANs (@ian-goodfellow.bsky.social et al.) and Seq2Seq (Sutskever et al.). Both papers will be presented in person 😍 Link: blog.neurips.cc/2024/11/27/a...

Both super deserving bedrocks!

Join us on Discord tomorrow (Nov 28th) at 15:00 UTC for our monthly talk 🔭 🧪 ! @micginolfi.bsky.social (U Florence) will be talking about how we can infer many galaxy properties via a single neural net (nice X thread here with more details: x.com/micginolfi/s...). Link: discord.gg/9PXcTH7cTn?e...

Universities are starting to join!

Loss go brrr more to come 👀👀

Very happy to see my grad student Ruby Pearce-Casey's first fully refereed paper at number 1 on the arXiv mailing this morning - and it's a beautiful piece of work, a big step forward in machine learning/AI methods to find strong gravitational lenses 🧪🔭 arxiv.org/abs/2411.16808

And Rosenblatt invented the ResNet in 1962! Check out page 313 of safari.ethz.ch/digitaltechn...

"Concentrating such vast power in a few hands does not lead to good things." ☝️☝️ couldn't agree more @meredithmeredith.bsky.social, we need a healthy, decentralised, open approach to our tech commons

@bot.astronomy.blue signup