The year is 2027 — you look inside your computer tower — you find a big ol vaporwave shoe w/ 8 pin cables plugged into it. www.reuters.com/business/all...

Vision [Language] Embeddings are a powerful tool to dive into relationships between images. If you enjoy traveling through them in 3D as much as I do, try out Vision Embedding Space Traveling (VEST)! github.com/ScaDS/vest Bon voyage! ✈️

Brooklyn Day 1 — both my movers and my neighbor asked if I’ve ever lived in nyc before — both with very concerned expressions 😂

Developing parasocial feelings towards animals w/ social media accounts is completely avoidable!

If anyone knows any excellent and experienced data engineers who would be excited by a Richmond-based job in the cultural heritage sector, have them get in touch.

Would you realize if the book you were reading was AI? What if it was humanized to remove AI-speak? We find that even without using stylistic cues (e.g., word choice or sentence structure) narrative choices alone give AI fiction away!

Vs code has this button at the bottom now of the UI that says “update is ready, click to restart.” And I really know, at an inopportune time, I will click this, and my day is going to get very annoying.

Now that there’s a magic the gathering account on bluesky — I have a precise sense of which nlp/cs folks are spending more of their intellectual strength thinking about mana leaks than memory leaks. 😔😂

The special Korean exhibit at the Art institute has taught me an important lesson… If I am part owner of Samsung — I too can own priceless historical artifacts and lend them at my leisure.

Get me off this hellish rock and send me to Planet Dank

So, I’ve got this idea for a heist movie 🤣 home.cern/news/press-r...

For no reason whatsoever —thinking, “if I were teaching books in 2026, I’d want to teach the long history of portraying self-owns.” “Sensationalizing the self own:” Greek comedy, Narcissus, Swift’s narrator, Mr. Collins, the Underground Man, Gob Bluth. And so many great choices for syllabi images!

A lot of language learning often starts with common phrases, grammar, etc. Thanks to an ongoing bit, coworkers are starting me off learning mandarin — by using ml related terminology… Will report back in four years when I only know how to order food and ask about the sparsity of your MoEs.

Any time I’m in a complicated ml training repo — with lots of moving pieces — I do enjoy imagining myself as Indiana Jones. In the sense that it’s obvious when changing a config means I’ll be running from a boulder. But also in the sense that we put unused catacombs under the library!

I think I’m having the funniest send off from Seattle (last week in town)! Which is sitting in a cafe, overhearing two Seattle residents talk about how much they despise New York and New Yorkers. I *love* eavesdropping on regionalism — such a rush. 🤣

Extensive lecture of Eric W. Tramel (Nvidia) on synthetic data: "Synthetic pretraining is the way frontier models are built" scalable-ai.eecs.berkeley.edu/assets/lectu...

🧵New paper: "Lost in Backpropagation: The LM Head is a Gradient Bottleneck" The output layer of LLMs destroys 95-99% of your training signal during backpropagation, and this significantly slows down pretraining 👇

I’m excited to be coordinating a new @ischoolui.bsky.social program The Summer Intensive will offer 6 courses over 2 weeks in May & June this year—SI weeks will also include a range of academic, professional, & social events—we are hoping to cultivate real "summer camp for LIS nerds vibes"

I’ve actually met more reactionary mathematicians than not— But! I think LLMs have highlighted two ongoing things. 1) The deep ideological heterogeneity of many disciplines. 2) Lots of people think they are bad at math and programming due to pedagogical trauma/ the magic of self-characterization.

One thing about growing up in Kuwait, is that history classes make sure you’re aware of how much global effort it takes to put out oil fires. I think *with coordinated effort* it took a year to put out the fires from the gulf war? Anyway, get involved — I sometimes make phone calls to Georgia.

Kicking a dead parrot

A decent primer on the longer history of the UK, Iran, and the U.S.— how we continue to not learn and the wild origins of BP that I wasn’t aware of. youtu.be/SJddbloTJ70?...

Zenyatta cosplayers about to be put out of business

3:30 am me - reflecting on how I’ve chosen a career where I’m genuinely intrigued why one very large matrix and another matrix are slightly different — when they should be the same. Me, grumbling at these very similar matrices, “please! Let me slumber!”

Uff

Media/ humanities ml folks might find this useful to track — I can think of a project or two ;) netflixtechblog.com/mediafm-the-...

From time to time I mutter about a secret project that involves benchmarks and historical language models. Here's a formal announcement of the Schmidt Sciences grant. Other PIs include @dmimno.bsky.social , @lauraknelson.bsky.social, @andrewpiper.bsky.social, and @mattwilkens.bsky.social. And +

“No no, I’m not a weeb, I just *love* Japanese woodblock prints!” (From the current rotation of prints at the chicago art institute)

“Penguins Sliding Snow Dunes Must Softly Waddle, Carrying Pebbles” For folks who need to have multi-head self attn ops jumbling around in their head. 😂

* working * * Suddenly remembering an intern who learned I’m over 30, teasing me for having worked with svms before * It’s vicious out here.

Currently at the art institute of chicago: not the vase we need but the vase we deserve.

Since it’s officially approved, I’ll be moving to NYC (same job)! Likely around March! Idk who I know in NYC, but please say hello! You’ll find me parallelizing tensors across every cafe in Brooklyn. I’m in the market for any and all food/drink recs!

It’s only fair. In my experience, if you let the kiddos beat you, they will lord it over you. Show them no weakness. “Cannon rush your kids, destroy all their lands, and take all their pieces on the board” — The Tao of Millennial Nerds.

BLANK!

Got to be mere inches from a tiger!

1/ We found that deep sequence models memorize atomic facts "geometrically" -- not as an associative lookup table as often imagined. This opens up practical questions on reasoning/memory/discovery, and also poses a theoretical "memorization puzzle."

Extracting Books From Production Language Models ahmeda14960.github.io/blackbox_web...

As chrome adds split tabs, I do start to wonder how much of my visual experience will become an ide 😂

This hits especially hard as someone who emerged from English departments — listening to a lot of tenured profs contrast their perceived professional practices from coding/computation, at the active cost of their students… while they accrue debt. W-i-l-d.

When you happen to look down from a pier and a harbor seal emerges, looking up at you— before going underwater again, teasing me into waiting with my binoculars for half an hour… — Dear reader, the cute harbor seal did not return. 😔😔😔 instead I was treated to a smorgasbord of sea lions

My partner and I were looking for the last few edge pieces of a jigsaw puzzle, but there were quite a few pieces to sort through. So as a joke he took a picture of all the pieces asked it to find them, and… it found them 😂 Fun benchmark idea: visual needle in a haystack (if not already a thing)

Let’s goooooooo!!! 🤪😂

TIL, San Luis Obispo features the very first Jamba Juice. Which in my historical mental model was the popularizer of the health smoothie? Idk if there was one before that?

California’s state slogan should really be “nothing you do will make your state as beautiful as ours, surrender.”

Little does Katseye know that 21st century kpop stars 🤝 19th century horticulturists

Will post prettier pics in a bit, but today I got to witness 3 park rangers coral a bobcat away from humans. Barely visible in this picture.

The tour guide’s sermon on the perils of yellow journalism doesn’t quite have the intended effect when you follow it up with the afforded opulence.

Monarch butterfly grove near Mismo beach! The sleeping clusters are very hard to spot. Also bonus image of sleepy California beach towns being unreal.