In the past few years, we’ve seen a cambrian explosion of new columnar formats, challenging the hegemony of Parquet. Presumably, the design of yore is not going to cut it moving forward. I spent some time to understand a bit better how things actually changed. sympathetic.ink/2025/12/11/C...

If you missed my talk "The advent of the open data lake" at AI By the Bay, the recording is now available. ai.bythebay.io/talks/the-ad... www.youtube.com/watch?v=xHGV...

Earthquake!

It turns out that Friday’s NYT’s mini crosswords was written by my 13-year-old.

Parquet praise in the wild :) Nice chatting with you at Datacouncil Hannes! www.youtube.com/watch?v=zeon...

Come say hi, Wednesday at 10am. I'll be speaking at the AI By the Bay Conference about "The Advent of The Open Data Lake". ai.bythebay.io/talks/the-ad...

If you missed me giving it live, the slides of my talk, "Column Storage for the AI era" are available here: docs.google.com/presentation...

Netflix: "We capture over a trillion events a day." Datadog: www.datadoghq.com/blog/enginee....

@openlineage.bsky.social support for Ray by Anyscale www.anyscale.com/blog/announc...

Good evening golden gate.

Higher latency but higher throughput on improving the overall data ecosystem.

"if you want to go fast, go alone; If you want to go far, go together" New Apache Parquet Community page is up: parquet.apache.org/community/

The future of data connectivity is columnar. Today we launched @columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇

Experimenting with the laser cutter to make 3d objects.

This just went in the oven

If you missed my talk: "Data Observability and OpenLineage" at the Datadog summit in SF, here is your chance to catch up on the recording. www.youtube.com/watch?v=uhNo...

Another earthquake

Great time seeing Garbage at the Warfield tonight.

I'm speaking tomorrow at "Embracing AI in Open Source" If you've been wondering why we see a flurry of new columnar formats, come see me present "Column Storage for the AI Era" I'll talk about what has changed, new advances in data encoding and how that's pushing Parquet to evolve. luma.com/pxikwty3

Who’s solving the Louvre robbery? Right answers only

First attempt at making prints with the laser cutter. I don’t know what I’m doing but happy to have made something.

And then he said: « Bring me to your leader! »

Felt it

"It is not 100% clear to me how a new file format (or three) will drive additional ecosystem adoption :thinking:" However, I absolutely think this adds to the pressure for Parquet to evolve. Speaking of, anyone interested in helping add new encodings to parquet? lists.apache.org/thread/djnbb...

"Why Datadog Chose Airflow 3: Multi-Tenancy, Observability, and the Future of Event-Driven Workflows" Zach and I will be talking about how Datadog adopted Airflow 3 at the Airflow summit next week. Come say hi! airflowsummit.org/sessions/202...

Columnar file formats are hot!

I'm trying to understand a bit better real life deployments of open source Clickhouse. If you're using it, what does your deployment look like?

Berkeley just experienced a small earthquake. Check USGS for the official earthquake magnitude: earthquake.usgs.gov/earthquakes/... Remember to drop, cover, and hold on during earthquake shaking.

Woken up by the earth quake!

Catching up in person at the Community over Code conference. Nice to see you all!

I’ll be at the Community over Code Conference in Minneapolis on Thursday and Friday. Come say hi if you’re around. I’m speaking about the deconstructed database Thursday at noon. communityovercode.org/schedule/

A cool blog post by Qi Zhu, Jigao Luo and @andrewlamb1111.bsky.social on embedding custom indices in Parquet files while staying compatible with the standard. datafusion.apache.org/blog/2025/07...

🇫🇷🥐🥖🛫📼😴🛬🌉🥑

New profile pic?

Just strolling in Paris on a summer night. What prevents you from looking like this?

Silver linings…

À jeudi au meetup Iceberg à Paris. Je vais tenter de faire ma présentation en Français. S’il vous plait, on ne se moque pas du franglish! www.meetup.com/iceberg-fr-m...

@andrewlamb1111.bsky.social : "New file formats are not needed: Parquet is enough" I don't disagree 😇 www.youtube.com/watch?v=74Ys...

🌉🛫😴🛬🇫🇷🥖🥐

Nice to see you all outside today and thank you for sharing pictures!

My wife went grocery shopping with our six year old this afternoon. When they came back he proudly announced that they didn’t buy anything for me. :)

On brand

The recording of my keynote at Data Council 2025 is now available. If you missed my best talk so far, you can now catch up. The Deconstructed Database and the Advent of the Open Data Lake www.youtube.com/watch?v=Cqhk...

The recording of my keynote at Data Council 2025 is now available. If you missed my best talk so far, you can now catch up. The Deconstructed Database and the Advent of the Open Data Lake www.youtube.com/watch?v=Cqhk...

It was long overdue.

🗽🛫😴🛬🌉

🌁🛫👨🏼‍💻🛬🗽

If you missed it, the recording of my talk on The Advent Of The Open Data Lake at the Iceberg Summit is up. www.youtube.com/watch?v=TFos...

The average American has three friends.

This query is supposed to find all employees in dept 10 who earn more than all programmers in dept 20, but it has a bug. The bug is caused by a fatal flaw in SQL. What is that flaw, and how does Morel fix it? (The answer is in my talk with @julien.ledem.net, youtu.be/zpdbEvhhne8#...)