🚀 We released version 0.3 of the DuckLake specification and the DuckDB ducklake extension today. It includes interoperability with Iceberg, support for geometry types and more. Check the announcement blog for more details ducklake.select/2025/09/17/d...

"5 HoUrS oF TrIaL AnD ErRoR SaVeS YoU 10 MiNuTeS oF ReAdInG ThE DoCuMeNtAtIoN." The documentation:

📈 DuckDB 1.4.0 is out! This is our first LTS release which comes with *one year of community support*. It also supports database encryption, the MERGE SQL statement and Iceberg writes. For more details, read the announcement blog post at duckdb.org/2025/09/16/a...

We're testing a new distribution channel for @duckdb.org : #docker images. For now they live at `hfmuehleisen/duckdb`, feel free to test them out. And yes, hell got a little colder today. hub.docker.com/r/hfmuehleis...

I've been trying to learn more about some of the concepts in the #AI space, and writing things up as I go. Here's my third blog post in the series, looking at #RAG with some hands-on examples. rmoff.net/2025/09/12/s... Check out the other articles, covering MCP & Models: rmoff.net/categories/s...

Blog Writing for Developers rmoff.net/2023/07/19/b...

I really enjoyed this talk from Paul Iusztin at QCon London. Covers lots of concepts around like #LLMs, #RAG, and #Agents and explains them well. www.infoq.com/presentation...

Write more blog articles, not fewer (Don’t leave the scraps on the cutting floor) rmoff.net/2025/03/11/w...

Love it - someone used SQL to build… a DOOM-like multiplayer shooter 😁 cedardb.com/blog/doomql/

Part 2 is out! In which I try to get my head around LLMs and the like rmoff.net/2025/09/08/s...

A new blog post, in which I write up my learning about MCP 👇 rmoff.net/2025/09/04/s...

PopSQL Moves to Limited Support :-( popsql.com/blog/popsql-...

Apache Kafka 4.1.0 released kafka.apache.org/blog#apache_...

A 1,000 episodes to explore Here's a map on my unofficial archive site, Braggoscope www.braggoscope.com/explore

Now I wish I'd watched this before I tried figuring it out for myself 😅 Tim Berglund nails it in this crystal-clear explanation of MCP: www.youtube.com/watch?v=FLpS...

🏃‍♂️ having too much fun learning about MCP :)

Replacing a cache service with a database - blag avi.im/blag/2025/db...

Oracle Autonomous Database & Confluent Tableflow: Real-Time Kafka Analytics Without ETL blogs.oracle.com/datawarehous...

Sunny Days Are Warm: Why LinkedIn Rewards Mediocrity www.elliotcsmith.com/linkedin-tox...

Brad Stulberg - Motivation is Overrated: Here’s What Works Instead bstulberg.medium.com/motivation-i...

✍️ Blogged: Interesting Links - August 2025 🗂️ Topics cover #ApacheKafka, #ApacheIceberg, #ApacheFlink, Stream Processing, #DataEngineering, RDBMS, and some stuff that I just found generally interesting :) 👉 rmoff.net/2025/08/21/i... #dataBS

Details of how DataDog built a new time series storage in Rust, replacing five previous generations of platform, giving 60x ingest speed and 5x faster queries www.datadoghq.com/blog/enginee...

Ostensibly about the adoption of StarRocks at Fresha, this blog post goes into a bunch of interesting detail about data platform architecture, migration strategy, data serving tiers, and more - recommended! freedium.cfd/https://medi...

srsly, probably 50% of the articles with interesting titles are just AI-generated crap. Smells include 🫵all✅the💽emojis • bullet • lists and then crappy ascii-art diagrams. (I guess this list'll get fed back into LLMs so they learn how to produce this shit better…)

Preparing this month's Interesting Links (rmoff.net/categories/i...) and jfc there is so much shit on Medium. Some of it is human-generated shit, and more and more it's AI slop. Unfortunately there is the odd gem in there amongst the swill so it'd be remiss not to keep trawling it.

✍️ Blogged: Kafka to Iceberg - Exploring the Options rmoff.net/2025/08/18/k... #dataBS

Vortex (vortex.dev) is now a Linux Foundation project www.linuxfoundation.org/press/lf-ai-...

Building Reproducible ML Systems with Apache Iceberg and SparkSQL: Open Source Foundations www.infoq.com/articles/rep...

Erica Pisani—A First-Timer’s Guide to Curating a Technical Conference Track www.infoq.com/articles/gui...

Richard van der Hoff - How matrix.org discovered, and recovered from, Postgres corruption matrix.org/blog/2025/07...

I should go on vacation more often—whilst I was away #ApacheFlink 2.1 was been released! flink.apache.org/2025/07/31/a...

✍️ Blogged: Interesting Links - July 2025 👉 Lots of Iceberg this month, plus Kafka, Flink, several interesting papers, and 9x examples of data in action at companies including Peloton, Cloudflare, Datadog, and Stifel 📚 rmoff.net/2025/07/18/i...

The weekend is here! Perfect time to submit your #dataBS talk. We want your lessons-learned stories from data work, everything from "my data pipeline: the unsung hero" to "how we got that AI system working" to "what we learned when it fell over." Details and sign-up: bit.ly/dataBSconf-cfs

Ignore the clickbaity listicle title - there are some really good points in this article from Bernd Wessely freedium.cfd/https://medi...

I currently run my blog using Hugo and GitHub Pages. Does anyone know of a way to bolt on a substack-esque email subscription option? I want to retain ownership of content, but seem to remember someone talking about something that did this. Sound familiar, @ssp.sh perhaps?

check it out, I wrote a blog 👇 😁 (it's showing how you can use SQL in Flink to build streaming ETL, with the resulting data ending up as Iceberg tables courtesy of Tableflow.) www.confluent.io/blog/streami... #dataBS

Details of Peloton's Data Infrastructure, including Kafka, Hudi, and Debezium hudi.apache.org/blog/2025/07...

Maths is hard, part 94.

Building a streaming data pipeline? Step one: make sense of the data you’re working with. @rmoff.net walks through how to explore and validate messy real-world data from #ApacheKafka in #ApacheIceberg using Tableflow. Read it now 👉 cnfl.io/4jrtjrD

✍️ I'm continuing my learning journey with #ApacheIceberg, taking a look at why housekeeping is necessary: rmoff.net/2025/07/14/k... I also learnt a little bit about #ApachePolaris, and even got chance to try out Nimtable :) #dataBS

Debezium 3.2.0.Final Released debezium.io/blog/2025/07...

Improving Debezium performance, by Vojtěch Juránek debezium.io/blog/2025/07...

Every time I use a notebook like Jupyter I remember how damn powerful they are for learning and developing something. So much of our tooling is just functional and necessary, but notebooks… notebooks are FUN as well as powerful :)

Brandolini lifting heavy today.

🚀 The DuckDB 1.3.2 bugfix release is out! 📦 The Python and CLI clients are already on the latest version, while the rest will follow in the coming days. 🔖 See the detailed change log at github.com/duckdb/duckd...

How Atlassian migrated four million JIRA database instances from RDS for Postgres to Aurora www.atlassian.com/blog/atlassi...

At last @abigalekim.bsky.social's paper is out! Its the most complete eval of DB extensions/plugins ever. We analyze PostgreSQL, MySQL, MariaDB, SQLite, DuckDB, Redis. TLDR: Postgres extns ecosystem is fraught with footguns. Other DBMSs have fewer extns but less problems. DuckDB has cleanest API.

📢 DuckLake 0.2 is out! We added new features to the specification and improved support in the DuckDB ducklake extension. See the announcement blog post at duckdb.org/2025/07/04/d....

✍️ Blogged: Writing to #ApacheIceberg using the #ApacheKafka Kafka Connect Iceberg sink rmoff.net/2025/07/04/w... #dataBS

An all-time classic conference talk: www.destroyallsoftware.com/talks/wat