Streaming with Apache Iceberg: The Operational Problems at Scale | Yuval Yogev www.ryft.io/blog/streami...

Apache Hudi 1.1 Deep Dive: Optimizing Streaming Ingestion with Apache Flink hudi.apache.org/blog/2025/12...

Clickhouse - How the 5 major cloud data warehouses really bill you clickhouse.com/blog/how-clo...

Yelp - S3 server access logs at scale engineeringblog.yelp.com/2025/09/s3-s...

Uber - From Batch to Streaming www.uber.com/blog/from-ba...

Data Quality Design Patterns pipeline2insights.substack.com/p/data-quali...

Uber - Improving MySQL Cluster Uptime: Designing Advanced Detection, Mitigation, and Consensus with Group Replication www.uber.com/en-AU/blog/i...

Transactions Aren’t Enough: The Need For End-To-End Thinking blog.allegro.tech/2025/12/tran...

I'm forever recommending @raycast.com to folk, so I took the time to write down quite _why_ it's probably the best thing since sliced bread. 💌 A love letter to Raycast: rmoff.net/2025/12/18/a...

Hey check it out - I've now got a Substack! It's just the same content as on my blog, but if you prefer getting an email then feel free to subscribe. interestinglinks.substack.com/p/interestin... (I've moved the publication domain, just in case you happen to have bookmarked the previous one…)

Fresha - Connecting Flink, Airflow and StarRocks Part 1: medium.com/fresha-data-... Part 2: medium.com/fresha-data-...

Hey check it out - I've now got a Substack! It's just the same content as on my blog, but if you prefer getting an email then feel free to subscribe. interestinglinks.substack.com/p/interestin... (I've moved the publication domain, just in case you happen to have bookmarked the previous one…)

How Fresha reduced their Postgres on RDS storage footprint by 75% medium.com/fresha-data-...

🎄Interesting Links in the data world for December 2025 is here! There's some awesomely excellent content that you'll not want to miss. Grab a mince pie and dive in :) 🔗 rmoff.net/2025/12/16/i...

Ouch. people-work.io/blog/junior-...

You can now query Iceberg catalogs with DuckDB – from the convenience of your browser. In our latest blog post, we break down how DuckDB's WebAssembly client makes this possible with zero setup and showcase it in action using Amazon S3 Tables. 👉 duckdb.org/2025/12/16/i...

Riskified's Journey to a Single Source of Truth medium.com/riskified-te...

Anyone know of a working equivalent of freedium.cfd? It was a great way to de-crappify Medium, but went offline a couple of months ago :(

From BI to AI: A Modern Lakehouse Stack with Lance and Iceberg lancedb.com/blog/from-bi...

On "AI Brendans" or "Virtual Brendans": www.brendangregg.com/blog//2025-1...

How AI Agents are changing the job of a Data Engineer ai.gopubby.com/what-it-mean...

Deep-dive into indexes in Apache Hudi: pt1: hudi.apache.org/blog/2025/10... pt2: hudi.apache.org/blog/2025/11...

This is an excellent practical explainer from Stefan Kecskes about Kafka Connect and its components skey.uk/post/kafka-c...

What's the best data-related (or otherwise!) article you've read this month? I'll be putting together my Interesting Links for December next week and looking for submissions :) (missed November's? it's here: rmoff.net/2025/11/26/i...)

This is pretty cool - Kafka Connect and Debezium at the heart of Datadog's data replication platform www.datadoghq.com/blog/enginee...

Real-Time Anomaly Detection with Apache Flink - @seanfalconer.bsky.social seanfalconer.medium.com/real-time-an...

A key factor for making technical discussions more successful (and enjoyable) is to resist the urge to one up each other. Don't try to prove you're smarter than others, instead work collaboratively towards a solution, benefiting everyone involved.

Parul Pandey - Why I’m Making the Switch to marimo Notebooks towardsdatascience.com/why-im-makin...

Critical Mistakes Companies Make When Integrating AI/ML into Their Processes | Towards Data Science towardsdatascience.com/critical-mis...

I've seen a lot of criticism directed towards Apache Flink recently. Here's something I have to say: Flink is not going anywhere. www.streamingdata.tech/p/why-apache...

It Doesn’t Need to Be a Chatbot | Towards Data Science towardsdatascience.com/it-doesnt-ne...

🕵️ Spotting Astroturfing on Reddit Using Graph Analysis rmoff.net/2025/12/01/u...

I went sock-puppet hunting! (What I found will _not_ shock you 😉 ) 🔗 Using Graph Analysis with @neo4j.com and @yworks.bsky.social to Spot Astroturfing on Reddit rmoff.net/2025/12/01/u...

🚀 I've built a new interactive simulation of #Kafka Streams, showcasing state stores! See state stores being restored, switch between RocksDB & in-memory state store behavior,restart tasks. Great for understanding or explaining Kafka Streams! Try it here: kafkastreamsfieldguide.com/tools/state-...

ICYMI (and if you're in 🇺🇸 you probably did 🦃): My monthly round-up of Interesting Links in the data world for November rmoff.net/2025/11/26/i...

Understanding the evolution of data lakes medium.com/capital-one-...

Wait what's this?! I've managed to pull my finger out to ship a list of **a whole lot of interesting links about stuff going on in the world of data for November**, a whole three days left until the end of the month! rmoff.net/2025/11/26/i...

Lakehouse format convergence & data interoperability medium.com/capital-one-...

In DuckDB v1.4.2, we shipped a number of features and improvements to the DuckDB-Iceberg extension: insert, update, and delete statements are all supported now. Read Tom Ebergen's new article on these features at duckdb.org/2025/11/28/i...

Wait what's this?! I've managed to pull my finger out to ship a list of **a whole lot of interesting links about stuff going on in the world of data for November**, a whole three days left until the end of the month! rmoff.net/2025/11/26/i...

⚡️ Writing an abstract for a lightning talk ⚡️ rmoff.net/2022/08/31/%...

🗣️ "The combination of AVRO’s binary encoding and lz4 compression delivered exactly what we wanted: an order-of-magnitude smaller footprint, faster network transfers and reduced latency" Great post by Emiliano Mancuso about the benefits of Avro for CDC pipelines 👍. 👉 medium.com/fresha-data-...

How to win [or at least not suck] at the conference abstract submission game rmoff.net/2020/01/16/h...

Enshittification is real. AI Slop is ruining the internet. rmoff.net/2025/11/25/a...

✍️ It's not high-brow, it's not erudite, but it is a ranty af blog post about AI slop: rmoff.net/2025/11/25/a... #enshittification #AISlop #blogging

2) If you’re proposing a talk that mentions your company’s product, realize that the committee will worry that it could be a thinly-veiled product pitch. Write accordingly.

Great tips! 2 more I’d add 1) In today’s blah blah age...please don’t let AI “polish” your abstract. Proofread, fine. But don’t let it blandify your ideas/style.

How to Write a Good Tech Conference Abstract - Learn from the Mistakes of Others rmoff.net/2022/07/20/h...

DuckDB v1.4 introduced the much-requested feature of database encryption. In our new blog post, @ccfelius.bsky.social and @hannes.muehleisen.org explain how the encryption works under the hood: duckdb.org/2025/11/19/e...

Waiting for SQL:202y: GROUP BY ALL peter.eisentraut.org/blog/2025/11...