🚀 Launching Supermetal — data replication that just works. Sync databases to warehouses in real-time or batch — no Kafka, no JVM, no Debezium. Built in Rust & Apache Arrow. Try it → trial.supermetal.io Launch post → supermetal.io/blog/launch

If you are in Vancouver on November 19th, you may want to check this Apache Kafka meetup! www.meetup.com/vancouver-ka...

My regular post-Current report is live: www.streamingdata.tech/p/current-ne...

Great conversation with Jan on all things Flink and data streaming youtu.be/X6Ukpi2p4y4

📝 Blogged: "'You Don't Need Kafka, Just Use Postgres' Considered Harmful" In which I'm arguing that both Postgres and Kafka are great tools for their respective purposes. But don't create your custom implementation of one on top of the other. 👉 www.morling.dev/blog/you-don...

I'm very excited about the upcoming webinar: "The State of Stream Processing", recorded with brilliant @olenakutsenko.bsky.social and @gunnarmorling.dev.

At #Current25

I'm launching Data Streaming Academy! 🎉 streamacademy.io

Shared some thoughts about Flink Forward that happened last week: www.streamingdata.tech/p/flink-forw...

Today's Future Data Systems Seminar Speaker: Ian Cook (@ian.columnar.tech) will present @columnar.tech's work on Apache Arrow's database connectivity API (ADBC). ADBC is available in modern DBMSs. Zoom talk open to public at 4:30pm ET. YouTube video available after: db.cs.cmu.edu/events/futur...

At #FlinkForward

At Polyglot Vancouver

I'll be at the Flink Forward in Barcelona next week. Happy to talk about all things data streaming, Flink, Arrow, DataFusion and more. You can also get these cute stickers! 🐿️

One of my superpowers: actually watching conference talk recordings 🤓

I agree with everything in the post and I tried my best to follow these practices. But, in my experience, bad politics often win. And when that happens several times, you don't want to be involved at all...

Today, in the Data Streaming Journey, I'm sharing my experience of building data streaming products with the RAD stack: Rust, Arrow, DataFusion. www.streamingdata.tech/p/streaming-...

Really, Grammarly?

Introducing Iron Vector: native, columnar, vectorized, high-performance accelerator for Apache Flink SQL and Table API built on top of Rust, Arrow and DataFusion. Reduce your Flink compute cost by up to 2x or handle 2x more data with the same infrastructure.

Introducing Iron Vector: native, columnar, vectorized, high-performance accelerator for Apache Flink SQL and Table API built on top of Rust, Arrow and DataFusion. Reduce your Flink compute cost by up to 2x or handle 2x more data with the same infrastructure.

The benefit of working two jobs: when you're tired of one, you can switch to another.

This is too good not to share: www.scattered-thoughts.net/writing/sql-...

I was compelled to make this

arrow-avro: I'm an experimental library! me: ok, not a big deal me, three days later: oh, I see 😬

The ability to keep up with DataFusion upgrades is a skill. The project truly leverages "breaking changes are fine in a major version upgrade" rule. Just look at this: datafusion.apache.org/library-user... 😅

TIL DataDog has a somewhat usable FREE plan. Yes, free. DataDog. Free. I know. The metric retention is only one hour, but it's enough to do some loadtesting.

In the past few weeks, I fixed memory leaks, JVM GC thrashing, a deadlock and all sorts of concurrency issues 😅. However, the Iron Vector POC is now complete 😎. Running benchmarks now and starting on the V1 roadmap.

I'm glad I see almost no mentions of "Reverse ETL" anymore. Cause it's all just ETL. Or, to be precise, data integration.

A short post about the recent Aiven announcement regarding adding Iceberg support for Kafka www.streamingdata.tech/p/no-more-ex...

“$110M a year on AWS? I could do it for half!” Bro, your last infra project was making a cron job email you weather updates. Sit down. www.duckbillgroup.com/blog/figmas-...

Over the past few months, I've been building a new Irontools extension called Iron Vector. It's a native, columnar, vectorized runtime for Apache Flink SQL and Table API. It's built on top of Rust, Arrow and DataFusion.

Still, probably the most entertaining conference talk I watched. Worth the time www.youtube.com/watch?v=RZ4S...

As a person who's building a plugin system based on dynamic loading, Rust and FFI, this feels very refreshing www.redpanda.com/blog/multi-l.... Just use gRPC over a Unix socket! I'd love to see a performance comparison though, going over gRPC must slower, even with batching.

🤣😅😭

I've just caught someone posting AI-summarized versions of my streaming data newsletter (www.streamingdata.tech) on LinkedIn. Without any attribution, of course.

I’ve been saying this for a while: data streaming needs to be polyglot. I’m addressing this with Iron Functions: a WebAssembly-based runtime that enables writing #ApacheFlink transformations in several languages like TypeScript, Rust, and Go.

What's your getpocket.com export stats?

Last night 🤘🥁

New post! I wrote about malaise in the streaming space. I'm not sure what's going on, but I'm thinking part of it has to do with Kafka.

Current London 2025: Kafka, Flink, Iceberg, AI... and some drama. www.streamingdata.tech/p/current-lo...

At #WebSummit Vancouver. It’s nice to travel to a conference in 20 minutes with no flights involved 😀

Opening Bluesky this morning...

Just saw police deployed a spike strip to stop a car in London. Wild.

Arrived at #Current25

I understand the narrative around losing to someone using AI, but that's not the game I want to play. I'm working to be me; there is no competition.

Wrote up some notes about eng levels and AI skamille.medium.com/things-i-cur...

TIL you can stream ClickHouse data in Arrow format natively: clickhouse.com/docs/interfa...

How did we allow Jackson to become the default Java JSON library? 🫠

Our industry is constantly evolving and so are projects like #Debezium. Competition is good an all that but if you position your new shiny solution against existing tech, please be honest, authentic and truthful... real world example below👇

I launched a new company! 🛠️ Irontools is a suite of Apache Flink extensions that makes your Flink pipelines more efficient and unlocks new use cases. For example, it's now possible to create UDFs in TypeScript! Check the announcement post here: irontools.dev/blog/announc...

Setting up cross-platform build for a Rust project the first time 😅