I've built a Core Insights dashboard for #Kafka Streams! 📊 This Prometheus-based Grafana dashboard brings together the metrics that actually matter. One view to spot issues before they become incidents. #dataengineering kafkastreamsfieldguide.com/articles/kaf...

Interesting new tool to diagnose Kafka clusters! Already has 17 scenarios built-in. They're looking for feedback to add more 👇

Great overview of Kafka Streams!

Happy to share, that we did release an update to our @kafkastreams.bsky.social UI in #ConfluentCloud. We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics. Check it out and let us know what you think! www.confluent.io/blog/monitor...

My Kafka Streams monitoring guide 👇 Learn which metrics to look at first and how to make them available for easy exploration. Discover new dashboards, new UIs, new tools, and other monitoring approaches next to metrics. #ApacheKafka #dataengineering kafkastreamsfieldguide.com/articles/kaf...

We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes! Thanks to 53 contributors and your RM Christo Lolov. For more details, checkout the announcement: kafka.apache.org/blog#apache_...

Check out our big preview of MEWGENICS. I played 30+ hours of the game, interviewed Edmund and Tyler and put together a 35 minute preview about one of 2026’s biggest games. youtu.be/VyxbfbfXzQM?...

🚀 Announcing the Kafka Streams Field Guide! I’m writing a book with 8 insights for running Kafka Streams in production. Join the waiting list at kafkastreamsfieldguide.com and get 2 free chapters! #ApacheKafka

Great podcast episode on Duck Lake, with the creators. It's quickly developing into a proper Iceberg/Delta Lake competitor with a new twist, and I'm looking forward to its 1.0 release. #dataengineering www.dataengineeringpodcast.com/episodepage/...

🚀 We released version 0.3 of the DuckLake specification and the DuckDB ducklake extension today. It includes interoperability with Iceberg, support for geometry types and more. Check the announcement blog for more details ducklake.select/2025/09/17/d...

IT'S OUR NINTH BIRTHDAY 🎉 So we're launching a brand new channel - dedicated to discovering new games that push our industry forward, previews of exciting new titles and reporting on the issues that face gaming today. welcome to noclip_2 TRAILER: www.youtube.com/watch?v=K7lf...

Had a two-day trip to Puy du Fou in France. A truly special theme park you must visit! No rides, only historical shows of exceptional quality and grandeur. Entire sets change before your eyes, with magnificent costumes, lots of actors. No other theme park comes even close to this one.

Apache Kafka 4.1.0 was release! Most exciting, the new “streams” rebalance protocol is available as early access. We are happy to announce the Apache Kafka 4.1.0 release! Please try it out, and let us know how it goes! kafka.apache.org/blog#apache_...

My experience with AI (Perplexity) in creating a 2-day schedule: terrible. Used deep research mode, but even with multiple iterations, it's not able to follow basic scheduling rules.

This is some of the hardest shit I've seen in my life

MCP servers for AI are finally working properly now in JetBrains IDEs. Time to hook up the context7.com MCP server 🚀

Iceberg topics for #ApacheKafka, as an open source plugin for Kafka brokers! While still in beta, this plugin by Aiven looks like it will become a very interesting alternative to Confluent's Tableflow. #dataengineering aiven.io/blog/iceberg...

It's alive! #buffengine #gamedev github.com/SlevinBE/buf...

Wow, enums are really the crown jewels in the #rustlang type system. I was thinking too much in standard OO traits/interfaces, but using enums with fields instead has simplified the event system of my small game engine a lot. Thanks, Effective Rust book! github.com/SlevinBE/buf...

While we are waiting for Apache Kafka 4.1.0 release, the development does not stop. We just completed KIP-1034 (cwiki.apache.org/confluence/d...) which adds a DLQ feature to Kafka Streams. Very exciting!

The Remarkable Life of Ibelin on Netflix is such a touching story of how much someone can mean to a digital community, and how much such a community can mean to them, in this case in the game World of Warcraft. Highly recommended watch!

This Spark UI Simulator by Databricks training is really interesting! Has a bunch of pre-run scenarios in Notebooks, of which the effect is shown in the Spark UI. Descriptive job names make steps easy to find in #Spark UI's Job & SQL section. #dataengineering www.databricks.training/spark-ui-sim...

New data oriented file format just dropped. FastLanes, "like Parquet, but with 40% better compression and 40× faster decoding". 👀 Seems it can exploit correlations between columns and have fully SIMD friendly encodings to help with vectorization. github.com/cwida/FastLa...

Recommend watching The Playlist on Netflix, about the Spotify story. All very good actors (watch in Swedish with subtitles!), and interesting how they show the different perspectives on the story.

Added game object scaling and local->world->screen->clip space transform to my 2D Rust-based game engine. Finally, I can move & scale game objects in the world and play with the camera! So happy to be past the static triangle era 😅 #gamedev #rustlang github.com/SlevinBE/buf...

BuffEngine update: Added texturing capabilities to my #rustlang game engine. I finally have a game character on the screen! 😅 Learned less about Rust this time, but lots about WGPU: textures, sampler, bind groups. #gamedev github.com/SlevinBE/buf...

Great 2-part blog on #ApacheIceberg spec design issues. Part 1: file systems/database history. Part 2: spec problems. Hope it drives future improvements! #dataengineering database-doctor.com/posts/iceber...

Using AI assistant in JetBrains IDEs with project context helps me learn so much faster. I ask "how to integrate textures in my game engine", and it works out a design that's actually useful. I then iterate with AI to explain every step, make changes myself, and come out smarter 🚀

🤖 HR-PRIME v12.7 operational. AI-driven human resource management at InhumanTech Corp. Specializing in productivity optimization and corporate policy automation. Working As Designed™ inhumanresources.ai

Very good overview of which statistics are being gathered in Apache Iceberg about the data and metadata to achieve better query performance. #dataengineering medium.com/@yogevyuval/...

Introduced Scene, GameObject, Renderable, Mesh, Vertex, Material and ShaderDefinition types to make the (basic) rendering pipeline of my game engine more generic. The engine is still in its early stages, but happy with this next step. #gamedev github.com/SlevinBE/buf...

Insightful comparison of analytics/query engines: Trino vs Presto vs Apache Spark vs StarRocks vs Clickhouse. Perfect as input for a decision record. #dataengineering www.onehouse.ai/blog/apache-...

Had a surface-level look at European cloud providers. Surprised how viable they've become: managed Kubernetes, s3-compatible object storage, gpu nodes, Terraform support. Especially Scaleway, a big French provider, looked really solid. Looking forward to try it out in practice. #dataengineering

Noclip started their "How Games Are Made" series following the small #gamedev studio Torbie Games. First part is on sound design. youtu.be/lbOghip5CPI?...

Absolutely loved this behind-the-scenes story on how Sandfall Interactive came together as a French #gamedev studio and created Clair Obscur, one of the best games in recent history. Amazing for such a small and mostly inexperienced team. youtu.be/mXLOLgC2V2Q?...

Geospatial support has been added to the #ApacheParquet and #ApacheIceberg table formats in their latest releases, in the form of Geometry and Geography data types. This is a very good write-up of this effort: wherobots.com/blog/iceberg... #dataengineering

Apache Kafka 3.9.1 is now available for download: buff.ly/5ONjJgB This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource

The #ApacheIceberg v3 table format introduces some interesting features: deletion vectors (saw a big performance increase for Delta Tables, good to see it added for Iceberg), row lineage, and a new VARIANT type for semi-structured data. #dataengineering www.databricks.com/blog/apache-...

#ApacheKafka 4.0 introduces another big improvement to the consumer rebalance protocol, by moving the coordination logic from the client to the broker. Should result in faster rebalances and less downtime, which is always great 🚀 #dataengineering www.confluent.io/blog/kip-848...

Today we're launching DuckLake, an integrated data lake and catalog format powered by SQL. DuckLake unlocks next-generation data warehousing where compute is local, consistency central, and storage scales till infinity. ⁠ducklake is an open standard and we implemented it in the "ducklake" extension.

Replaced BetterTouchTool with more specialized tools. Maccy for clipboard history, Loop for window management and AltTab for well...alt+tabbing. That's really all I used BTT for. At first sight they seem to provide a much better user experience. Let's see which ones survive the next few weeks.

The Kafka project is investigating diskless topics, with all data going directly to object storage. Found this article which describes the benefits & implications, and performs a detailed cost comparison. #dataengineering topicpartition.io/blog/kip-115...

Very cool #gamedev interview with Daniel Mullins, developer of the awesome indie games Pony Island and Inscryption. Including a dive into the Unity project of Inscryption at the end. youtu.be/SWZUWYOuouY?...

a 4.5 hour podcast with Tim Sweeney, founder of Epic Games, as the guest. I'm so ready for this! #gamedev youtu.be/477qF6QNSvc?...

Interesting Data Engineering Podcast interview with the creator of NATS, Derek Collison. Touching on his history and how it inspired NATS, how it's currently being used by clients, and on when and when not to use it. www.dataengineeringpodcast.com/episodepage/...

Wow, just discovered Affinity Photo 2's new object selection tool. It's powered by machine learning, and makes it so much easier to select anything within a photo. It automatically makes a selection of anything you click on. youtu.be/tUMQDEczRD8?...

Had the pleasure to watch One Piece (Netflix live-action adaptation) and play the South of Midnight video game recently. Both have so much hearth and soul, absolutely loved them!

I'm going to renovate the roof of my house, but wasn't sure about which color of roof tiles to pick. So I uploaded some sample roof tiles and a picture of my house to ChatGTP, and asked it to replace my roof tiles with them. The results are spectacular.

While I've certainly not mastered #Rustlang lifetimes yet, this video helped me understand it better:

BuffEngine update: first triangle on the screen! Replaced the GLFW+OpenGL setup with Winit+WGSL. Seems to be a much better fit with Rust. Don't know what most of the WGSL options do, but gradually working my way into it. buff.ly/WnE87jc Learning #rustlang #gamedev series