The Streaming Otter
@thestreamingotter.bsky.social
๐ค 113
๐ฅ 142
๐ 20
The unoffical Apache Kafka Streams account. Long live the otter.
reposted by
The Streaming Otter
Yennick Trevels
27 days ago
๐ Announcing the Kafka Streams Field Guide! Iโm writing a book with 8 insights for running Kafka Streams in production. Join the waiting list at
kafkastreamsfieldguide.com
and get 2 free chapters!
#ApacheKafka
loading . . .
Kafka Streams Field Guide | Kafka Streams Field Guide Book
https://kafkastreamsfieldguide.com
1
1
1
taogang.medium.com/the-past-and...
loading . . .
The Past and Present of Stream Processing (Part 13): Kafka StreamsโโโA Lean and Agile Kingโs Army
Introduction
https://taogang.medium.com/the-past-and-present-of-stream-processing-part-13-kafka-streams-a-lean-and-agile-kings-army-f2f310437f1b
12 days ago
0
3
4
reposted by
The Streaming Otter
Matthias J. Sax
13 days ago
Happy to share, that we did release an update to our
@kafkastreams.bsky.social
UI in
#ConfluentCloud
. We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics. Check it out and let us know what you think!
www.confluent.io/blog/monitor...
loading . . .
Monitor Kafka Streams Health in Confluent Cloud
Quickly troubleshoot Kafka Streams apps with new health metrics in Confluent Cloud. Spot bottlenecks, monitor RocksDB, and reduce MTTRโno extra code.
https://www.confluent.io/blog/monitor-kafka-streams-health-metrics/
0
4
5
reposted by
The Streaming Otter
Kafka Streams
14 days ago
We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes! Thanks to 53 contributors and your RM Christo Lolov. For more details, checkout the announcement:
kafka.apache.org/blog#apache_...
loading . . .
Apache Kafka
Apache Kafka: A Distributed Streaming Platform.
https://kafka.apache.org/blog#apache_kafka_401_release_announcement
0
5
4
Oh-oh!
add a skeleton here at some point
20 days ago
0
0
0
reposted by
The Streaming Otter
Kafka Streams
28 days ago
Any KIP-1071 experience out there? Asking for a friend.
0
2
3
reposted by
The Streaming Otter
Restate
26 days ago
๐ Yesterday, we announced that ๐ฅ๐ฒ๐๐๐ฎ๐๐ฒ ๐๐น๐ผ๐๐ฑ is now publicly available. Today, weโre announcing ๐ฅ๐ฒ๐๐๐ฎ๐๐ฒ ๐ญ.๐ฑ! This release brings key features for building, controlling and observing your durable agents and workflows.
1
7
3
reposted by
The Streaming Otter
Matthias J. Sax
about 2 months ago
The
#ApacheKafka
Java clients and
#KafkaStreams
engineering team at
@confluent.io
keeps growing. Very excited to welcome
@okaberintaroubeta.bsky.social
, Genseric Ghiro, and
@nikitashupletsov.bsky.social
! We also have one more entry level position in Toronto ๐จ๐ฆ
careers.confluent.io/jobs/job/67c...
loading . . .
https://careers.confluent.io/jobs/job/67c15e3b-7d49-440e-9e33-8d04725e805d
0
2
2
๐ข
www.responsive.dev/ks-archive
loading . . .
Responsive | Kafka Streams Vault
We're no longer actively developing or maintaining our Kafka Streams content. Visit our GitHub repository for archived blog content.
https://www.responsive.dev/ks-archive
about 2 months ago
0
3
1
reposted by
The Streaming Otter
Kafka Streams
about 2 months ago
Apache Kafka 4.1.0 was release! Most exciting, the new โstreamsโ rebalance protocol is available as early access. We are happy to announce the Apache Kafka 4.1.0 release! Please try it out, and let us know how it goes!
kafka.apache.org/blog#apache_...
loading . . .
Apache Kafka
Apache Kafka: A Distributed Streaming Platform.
https://kafka.apache.org/blog#apache_kafka_410_release_announcement
0
5
5
reposted by
The Streaming Otter
Kafka Streams
3 months ago
While we are waiting for Apache Kafka 4.1.0 release, the development does not stop. We just completed KIP-1034 (
cwiki.apache.org/confluence/d...
) which adds a DLQ feature to Kafka Streams. Very exciting!
loading . . .
https://cwiki.apache.org/confluence/disโฆ
0
3
4
reposted by
The Streaming Otter
Apache Software Foundation (The ASF)
4 months ago
The schedule is now available for Community Over Code North America, and early bird registration ends June 28. We hope you'll join the ASF community in Minneapolis Sept 11-14!
buff.ly/4b8kciW
#CommunityOverCode
#opensource
0
4
2
reposted by
The Streaming Otter
Chris
4 months ago
Insane amount of SlateDB work going on: - snapshot reads - split/merge DBs (zero copy) - deterministic simulation testing And someone just pushed Python bindings in a PR! ๐คฏ
0
9
3
reposted by
The Streaming Otter
Apache Software Foundation (The ASF)
5 months ago
Apache Kafka 3.9.1 is now available for download:
buff.ly/5ONjJgB
This bug-fix release has several fixes, and most importantly, it adds Java 23 support.
#opensource
0
8
6
reposted by
The Streaming Otter
Tom Cooper
5 months ago
Next at
#Current25
a panel discussion on the past, present and future of
@kafkastreams.bsky.social
. I love the background...the likeness is uncanny...
0
6
2
reposted by
The Streaming Otter
Matthias J. Sax
6 months ago
New blog post alert! My colleague Alieh Saeedi digs into the guts of manual consumer offset commits, and the improvements of KIP-1094 (AK 4.0) about it. Outstanding work! Enjoy the read and change your code. You most likely do it wrong right now!
www.confluent.io/blog/guide-t...
loading . . .
Kafka Consumer Offsets GuideโBasic Principles, Insights & Enhancements
Learn how to achieve data consistency and reliability with a complete Apache Kafka consumer offsets guide covering key principles, offset management, and KIP-1094 innovations.
https://www.confluent.io/blog/guide-to-consumer-offsets/
0
3
2
reposted by
The Streaming Otter
Chris
6 months ago
Today marks SlateDBโs one year anniversary! Itโs been a lot of fun. Thanks to
@rohanpd.bsky.social
@flaneur2024.bsky.social
@almog.ai
@vigneshc.bsky.social
@paulbutler.org
Jason Gustafson, David Moravek, and many others for joining the project. ๐
loading . . .
SlateDB - An embedded storage engine built on object storage | SlateDB
Description will go into a meta tag in <head />
https://SlateDB.io
0
16
6
reposted by
The Streaming Otter
Matthias J. Sax
6 months ago
We are having two more (early career) open positions in our team, Java clients &
#KafkaStreams
(๐จ๐ฆ). If working on distributed data systems and stream processing sounds interesting to you, please apply:
careers.confluent.io/jobs/1518441...
We have also not closed the other two positions yet:
add a skeleton here at some point
0
8
3
reposted by
The Streaming Otter
Neil Buesing
6 months ago
Looking forward to
@sharatchander.bsky.social
's Keynote. Then, looking forward to hearing
@gamussa.dev
talking about Kafka and the Schema Registry, and then more! Java, Kafka,
@kafkastreams.bsky.social
, &
@intellijidea.com
- that's my tech stack!
lp.jetbrains.com/intellij-ide...
@jetbrains.com
loading . . .
IntelliJ IDEA Conf 2025 | June 3-4, 2025
We invite you to join us for IntelliJ IDEA Conf 2025 and gain insights from industry leaders and experts.
https://lp.jetbrains.com/intellij-idea-conf-2025/
0
5
2
reposted by
The Streaming Otter
Kafka Streams
7 months ago
Apache Kafka 4.0 was released recently. We got a couple of a cool KIPs shipped. KIP-1065:
cwiki.apache.org/confluence/p...
The ProductionExceptionHandler becomes more flexible. Itโs now also called for retriable errors. This allows you to break (previously infinite) retry loops. \1
loading . . .
https://cwiki.apache.org/confluence/pagโฆ
1
1
2
Interesting.
www.kafkastreams.money
loading . . .
Kafka Streams Cost Calculator | Estimate Your Kafka Streams Application Costs
Free tool to analyze and estimate the costs of running Kafka Streams applications. Calculate compute, storage, and operational costs for your Kafka Streams deployment.
https://www.kafkastreams.money/
7 months ago
1
5
1
reposted by
The Streaming Otter
Matthias J. Sax
7 months ago
We have two open (early career) engineering positions in our team (Canada ๐จ๐ฆ) If you are excited about contributing to
#ApacheKafka
with a focus on Java client and
@kafkastreams.bsky.social
this might be the right fit for you
careers.confluent.io/jobs/1581205...
careers.confluent.io/jobs/1580808...
0
9
7
reposted by
The Streaming Otter
Marie-Laure Momplot
7 months ago
Thrilled to announce that I'll be bringing my 'charming French accent' to
#Current25
London to present my talk: 'Massive Kafka Streams Topology Revamp in Production: No Chaos, No Headaches! My Key Takeaways ๐ฆพ'. Canโt wait to share the lessons learned!
#kafka
#eda
#kafkaStreams
#kstreamplify
1
7
2
reposted by
The Streaming Otter
Sรฉbastien Viale
7 months ago
First time at
#Current2025
, and Iโm incredibly lucky to have been selected as a speaker for two talks! ๐น Optimizing Kafka Streams Joins, with
@adamsouquieres.bsky.social
๐น Exception Handling & DLQ in Kafka Streams โ A deep dive into KIP-1033 & KIP-1034 Canโt wait to meet the
#Kafka
community!
1
6
3
reposted by
The Streaming Otter
Matthias J. Sax
7 months ago
Drum roll... ๐ฅ We released our Confluent Cloud UI for
#KafkaStreams
Instead of only seeing the internal consumer/producer clients in the "Clients" view, you now get a list of all your running
#KafkaStreams
applications, plus some basic statistics. --Long live the otter. ๐ฆฆ
1
2
1
reposted by
The Streaming Otter
Apache Kafka News
7 months ago
Apache Kafka 4.0.0 is released. Check out the release notes here:
dlcdn.apache.org/kafka/4.0.0/...
loading . . .
Below is a summary of the JIRA issues addressed in the 4.0.0 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.
https://dlcdn.apache.org/kafka/4.0.0/RELEASE_NOTES.html
0
8
6
reposted by
The Streaming Otter
Neil Buesing
8 months ago
@intellijidea.com
's IDE has a great Apache Kafka plugin. This is a
@kafkastreams.bsky.social
's session window changelog topic -- maybe I can figure out how to get support natively for Kafka Stream windowing keys.
1
8
3
reposted by
The Streaming Otter
Apurva Mehta
8 months ago
This week, our 101 series has
@ableegoldman.bsky.social
diving deep into the world of performance optimization for Kafka Streams. This isn't just theory: she shows how we realized 10x throughput improvements by implementing these techniques in prod!
www.responsive.dev/blog/perform...
loading . . .
Kafka Streams 101: Optimizing your apps for maximum performance
Learn the concepts, configs, and application design strategies to get your Kafka Streams apps running as optimally as possible.
https://www.responsive.dev/blog/performance-optimization-kafka-streams-101
0
6
3
reposted by
The Streaming Otter
Sophie Blee-Goldman
8 months ago
Next entry in the Kafka Streams 101 series: application lifecycle. Very beginner friendly, but even the pros might find a useful tip or two -- for example: have you heard of the new standby task listener? Check it out:
www.responsive.dev/blog/app-lif...
loading . . .
Kafka Streams 101: Application Lifecycle
Learn how to properly start, stop, and manage the lifecycle of Kafka Streams
https://www.responsive.dev/blog/app-lifecycle-kafka-streams-101
0
9
5
reposted by
The Streaming Otter
Sophie Blee-Goldman
9 months ago
The 2025 blog post series has begun and we're kicking things off with the "official" Kafka Streams upgrade-guide -- check it out for best practices when setting up a new app, rules for safe vs unsafe upgrades, and tips for making the process go smoothly:
www.responsive.dev/blog/topolog...
loading . . .
Kafka Streams 101: Topology Upgrades
A Kafka Streams 101 lesson to learn how to identify unsafe changes to a topology and the techniques to mitigate them
https://www.responsive.dev/blog/topology-upgrades-kafka-streams-101
1
5
2
reposted by
The Streaming Otter
Sophie Blee-Goldman
8 months ago
We're keeping the ball rolling on the Kafka Streams 101 series with yet another blog post! This time the focus is on configuration, and breaking down the most important configs to focus on for various needs (such as correctness, resiliency, etc) Check it out here:
www.responsive.dev/blog/importa...
loading . . .
Kafka Streams 101: The Most Important Configs
Learn which configurations are most critical for a reliable and efficient deployment
https://www.responsive.dev/blog/important-configs-kafka-streams-101
0
8
6
reposted by
The Streaming Otter
Matthias J. Sax
9 months ago
#StreamProcessing
with
@kafkastreams.bsky.social
0
15
4
reposted by
The Streaming Otter
Matthias J. Sax
9 months ago
๐ฎ๐ณ Current 2025 ๐ฎ๐ณ Bengaluru, here I come. My talk "One Client to Rule them all" was accepted. Hope to see you there.
#KafkaSummit
#Current2025
1
8
3
reposted by
The Streaming Otter
Matthias J. Sax
9 months ago
Uffโฆ hard to digest this allโฆ Bottom line: both infinite and unbounded are wrong ๐
1
1
1
reposted by
The Streaming Otter
Apurva Mehta
9 months ago
This will be the foundation for being able to branch
@kafkastreams.bsky.social
apps to support seamless blue/green deploys. It also allows you to branch a previous version of the state to debug an issue from the past. Powerful stuff coming to the world of stream processing!
add a skeleton here at some point
1
13
4
reposted by
The Streaming Otter
ScyllaDB
9 months ago
How did Responsive simplify its architecture and achieve monstrously high availability with unlimited scale potential? Co-founder
@almog.ai
will share how replacing RocksDB with
#ScyllaDB
in
#Kafka
Streams led to big wins for their team at Monster Scale Summit.
www.scylladb.com/monster-scal...
0
8
4
reposted by
The Streaming Otter
Apurva Mehta
9 months ago
(2/2) And Kafka Streams EXTENDS Kafka and itself is modular and thus EXTENSIBLE. So it can run self-contained on your laptop and yet scale to 100k+ events/s on 100's of TBS of state WITHOUT having to change anything application code. Super bullish about its future given these trends.
0
5
1
reposted by
The Streaming Otter
Almog
9 months ago
Kafka Streams 101: Windows & Time! ๐ฐ๏ธ What's the difference between event, stream and wall clock time? ๐ช What are the four different types of windows? โ๏ธ What are the important error messages and metrics, and what do they mean? ๐ Read the full lesson here:
www.responsive.dev/blog/windows...
0
8
5
reposted by
The Streaming Otter
Almog
9 months ago
Kicking the tires on animated explanations of windowing strategies in Kafka Streams. Would love feedback on if this animation for session windows resonates: they keep growing until there is an 'inactivity gap' (no events for the key). This here shows a session window with inactivity gap of 10.
loading . . .
1
6
1
reposted by
The Streaming Otter
Sophie Blee-Goldman
10 months ago
[1/5] Hey fellow Kafka Streams otters! You may have already seen my previous blog posts such as the "Debugging Rebalances" and "EOS guide" from last year (and if you haven't, go check them out! Links in thread) But now it's 2025, and time for me to think about what to write next...
1
8
3
reposted by
The Streaming Otter
SoCal Leslie
10 months ago
I took this shot of a Sea otter chilling out in Morro Bay. You can see one of his big rear flippers sticking out. To see them is to love them.๐ฟ๐ฆฆ๐ฆ
9
362
36
reposted by
The Streaming Otter
Matthias J. Sax
10 months ago
Another holiday ๐ delivered. We completed
issues.apache.org/jira/browse/...
to remove all deprecated
#KafkaStreams
APIs for the upcoming
#ApacheKafka
4.0 release! It was an outstanding community effort and huge win! We merged 36 PRs from 14 different contributors, removing 13K LOC. \1
loading . . .
[KAFKA-16332] Remove Deprecated builder methods for Time/Session/Join/SlidingWindows - ASF JIRA
https://issues.apache.org/jira/browse/KAFKA-16332
1
15
4
reposted by
The Streaming Otter
Kafka Streams
10 months ago
Kafka Streams has officially come to Bluesky! Follow this account for updates on everything Kafka Streams and keep up to date with new features, bug fixes, and upcoming KIPs. Long live the otter!
1
16
9
Thanks for the call-out! Are we a (un)official tag-team now?
add a skeleton here at some point
10 months ago
0
1
0
reposted by
The Streaming Otter
Almog
10 months ago
Kafka Streams: 25 improvements in time for 2025! Big wins in performance (KIP-925: Rack Aware Assignment), customization (KIP-924: Custom Task Assignment, KIP-954: Custom Storage) and monitoring (KIP-1091: thread state metrics) - just to name a few. See them all:
www.responsive.dev/blog/kafka-s...
loading . . .
Kafka Streams Wrapped: 2024 in review
Kafka Streams had some tremendous additions and improvements in 2024. Here are the highlights.
https://www.responsive.dev/blog/kafka-streams-2024-year-in-review
0
4
1
reposted by
The Streaming Otter
Apurva Mehta
10 months ago
Kafka Streams had an amazing 2024! Check out
@ableegoldman.bsky.social
's year in review, where she recaps the 25 major improvements the community made to Kafka Streams!
www.responsive.dev/blog/kafka-s...
loading . . .
Kafka Streams Wrapped: 2024 in review
Kafka Streams had some tremendous additions and improvements in 2024. Here are the highlights.
https://www.responsive.dev/blog/kafka-streams-2024-year-in-review
0
12
3
reposted by
The Streaming Otter
Viktor Gamov
10 months ago
๐ A friendly reminder, you can choose favorite Christmas movie using Kafka Streams, Spring Boot, Kubernetes and Confluent
www.youtube.com/live/ampmQg3...
P.s. Die Hard and Lethal Weapon are Christmas movies
0
3
1
12 KIPs for
#KafkaStreams
in upcoming Kafka 4.0 release!
add a skeleton here at some point
10 months ago
0
3
0
Important bug-fixes for
#KafkaStreams
โฆ
add a skeleton here at some point
10 months ago
0
1
0
reposted by
The Streaming Otter
Bruno Cadonna
11 months ago
๐ฅณ KIP-1071 was accepted by the Apache Kafka community! ๐ฅณ Exciting!
bsky.app/profile/brun...
add a skeleton here at some point
0
13
3
Load more
feeds!
log in