Igfasouza
@igfasouza.bsky.social
📤 31
📥 45
📝 601
Software Engineer in a Data Engineer team 🇧🇷🇮🇪 Views are my own •Java •Kafka •Raspberry PI •Maker
How Modern Applications Handle Millions of Events: Inside Apache Kafka
#apachekafka
medium.com/@muskangarg1...
loading . . .
How Modern Applications Handle Millions of Events: Inside Apache Kafka
Every time you place an order online, watch a video, or make a payment, multiple systems react almost instantly behind the scenes.
https://medium.com/@muskangarg1108/how-modern-applications-handle-millions-of-events-inside-apache-kafka-8cb1961dd694
4 minutes ago
0
0
0
From Virtual Threads to Kafka: How a Simple ID Generator Failed at Scale (and What Fixed It)
#apachekafka
medium.com/@ashishg0926...
loading . . .
From Virtual Threads to Kafka: How a Simple ID Generator Failed at Scale (and What Fixed It)
A real-world lesson in how system evolution can expose hidden flaws in design.
https://medium.com/@ashishg0926/from-virtual-threads-to-kafka-how-a-simple-id-generator-failed-at-scale-and-what-fixed-it-801a12c64f97?postPublishedType=initial
about 23 hours ago
0
0
0
in 2026 kafka is no longer a system, it's a protocol
#apachekafka
m.youtube.com/watch?v=CVM7...
loading . . .
in 2026 kafka is no longer a system, it's a protocol
YouTube video by Stanislav Kozlovski
https://m.youtube.com/watch?v=CVM7ilVmrRw
2 days ago
0
0
0
Queues for Kafka (KIP-932): The Bridge between Event Streaming and Queuing
#apachekafka
medium.com/@BitrockIT/q...
loading . . .
Queues for Kafka (KIP-932): The Bridge between Event Streaming and Queuing
For years, architects and developers have adopted Apache Kafka as the standard for event streaming and distributed logs, yet continued to…
https://medium.com/@BitrockIT/queues-for-kafka-kip-932-the-bridge-between-event-streaming-and-queuing-0168d18a5324
3 days ago
0
0
0
Kafka Beyond APIs: 30 Architecture Questions I've Seen Matter in Real Systems
#apachekafka
freedium-mirror.cfd/https://code...
4 days ago
0
0
0
Look Ma, I made a JAR! (Building a connector for Kafka Connect without knowing Java)
#apachekafka
rmoff.net/2026/03/27/l...
loading . . .
Look Ma, I made a JAR! (Building a connector for Kafka Connect without knowing Java)
https://rmoff.net/2026/03/27/look-ma-i-made-a-jar-building-a-connector-for-kafka-connect-without-knowing-java/
5 days ago
0
0
0
Kafka Backlog #1
#apachekafka
open.substack.com/pub/topicigo...
loading . . .
Kafka Backlog #1
Welcome to the first edition of Kafka Backlog, a monthly series here on Topic:Igor where I share articles and pieces I find valuable but never manage to tweet.
https://open.substack.com/pub/topicigor/p/kafka-backlog-1
6 days ago
0
1
0
Kafka Ecosystem Project Ideas: End-to-End Domain Implementations guide
#apachekafka
freedium-mirror.cfd/https://code...
7 days ago
0
0
0
What the IBM Confluent acquisition means for Kafka users
#apachekafka
factorhouse.io/articles/wha...
loading . . .
What the IBM Confluent acquisition means for Kafka users | Factor House
IBM's $11B Confluent acquisition raises questions for Kafka users. Assess your lock-in risk across Schema Registry, managed connectors, and operational tooling.
https://factorhouse.io/articles/what-the-ibm-confluent-acquisition-means-for-kafka-users
8 days ago
0
0
0
Deep Dive into Kafka Offset Commit with Spring Boot
#apachekafka
piotrminkowski.com/2026/03/27/d...
loading . . .
Deep Dive into Kafka Offset Commit with Spring Boot - Piotr's TechBlog
This article uses straightforward Spring Boot examples to illustrate how your application can inadvertently lose messages or process them twice due to the Kafka offset commit mechanism. It builds upon...
https://piotrminkowski.com/2026/03/27/deep-dive-into-kafka-offset-commit-with-spring-boot/
9 days ago
0
0
0
Outbox Pattern with Kafka and Hexagonal Architecture in Spring Boot
#apachekafka
dev.to/allan_robert...
loading . . .
Outbox Pattern with Kafka and Hexagonal Architecture in Spring Boot
When building microservices, one of the most common consistency problems is this: what happens if...
https://dev.to/allan_roberto_3c86dab9d94/outbox-pattern-with-kafka-and-hexagonal-architecture-in-spring-boot-320d
10 days ago
0
0
0
A very nice tool from Tom Cooper for tracking KIPs and FLIPs.
#apachekafka
#apacheflink
ossip.dev
11 days ago
0
0
0
How to process JSON data in a Kafka Connect pipeline, and explain the schema format that Kafka uses to describe JSON events.
#apachekafka
dalelane.co.uk/blog/?p=5857
loading . . .
Processing JSON with Kafka Connect
In this post, I'll share examples of how to process JSON data in a Kafka Connect pipeline, and explain the schema format that Kafka uses to describe JSON events. Using sink connectors Kafka Connect...
https://dalelane.co.uk/blog/?p=5857
12 days ago
0
0
0
Say Goodbye to ZooKeeper
#apachekafka
aiven.io/blog/say-goo...
loading . . .
Say Goodbye to ZooKeeper
Automated, Zero-Downtime KRaft Migrations Now Available on Aiven
https://aiven.io/blog/say-goodbye-to-zookeeper
13 days ago
0
0
0
Spring for Apache Kafka 4.1.0-M2, 4.0.4, and 3.3.14 Available
#apachekafka
spring.io/blog/2026/03...
loading . . .
Spring for Apache Kafka 4.1.0-M2, 4.0.4, and 3.3.14 Available
Level up your Java code and explore what Spring can do for you.
https://spring.io/blog/2026/03/17/spring-kafka-4
14 days ago
0
0
0
Kafka Isn’t a Database, But We Gave It a Query Engine Anyway
#apachekafka
www.warpstream.com/blog/warpstr...
loading . . .
Kafka Isn’t a Database, But We Gave It a Query Engine Anyway
With WarpStream Events, there is no more wrangling multiple tools. Get built-in observability without any additional infrastructure.
https://www.warpstream.com/blog/warpstream-events-built-in-observability-powered-by-kafka
15 days ago
0
0
0
Automate test and failure analysis via streams for Apache Kafka
#apachekafka
developers.redhat.com/articles/202...
loading . . .
Automate test and failure analysis via streams for Apache Kafka | Red Hat Developer
Explore an automated, event-driven solution using streams for Apache Kafka, Debezium CDC, and Quarkus with SmallRye Reactive Messaging to sync failure analysis
https://developers.redhat.com/articles/2026/03/19/automate-test-and-failure-analysis-streams-apache-kafka#
16 days ago
0
0
0
IBM Completes Acquisition of Confluent, Making Real Time Data the Engine of Enterprise AI and Agents
#apachekafka
newsroom.ibm.com/2026-03-17-i...
loading . . .
IBM Completes Acquisition of Confluent, Making Real Time Data the Engine of Enterprise AI and Agents
IBM and Confluent deliver a smart data platform that gives every AI model, agent, and automated workflow the real-time, trusted data needed to operate across on-premises and hybrid cloud environments ...
https://newsroom.ibm.com/2026-03-17-ibm-completes-acquisition-of-confluent,-making-real-time-data-the-engine-of-enterprise-ai-and-agents
17 days ago
0
1
0
How to Set Up a Kafka Cluster with KRaft Architecture (Step-by-Step)
#apachekafka
dataverses.io/resources/bl...
loading . . .
How to Set Up a Kafka Cluster with KRaft Architecture (Step-by-Step)
ZooKeeper is deprecated and on its way out. Learn how to spin up a 3-node Kafka KRaft cluster using Docker Compose — no Java installs, no systemd units, no external dependencies.
https://dataverses.io/resources/blog/setting-up-kafka-cluster-with-kraft
18 days ago
0
0
0
Dead Letter Topic #01
#apachekafka
Interesting resources from the broader event streaming and real-time data ecosystem.
topicigor.substack.com/p/dead-lette...
loading . . .
Dead Letter Topic #01
Story Horse?
https://topicigor.substack.com/p/dead-letter-topic-01
19 days ago
0
0
0
Kafka, Disk, Tiered Storage — and the Rise of Diskless Streaming
#apachekafka
medium.com/@abhaysoni.d...
loading . . .
Kafka, Disk, Tiered Storage — and the Rise of Diskless Streaming Architectures
Understanding Kafka’s evolution beyond its original architecture
https://medium.com/@abhaysoni.developer/kafka-disk-tiered-storage-and-the-rise-of-diskless-streaming-architectures-8fffcf9462bc
20 days ago
0
0
0
Kafka vs Flink vs Spark Streaming: What Nobody Tells You Before You Pick One
#apachekafka
#apacheflink
#apachespark
alper-korukcu.medium.com/kafka-vs-fli...
loading . . .
Kafka vs Flink vs Spark Streaming: What Nobody Tells You Before You Pick One
You’re comparing three things that aren’t the same thing. That’s the first problem. Kafka is a messaging backbone. Flink is a stream…
https://alper-korukcu.medium.com/kafka-vs-flink-vs-spark-streaming-what-nobody-tells-you-before-you-pick-one-aa83c26a287a
21 days ago
0
0
0
From Batch to Real‑Time: Mastering Event‑Driven Architectures with Apache Kafka
#apachekafka
martinuke0.github.io/posts/2026-0...
loading . . .
From Batch to Real‑Time: Mastering Event‑Driven Architectures with Apache Kafka
Introduction For decades, enterprises have relied on batch jobs to move, transform, and analyze data. Nightly ETL pipelines, scheduled reports, and periodic data warehouses have been the backbone of d...
https://martinuke0.github.io/posts/2026-03-12-from-batch-to-realtime-mastering-eventdriven-architectures-with-apache-kafka/
22 days ago
0
0
0
Visual Guide to Apache Kafka Diskless Topics & Cloud Costs
#apachekafka
www.instaclustr.com/blog/visual-...
loading . . .
Visual Guide to Apache Kafka Diskless Topics & Cloud Costs
Explore the new Apache Kafka Diskless Topics proposal. Learn about the architecture and how it reduces cloud costs by eliminating cross-AZ traffic.
https://www.instaclustr.com/blog/visual-guide-to-apache-kafka-diskless-topics-cloud-costs/
23 days ago
0
0
0
Happy
#piday
!!! Estimating Pi with Kafka Streams
#apachekafka
fredrikmeyer.net/2024/05/06/e...
24 days ago
0
1
0
⚠️ Warning: Friday the 13th detected! Avoid deploying to production… or running your code without coffee ☕️ A little Java 25 script to see if today is cursed:
#DevHumor
#Java25
#FridayThe13th
25 days ago
0
0
0
Announcing Inkless clusters: Cloud Kafka done right
#apachekafka
aiven.io/blog/announc...
loading . . .
Announcing Inkless clusters: Cloud Kafka Done Right | Aiven
Boost Kafka performance with Inkless clusters. Experience 90% faster recovery, 10x faster scaling, and diskless topics for infinite, low-latency data streaming.
https://aiven.io/blog/announcing-inkless-clusters-cloud-kafka-done-right
25 days ago
0
0
1
KPipe: A Modern, High-Performance Kafka Consumer in Java — Powered by Java 25 Features
#apachekafka
open.substack.com/pub/topicigo...
loading . . .
KPipe: A Modern, High-Performance Kafka Consumer in Java — Powered by Java 25 Features
Howdy! If you’re building Kafka-based systems in Java and dealing with high-throughput pipelines, you’ve probably faced the usual pain points:Thanks for reading!
https://open.substack.com/pub/topicigor/p/kpipe-a-modern-high-performance-kafka
26 days ago
0
0
0
Event-Driven Architecture in Java and Kafka
#apachekafka
A nice walk through in an application using Reactive Java with MongoDB.
foojay.io/today/event-...
loading . . .
Event-Driven Architecture in Java and Kafka
Reactive Java is well suited to modern streaming, event driven applications. In this article, we'll walk through an example of such an application using Reactive Java with MongoDB. Specifically, we're...
https://foojay.io/today/event-driven-architecture-in-java-and-kafka/
27 days ago
0
0
0
How KIP-881 and KIP-392 reduce Inter-AZ Networking Costs in Classic Kafka
#apachekafka
getkafkanated.substack.com/p/how-kip-88...
loading . . .
How KIP-881 and KIP-392 reduce Inter-AZ Networking Costs in Classic Kafka
Data transfer costs are the killer behind your massive Kafka bills in the cloud. Learn how to slash 50% of them with little effort by either assigning partitions in a rack-aware wad or enabling FFF
https://getkafkanated.substack.com/p/how-kip-881-and-kip-392-reduce-inter
28 days ago
0
0
0
A modern, functional, and high-performance Kafka consumer built using Java 24 features like virtual threads, composable message processors, and DslJson for JSON processing.
#apachekafka
github.com/eschizoid/kp...
loading . . .
GitHub - eschizoid/kpipe
Contribute to eschizoid/kpipe development by creating an account on GitHub.
https://github.com/eschizoid/kpipe
29 days ago
0
0
0
Stop Gluing Scripts Together: Build a Real Java Workflow with Quarkus Flow, Kafka, and Ollama
#apachekafka
www.the-main-thread.com/p/quarkus-fl...
loading . . .
Stop Gluing Scripts Together: Build a Real Java Workflow with Quarkus Flow, Kafka, and Ollama
A complete, runnable Quarkus tutorial that ingests CloudEvents, calls a local LLM for sentiment, routes by policy, and pauses for human-in-the-loop approvals.
https://www.the-main-thread.com/p/quarkus-flow-ollama-kafka-cloudevents-java-workflow
30 days ago
0
0
0
I Taught Claude to Draw My Kafka Streams Topologies
#apachekafka
medium.com/@souquieres....
loading . . .
I Taught Claude to Draw My Kafka Streams Topologies
Notes from a Saturday afternoon spent wiring an LLM to Excalidraw.
https://medium.com/@souquieres.adam/i-taught-claude-to-draw-my-kafka-streams-topologies-f6cddd13be66
about 1 month ago
0
0
0
The 5 Ways to Move Data Iceberg -> Kafka
#apachekafka
blog.streambased.io/p/the-5-ways...
loading . . .
The 5 Ways to Move Data Iceberg -> Kafka
An in-depth comparison of today's solutions to the expanding Iceberg to Kafka market.
https://blog.streambased.io/p/the-5-ways-to-move-data-iceberg-kafka
about 1 month ago
0
0
0
Queues for Kafka ready for prime time
#apachekafka
medium.com/@andrew_scho...
loading . . .
Queues for Kafka ready for prime time
Now that Apache Kafka 4.2.0 has been released, Queues for Kafka is ready for production use. I thought I’d take the opportunity to share…
https://medium.com/@andrew_schofield/queues-for-kafka-ready-for-prime-time-988f5c58b8f7
about 1 month ago
0
0
0
Kafka Deep Dive: Architecture, Internals, and Interview Guide
#apachekafka
medium.com/@ayushbhaime...
loading . . .
Kafka Deep Dive: Architecture, Internals, and Interview Guide
Who This Article Is For
https://medium.com/@ayushbhaimehta20002/kafka-deep-dive-architecture-internals-and-interview-guide-f192339d3f0e
about 1 month ago
0
0
0
How Is Kafka So Fast If It Writes to Disk?
#apachekafka
yasindudilshan.medium.com/how-is-kafka...
loading . . .
How Is Kafka So Fast If It Writes to Disk?
Most people think disks are slow. So how does Apache Kafka — a system that persists data to disk — handle millions of messages per second?
https://yasindudilshan.medium.com/how-is-kafka-so-fast-if-it-writes-to-disk-38c9a3c27eda
about 1 month ago
0
0
0
Managing JVM Option Settings for Kafka Tools
#apachekafka
www.javacodegeeks.com/managing-jvm...
loading . . .
Managing JVM Option Settings for Kafka Tools - Java Code Geeks
Learn how Kafka tools work better by setting memory, tuning JVM performance, and choosing the right options.
https://www.javacodegeeks.com/managing-jvm-option-settings-for-kafka-tools.html
about 1 month ago
0
0
0
Uforwarder: Uber’s Scalable Kafka Consumer Proxy for Efficient Event-Driven Microservices
#apachekafka
www.infoq.com/news/2026/02...
loading . . .
Uforwarder: Uber’s Scalable Kafka Consumer Proxy for Efficient Event-Driven Microservices
Uber has open-sourced uForwarder, a push-based Kafka consumer proxy built to handle trillions of messages and multiple petabytes of data daily. The system introduces context-aware routing, head-of-lin...
https://www.infoq.com/news/2026/02/uber-uforwarder-kafka-push-proxy/
about 1 month ago
0
0
0
Start with Apache Kafka Ebook
#apachekafka
softwaremill.com/ebooks/start...
loading . . .
Start with Apache Kafka - download ebook!
Are you ready to take your data streaming to the next level? Download Start with Apache Kafka ebook made by SoftwareMill engineers, a Confluent Preferred Partner.
https://softwaremill.com/ebooks/start-with-apache-kafka-ebook/
about 1 month ago
0
0
0
Kafka Metadata Fetching and Caching Demo
#apachekafka
This repo shows how a Kafka client discovers the full cluster and caches metadata even when it only bootstraps to a single broker.
github.com/ifnesi/kafka...
loading . . .
GitHub - ifnesi/kafka-metadata
Contribute to ifnesi/kafka-metadata development by creating an account on GitHub.
https://github.com/ifnesi/kafka-metadata
about 1 month ago
0
0
0
Kafka Connect setup and creation of custom SMT
#apachekafka
github.com/Gaurav0807/k...
loading . . .
GitHub - Gaurav0807/kafka-connect: Kafka Connect setup and creation of custom SMT
Kafka Connect setup and creation of custom SMT . Contribute to Gaurav0807/kafka-connect development by creating an account on GitHub.
https://github.com/Gaurav0807/kafka-connect
about 1 month ago
0
0
0
System Design Basics - Apache Kafka vs RabbitMQ vs ActiveMQ
#apachekafka
www.java67.com/2026/02/syst...
loading . . .
System Design Basics - Apache Kafka vs RabbitMQ vs ActiveMQ
Java Programming tutorials and Interview Questions, book and course recommendations from Udemy, Pluralsight, Coursera, edX etc
https://www.java67.com/2026/02/system-design-basics-apache-kafka-vs-rabbitmq-vs-activemq.html
about 1 month ago
0
0
0
Introducing uFowarder: The Consumer Proxy for Kafka Async Queuing
#apachekafka
www.uber.com/en-BR/blog/i...
loading . . .
Introducing uFowarder: The Consumer Proxy for Kafka Async Queuing
Uber processes trillions of Kafka messages per day on a push-based consumer proxy in real time. Read this blog to learn about the thinking behind open source uForwarder before applying it to your use cases.
https://www.uber.com/en-BR/blog/introducing-ufowarder/
about 1 month ago
0
0
0
Kafka- Zero to Hero
#apachekafka
youtube.com/playlist?lis...
about 1 month ago
0
0
0
Apache Kafka: The Definitive Guide
#apachekafka
cendyandreoli.com.br/posts/apache...
loading . . .
Cendy Andreoli - Blog & Tools para Desenvolvedores
Blog técnico e ferramentas para desenvolvedores. Artigos sobre arquitetura de software, performance, microsserviços e boas práticas.
https://cendyandreoli.com.br/posts/apache-kafka-o-guia-definitivo
about 1 month ago
0
0
0
An end-to-end data pipeline that orchestrates data ingestion, processing, and storage using Airflow, Python, Kafka, Zookeeper, Spark, and Cassandra.
#apachekafka
github.com/AbdullahEmad...
loading . . .
GitHub - AbdullahEmad22/realtime-data-engineering-project: An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka,...
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All comp...
https://github.com/AbdullahEmad22/realtime-data-engineering-project
about 1 month ago
0
0
0
Apache Kafka 4.2 | 38 KIPs, Kafka Streams, Observability Improvements, Rebalance Protocol, and more
#apachekafka
m.youtube.com/watch?v=4Yw1...
loading . . .
Apache Kafka 4.2 | 38 KIPs, Kafka Streams, Observability Improvements, Rebalance Protocol, and more
YouTube video by Confluent Developer
https://m.youtube.com/watch?v=4Yw1TzJe1Z8&pp=0gcJCUABo7VqN5tD
about 2 months ago
0
0
0
Apache Kafka 4.2.0 Release Announcement
#apachekafka
kafka.apache.org/blog/2026/01...
loading . . .
https://kafka.apache.org/blog/2026/01/14/apache-kafka-4.2.0-release-announcement/
about 2 months ago
0
0
0
FormPilot
#apachekafka
FormPilot is a comprehensive, microservices-based fitness application designed to handle user management, activity tracking, and AI-driven recommendations.
github.com/ManurangaJay...
loading . . .
GitHub - ManurangaJay/FormPilot: AI powered fitness application using Java, Spring Boot & React with microservices architecture
AI powered fitness application using Java, Spring Boot & React with microservices architecture - GitHub - ManurangaJay/FormPilot: AI powered fitness application using Java, Spring Boot & R...
https://github.com/ManurangaJay/FormPilot
about 2 months ago
0
0
0
Load more
feeds!
log in
