Latest updates for Apache Kafka

Fresh curated links around Apache Kafka are collected here so marketers can spot useful updates and turn timely ideas into posts faster.

Recent items include:

  • Kafka With Spring Boot: Introduction
  • How Kafka Works
  • Why Databricks and Snowflake Speak the Kafka Protocol: Ingestion vs Architecture

Post angles to try

Share the most useful takeaway for your audience.
Turn one article into a quick practical checklist.
Ask your audience how this shift affects their work.
Turn angles into scheduled posts

Fresh articles and ideas

Recent curated links from global sources. Generate one free draft from any story, then use SocialBu to schedule and refine your content calendar.

dzone.com /1 week ago

Kafka With Spring Boot: Introduction

Kafka is a distributed event streaming platform that enables real-time data ingestion, storage, and processing of continuous event streams. To do that, Kafka has a complex internal...

Read source
kodekloud.com /1 month ago

How Kafka Works

Learn how Kafka works and why every backend uses it: producers, consumers, topics, partitions and offsets explained with a checkout example.

Read source
dzone.com /3 weeks ago

Why Databricks and Snowflake Speak the Kafka Protocol: Ingestion vs Architecture

Kafka-compatible ingestion is showing up everywhere now, including in analytics platforms that have nothing to do with running Kafka. Databricks added Kafka-compatible APIs to its...

Read source
dzone.com /1 month ago

Dashboards and Queries for Apache Kafka

Dashboards are everywhere. Business and IT teams use them to track metrics, visualize trends, and make decisions. But when working with real-time data from Apache Kafka, it’s not o...

Read source
dev.to /3 weeks ago

Archivos PDF, ZIP y binarios viajando en Kafka con nombre intacto.

Archivos PDF, ZIP y binarios viajando en Kafka con nombre intacto. Día 07 de la serie técnica WKafka Open Source. No aprovisiones un bucket en la nube cuando lo único que nece...

Read source
dev.to /3 weeks ago

PDF, ZIP and binary files streaming over Kafka with names intact.

PDF, ZIP and binary files streaming over Kafka with names intact. Day 07 of the WKafka Open-Source Engineering Series. Don't provision a cloud bucket when all you need is send...

Read source
aws.amazon.com /3 weeks ago

Optimize consumer rebalancing on Amazon MSK with next generation protocol

The KIP-848 consumer protocol in Apache Kafka 4.0 redesigns consumer group rebalancing to eliminate stop-the-world pauses. This post explains how the consumer protocol works on Ama...

Read source
habr.com /3 weeks ago

Под капотом Kafka: путь сообщения от send() до commit offset. Часть 2

Привет, Хабр! Меня зовут Максим Шуматбаев, я инженер технической поддержки в Arenadata. Это вторая часть разбора, что на самом деле происходит при работе клиентских приложений с Ka...

Read source
dzone.com /1 month ago

Event-Driven AI Systems With Kafka and Autonomous Agents

Enterprise AI is moving beyond isolated prompt-response calls and toward systems that observe events, preserve state, invoke tools, and publish decisions back into operational work...

Read source
habr.com /1 month ago

Очередь без серверов и головной боли: как устроен Serverless Queue в MWS Cloud Platform

Если вы хоть раз эксплуатировали Kafka, то знаете, сколько нервных клеток способен съесть её кластер. Поднять Kafka для PoC несложно, а вот дальше начинается планирование ёмкости,...

Read source
dev.to /4 days ago

kafka-harbor: the Kafka layer every Node.js team rebuilds by hand, done once

Comments

Read source
aws.amazon.com /1 month ago

Migrate an OAuth 2.0 authenticated Apache Kafka cluster to Amazon MSK with MSK Replicator

MSK Replicator now supports OAuth 2.0 (SASL/OAUTHBEARER) authentication to external Apache Kafka clusters. This post walks through the three supported grant types, how to configure...

Read source
dzone.com /1 month ago

Designing Replay-Safe CDC Pipelines With Kafka, Debezium, and Recovery Contracts

Change data capture (CDC) pipelines look straightforward on paper: capture database changes, publish them to Kafka, and update downstream systems. The difficulty starts when events...

Read source
habr.com /1 month ago

Kafka Connect без магии: как переносить данные и не писать еще один сервис

Привет, бойцы, вы готовы победить перенос данных? Есть задача: перенести данные из PostgreSQL в Kafka. Первая мысль: написать небольшой сервис.Он будет выполнять SELECT, превращать...

Read source
cncf.io /3 weeks ago

From 40 seconds to under 10: rebuilding incident detection on OpenTelemetry, Apache Kafka, and Apache Flink on Kubernete...

Every SaaS company has the same uncomfortable question after a major incident: who noticed first, the monitoring or the customers? For a long time our honest answer was “it depends...

Read source
aws.amazon.com /1 month ago

Best practices for scaling large consumer groups on Amazon MSK

As consumer groups on Amazon MSK scale to thousands of members, the metadata record Kafka writes during rebalances can exceed the 1 MB limit and stall the group. Learn how to estim...

Read source
habr.com /2 weeks ago

[Перевод] Компактация лога в Apache Kafka повреждала данные. Вот как мы это исправили

Компактация лога в Kafka может привести к ситуации, когда разные реплики одного топика начинают хранить разную версию данных — и расхождение сохраняется даже после восстановления б...

Read source
dzone.com /1 month ago

Stream Processing on the Mainframe With Apache Flink: Genius or a Glitch in the Matrix?

Running Apache Flink on a mainframe sounds odd at first. A modern stream processing engine on a platform most people call legacy? But take a closer look. It is not only possible. I...

Read source
dzone.com /1 month ago

dbt Meets Apache Flink: One Workflow for Data Engineers

Data engineers managing batch SQL pipelines on Snowflake, BigQuery, and increasingly Databricks, and streaming pipelines on Apache Flink face a familiar problem: two toolchains, tw...

Read source
dzone.com /1 month ago

Best Practices for Handling Bad Data in Stream Processing Platforms

Today, stream processing platforms facilitate the real-time analysis of data flowing continuously from Internet of Things (IOT) devices, financial transactions, web applications an...

Read source
aws.amazon.com /1 month ago

Amazon MSK Service 101: How many partitions does an Amazon MSK topic need?

How many partitions does your Amazon MSK topic need? Choosing the right partition count affects throughput, scalability, and operational complexity. This post provides practical gu...

Read source
habr.com /1 month ago

«Зачем платформа, если есть Kafka?» Отвечаю честно, включая ту часть, где вы правы

Привет, Хабр! Меня зовут Виктор Овчинников, я руковожу продуктовым направлением «Интеграционная платформа» в «Диасофт». Той самой Digital Q.Integration, которую вы имеете полное пр...

Read source
dzone.com /1 week ago

Consumer Lag Is the Wrong Finish Line

A Kafka recovery often looks successful before it actually is. The replay job exits. Consumer lag drops. Error rate returns to normal. The dashboard is green enough for everyone to...

Read source
aws.amazon.com /1 month ago

Build a dynamic streaming data lake with Apache Iceberg and Apache Flink

Learn how to build a dynamic streaming data lake on Amazon Managed Service for Apache Flink that adapts to new event types and schema changes without stopping the pipeline, using A...

Read source

Turn fresh research into a full content calendar

Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.

Sources covering Apache Kafka

feeds.dzone.com

Recent coverage from public sources
Public source

aws.amazon.com

Recent coverage from public sources
Public source

dev.to

Recent coverage from public sources
Public source

habr.com

Recent coverage from public sources
Public source

kodekloud.com

Recent coverage from public sources
Public source

cncf.io

Recent coverage from public sources
Public source