Social Media Ideas for Apache Kafka

Latest updates for Apache Kafka

Fresh curated links around apache kafka are collected here so marketers can spot useful updates and turn timely ideas into posts faster.

Post angles to try

Share the most useful takeaway for your audience.

Turn one article into a quick practical checklist.

Ask your audience how this shift affects their work.

Turn angles into scheduled posts

Fresh articles and ideas

Recent curated links from global sources. Generate one free draft from any story, then use SocialBu to schedule and refine your content calendar.

javacodegeeks.com /1 month ago

Kafka CommitFailedException: Causes and Prevention

Apache Kafka provides reliable message consumption by allowing consumers to periodically commit their offsets. Offset commits inform Kafka that a consumer has successfully processe...

Read source

habr.com /3 weeks ago

2–3 тысячи сборок в день: как мы превратили Kafka из компонента в инфраструктурную платформу

Apache Kafka можно бесплатно скачать, развернуть и подключить к приложениям. При небольшом проекте этого может быть достаточно: создали несколько топиков, настроили потребителей —...

Read source

habr.com /2 weeks ago

Выбор Kafka UI: сравнение популярных инструментов для Apache Kafka от VK Data Platform

Apache Kafka — популярная система потоковой обработки событий, предназначенная для сбора, хранения и передачи больших объемов данных в режиме реального времени. Она используется ты...

Read source

techblog.lycorp.co.jp /1 month ago

秒間100万件、LINEアプリへのApache Kafkaエンドツーエンド暗号化の導入記

はじめに：なぜKafkaのエンドツーエンド暗号化なのか？LINEメッセンジャーでは、毎日数十億件のメッセージがやり取りされています。この膨大なデータはさまざまなシステムに送信されますが、そ...

Read source

mensfeld.pl /1 month ago

Karafka 2.6 and Web UI 1.0: Laying the Groundwork for Kafka Queues

Originally appeared on Closer to Code.I'm happy to announce that Karafka 2.6 and Karafka Web UI 1.0 have just been released. For those new here: Karafka is a Ruby and Rails multi-t...

Read source

dzone.com /3 weeks ago

Real-Time Supply Chain Event Streaming With Kafka and Neo4j

In a previous article, we built a static supply chain graph in Neo4j using Apache Spark, with suppliers, warehouses, distribution centers, and retailers connected by shipping route...

Read source

javacodegeeks.com /1 month ago

Building Idempotent Java Consumers for Replay-Safe Kafka Pipelines

Fast Kafka consumers are not automatically safe Kafka consumers. A Java service can keep up with partitions, restart cleanly, and still leave the business in a state that is hard t...

Read source

habr.com /1 month ago

[Перевод] Как использовать Kafka на собеседовании по System Design

Kafka часто появляется на System Design интервью, когда нужно асинхронно обрабатывать события и масштабировать систему.Но за словами “добавим Kafka” скрывается много важных деталей...

Read source

aws.amazon.com /1 month ago

Streamline Apache Kafka cluster operations and migrations with Agent Skills for Amazon MSK

Agent Skills for Amazon MSK bring broker-type-aware expertise to operating and migrating Apache Kafka clusters. In this post, we walk through installing the managing-amazon-msk and...

Read source

dev.to /3 weeks ago

My First Go + Kafka Project, and What It Actually Taught Me

In this post: what building a reliable webhook delivery system in Go and Kafka, my first project with both, actually taught me. Skip to What Kafka taught me if you want the meatier...

Read source

aws.amazon.com /1 week ago

Migrate an OAuth 2.0 authenticated Apache Kafka cluster to Amazon MSK with MSK Replicator

MSK Replicator now supports OAuth 2.0 (SASL/OAUTHBEARER) authentication to external Apache Kafka clusters. This post walks through the three supported grant types, how to configure...

Read source

habr.com /5 days ago

Kafka Connect без магии: как переносить данные и не писать еще один сервис

Привет, бойцы, вы готовы победить перенос данных? Есть задача: перенести данные из PostgreSQL в Kafka. Первая мысль: написать небольшой сервис.Он будет выполнять SELECT, превращать...

Read source

habr.com /4 weeks ago

Как восстановить KRaft-кворум после потери большинства контроллеров

Представьте себе баг-репорт: все шесть подов в статусе 1/1 Running, Readiness зелёный, kafka-agent на брокерах отдаёт 204. А кластер мёртв: оператор бесконечно крутит реконсайл и в...

Read source

dzone.com /1 week ago

Designing Replay-Safe CDC Pipelines With Kafka, Debezium, and Recovery Contracts

Change data capture (CDC) pipelines look straightforward on paper: capture database changes, publish them to Kafka, and update downstream systems. The difficulty starts when events...

Read source

towardsdatascience.com /2 weeks ago

How to Scale an Integration Pipeline Without Breaking Correctness

A production account of scaling an enterprise integration pipeline from 500 to 8,000 events per second, and the two correctness guarantees the throughput work was never allowed to...

Read source

aws.amazon.com /3 weeks ago

How AppFolio transformed its data streaming architecture with Amazon MSK Express brokers

Learn how AppFolio transformed its data streaming architecture by adopting Amazon MSK Express brokers, replacing hours-long rebalances and manual storage planning with a platform t...

Read source

aws.amazon.com /1 month ago

Deliver Apache Kafka data to streaming tables for Apache Iceberg with Amazon MSK Express brokers

Announcing delivery to streaming tables on Apache Iceberg for Amazon MSK Express brokers, a fully managed capability that continuously materializes your Kafka streaming data as que...

Read source

dzone.com /3 weeks ago

Orchestrating Small Language Models Without Losing Events or Context

Reliable orchestration for small language models depends less on model sophistication than on the durability of event flow and state. Under the assumptions used here — small model...

Read source

aws.amazon.com /2 weeks ago

Amazon MSK Service 101: How many partitions does an Amazon MSK topic need?

How many partitions does your Amazon MSK topic need? Choosing the right partition count affects throughput, scalability, and operational complexity. This post provides practical gu...

Read source

dzone.com /6 days ago

Best Practices for Handling Bad Data in Stream Processing Platforms

Today, stream processing platforms facilitate the real-time analysis of data flowing continuously from Internet of Things (IOT) devices, financial transactions, web applications an...

Read source

habr.com /3 weeks ago

River OSS и Kafka: почему transactional outbox не гарантирует порядок событий агрегата

Меня зовут Василий Миловидов, я системный архитектор в крупной компании. Мы строим обмен между сервисами на событиях: сервис меняет агрегат в PostgreSQL, в той же транзакции кладёт...

Read source

dzone.com /1 month ago

How We Cut PyFlink Pipeline p99 Latency from 3-5 Seconds to ~500ms

The Problem: Our p99 Was 3-5 Seconds Our PyFlink pipeline was missing its latency SLO by seconds. The pipeline itself was straightforward: consume events from Kafka, transform them...

Read source

dzone.com /1 month ago

Why LLM Pipelines Fail in Production and How Temporal and Kafka Fix Them

A production LLM pipeline is rarely just a prompt and a response. It typically combines retrieval, prompt rendering, model inference, output shaping, validation, persistence, and d...

Read source

aws.amazon.com /6 days ago

Build a dynamic streaming data lake with Apache Iceberg and Apache Flink

Learn how to build a dynamic streaming data lake on Amazon Managed Service for Apache Flink that adapts to new event types and schema changes without stopping the pipeline, using A...

Read source

Turn fresh research into a full content calendar

Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.