Social Media Ideas for Amazon Managed Streaming For Apache Kafka (Amazon Msk)

Latest updates for Amazon Managed Streaming For Apache Kafka (Amazon Msk)

Fresh curated links around Amazon Managed Streaming for Apache Kafka (Amazon MSK) are collected here so marketers can spot useful updates and turn timely ideas into posts faster.

Post angles to try

Share the most useful takeaway for your audience.

Turn one article into a quick practical checklist.

Ask your audience how this shift affects their work.

Turn angles into scheduled posts

Fresh articles and ideas

Recent curated links from global sources. Generate one free draft from any story, then use SocialBu to schedule and refine your content calendar.

aws.amazon.com /1 month ago

Migrate an OAuth 2.0 authenticated Apache Kafka cluster to Amazon MSK with MSK Replicator

MSK Replicator now supports OAuth 2.0 (SASL/OAUTHBEARER) authentication to external Apache Kafka clusters. This post walks through the three supported grant types, how to configure...

Read source

aws.amazon.com /3 weeks ago

Optimize consumer rebalancing on Amazon MSK with next generation protocol

The KIP-848 consumer protocol in Apache Kafka 4.0 redesigns consumer group rebalancing to eliminate stop-the-world pauses. This post explains how the consumer protocol works on Ama...

Read source

aws.amazon.com /1 month ago

Deliver real-time data to streaming tables for Apache Iceberg with Amazon Kinesis Data Streams

Amazon Kinesis Data Streams now supports streaming tables, a fully managed capability that continuously delivers your streaming data as queryable Apache Iceberg tables on Amazon S3...

Read source

aws.amazon.com /1 month ago

Announcing in-place ZooKeeper-to-KRaft cluster upgrades for Amazon MSK

Amazon MSK now supports in-place upgrades from ZooKeeper to KRaft metadata mode. You can modernize your existing cluster's metadata management through the familiar version upgrade...

Read source

aws.amazon.com /1 month ago

Best practices for scaling large consumer groups on Amazon MSK

As consumer groups on Amazon MSK scale to thousands of members, the metadata record Kafka writes during rebalances can exceed the 1 MB limit and stall the group. Learn how to estim...

Read source

aws.amazon.com /1 month ago

Amazon MSK Service 101: How many partitions does an Amazon MSK topic need?

How many partitions does your Amazon MSK topic need? Choosing the right partition count affects throughput, scalability, and operational complexity. This post provides practical gu...

Read source

aws.amazon.com /1 week ago

Build cross-account streaming pipelines with the Amazon Kinesis Producer Library and Kinesis Client Library

Learn how to build an enterprise-scale cross-account streaming pipeline with Amazon Kinesis Data Streams using the Kinesis Producer Library (KPL) and Kinesis Client Library (KCL) a...

Read source

aws.amazon.com /1 month ago

Build a dynamic streaming data lake with Apache Iceberg and Apache Flink

Learn how to build a dynamic streaming data lake on Amazon Managed Service for Apache Flink that adapts to new event types and schema changes without stopping the pipeline, using A...

Read source

dzone.com /3 weeks ago

Why Databricks and Snowflake Speak the Kafka Protocol: Ingestion vs Architecture

Kafka-compatible ingestion is showing up everywhere now, including in analytics platforms that have nothing to do with running Kafka. Databricks added Kafka-compatible APIs to its...

Read source

dzone.com /1 week ago

Kafka With Spring Boot: Introduction

Kafka is a distributed event streaming platform that enables real-time data ingestion, storage, and processing of continuous event streams. To do that, Kafka has a complex internal...

Read source

aws.amazon.com /2 weeks ago

Monitoring MWAA-orchestrated ETL pipelines with Amazon OpenSearch Service

Troubleshooting a multi-service, MWAA-orchestrated ETL pipeline often means hunting across scattered Amazon CloudWatch log groups. This post shows how to centralize your ETL logs i...

Read source

kodekloud.com /1 month ago

How Kafka Works

Learn how Kafka works and why every backend uses it: producers, consumers, topics, partitions and offsets explained with a checkout example.

Read source

aws.amazon.com /3 weeks ago

Announcing Spark Connect on Amazon EMR on EKS: Interactive PySpark development, anywhere

Announcing Spark Connect on Amazon EMR on EKS: build, test, and debug Spark applications from VS Code, PyCharm, Jupyter notebooks, Amazon SageMaker Unified Studio, or dbt, while ru...

Read source

snowflake.com /1 month ago

Snowpipe Streaming Elastic Channels Is Now GA | Snowflake

Snowpipe Streaming Elastic Channels and durable acknowledgments are now generally available — stream data directly from any producer into Snowflake.

Read source

aws.amazon.com /1 month ago

How Sony LIV built real-time video streaming analytics with AWS

Real-time data analytics is transforming how streaming platforms serve their audiences. Learn how Sony LIV built a comprehensive, real-time streaming analytics solution on AWS usin...

Read source

habr.com /1 month ago

Очередь без серверов и головной боли: как устроен Serverless Queue в MWS Cloud Platform

Если вы хоть раз эксплуатировали Kafka, то знаете, сколько нервных клеток способен съесть её кластер. Поднять Kafka для PoC несложно, а вот дальше начинается планирование ёмкости,...

Read source

aws.amazon.com /1 month ago

Build a real-time event pipeline with Spark Real-Time Mode on AWS Glue 6.0

With AWS Glue 6.0, you can build real-time, near-real-time, and batch data pipelines on a single platform. Using a financial market-risk example, learn how to flag high-risk trades...

Read source

aws.amazon.com /4 weeks ago

How to stream PostgreSQL changes to Amazon S3 with AWS Fargate

In this post, we show you how to build a fully managed, event-driven change data capture (CDC) pipeline. It streams row-level changes from Amazon RDS for PostgreSQL or Amazon Auror...

Read source

aws.amazon.com /1 month ago

How Delivery Hero rebuilt real-time ad measurement with Apache Flink

Learn how Delivery Hero rebuilt its ad measurement pipeline from hourly batch processing to real time on Amazon Managed Service for Apache Flink, cutting the gap between an event a...

Read source

aws.amazon.com /3 weeks ago

Aurora PostgreSQL zero-ETL integration with Amazon SageMaker

Amazon Aurora PostgreSQL zero-ETL integration with Amazon SageMaker replicates your operational data to a lakehouse in near real time, without building custom ETL pipelines. Learn...

Read source

aws.amazon.com /1 month ago

Accelerate Apache Spark debugging on Amazon EMR with AWS DevOps Agent

Extend AWS DevOps Agent to investigate Apache Spark failures on Amazon EMR. This post shows how to register the Apache Spark Troubleshooting Agent for Amazon EMR as a custom MCP ca...

Read source

dev.to /3 weeks ago

PDF, ZIP and binary files streaming over Kafka with names intact.

PDF, ZIP and binary files streaming over Kafka with names intact. Day 07 of the WKafka Open-Source Engineering Series. Don't provision a cloud bucket when all you need is send...

Read source

aws.amazon.com /1 month ago

Announcing Spark Connect on Amazon EMR on EC2: Interactive PySpark anywhere

Amazon EMR on EC2 now supports Spark Connect, so you can develop and debug PySpark interactively from Amazon SageMaker Unified Studio Data Notebooks or your own IDE while Spark run...

Read source

dev.to /3 weeks ago

Archivos PDF, ZIP y binarios viajando en Kafka con nombre intacto.

Archivos PDF, ZIP y binarios viajando en Kafka con nombre intacto. Día 07 de la serie técnica WKafka Open Source. No aprovisiones un bucket en la nube cuando lo único que nece...

Read source

Turn fresh research into a full content calendar

Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.