Latest updates for Amazon Managed Streaming For Apache Kafka (Amazon Msk)

Fresh curated links around Amazon Managed Streaming for Apache Kafka (Amazon MSK) are collected here so marketers can spot useful updates and turn timely ideas into posts faster.

Recent items include:

  • Streamline Apache Kafka cluster operations and migrations with Agent Skills for Amazon MSK
  • Deliver Apache Kafka data to streaming tables for Apache Iceberg with Amazon MSK Express brokers
  • How AppFolio transformed its data streaming architecture with Amazon MSK Express brokers

Post angles to try

Share the most useful takeaway for your audience.
Turn one article into a quick practical checklist.
Ask your audience how this shift affects their work.
Turn angles into scheduled posts

Fresh articles and ideas

Recent curated links from global sources. Generate one free draft from any story, then use SocialBu to schedule and refine your content calendar.

aws.amazon.com /1 month ago

Streamline Apache Kafka cluster operations and migrations with Agent Skills for Amazon MSK

Agent Skills for Amazon MSK bring broker-type-aware expertise to operating and migrating Apache Kafka clusters. In this post, we walk through installing the managing-amazon-msk and...

Read source
aws.amazon.com /1 month ago

Deliver Apache Kafka data to streaming tables for Apache Iceberg with Amazon MSK Express brokers

Announcing delivery to streaming tables on Apache Iceberg for Amazon MSK Express brokers, a fully managed capability that continuously materializes your Kafka streaming data as que...

Read source
aws.amazon.com /3 weeks ago

How AppFolio transformed its data streaming architecture with Amazon MSK Express brokers

Learn how AppFolio transformed its data streaming architecture by adopting Amazon MSK Express brokers, replacing hours-long rebalances and manual storage planning with a platform t...

Read source
aws.amazon.com /3 weeks ago

Amazon MSK simplifies configuring custom domain names

With Amazon MSK, you can now configure custom domain names for provisioned clusters using a single configuration property that works identically on ZooKeeper and KRaft. Define the...

Read source
aws.amazon.com /1 week ago

Migrate an OAuth 2.0 authenticated Apache Kafka cluster to Amazon MSK with MSK Replicator

MSK Replicator now supports OAuth 2.0 (SASL/OAUTHBEARER) authentication to external Apache Kafka clusters. This post walks through the three supported grant types, how to configure...

Read source
aws.amazon.com /1 week ago

Deliver real-time data to streaming tables for Apache Iceberg with Amazon Kinesis Data Streams

Amazon Kinesis Data Streams now supports streaming tables, a fully managed capability that continuously delivers your streaming data as queryable Apache Iceberg tables on Amazon S3...

Read source
aws.amazon.com /1 week ago

Announcing in-place ZooKeeper-to-KRaft cluster upgrades for Amazon MSK

Amazon MSK now supports in-place upgrades from ZooKeeper to KRaft metadata mode. You can modernize your existing cluster's metadata management through the familiar version upgrade...

Read source
aws.amazon.com /1 month ago

How Razorpay Built Real-Time Anomaly Detection with Amazon MSK

In this post, we explore Razorpay’s anomaly detection and alerting platform (ADA) architecture using Amazon Managed Streaming for Apache Kafka (Amazon MSK) and other AWS services....

Read source
aws.amazon.com /1 week ago

Amazon MSK Service 101: How many partitions does an Amazon MSK topic need?

How many partitions does your Amazon MSK topic need? Choosing the right partition count affects throughput, scalability, and operational complexity. This post provides practical gu...

Read source
aws.amazon.com /3 weeks ago

NaranjaX manages multiple Amazon MSK Serverless clusters in different accounts from their IDP using AWS RAM and Route 53

Learn how NaranjaX built a cross-account, many-to-many connectivity model for Amazon MSK Serverless using AWS Resource Access Manager and Amazon Route 53 Resolver, so teams across...

Read source
aws.amazon.com /6 days ago

Build a dynamic streaming data lake with Apache Iceberg and Apache Flink

Learn how to build a dynamic streaming data lake on Amazon Managed Service for Apache Flink that adapts to new event types and schema changes without stopping the pipeline, using A...

Read source
aws.amazon.com /1 month ago

Efficient log management with Amazon OpenSearch Service data streams

In this post, we show you how to implement data streams with Index State Management (ISM) in Amazon OpenSearch Service. This approach automatically manages your time series data li...

Read source
aws.amazon.com /4 weeks ago

AI-powered cost optimization agent for Amazon Kinesis Data Streams

Learn how to deploy an open-source, AI-powered agent built on Amazon Bedrock that automatically analyzes every Amazon Kinesis Data Streams stream in your account, compares costs ac...

Read source
aws.amazon.com /3 weeks ago

Unlocking real-time analytics: Streaming Aurora DSQL changes into Apache Iceberg

Stream Amazon Aurora DSQL change data capture (CDC) events into Apache Iceberg tables on Amazon S3 with Amazon Data Firehose, then query them using Amazon Athena. This post walks t...

Read source
dev.to /3 weeks ago

Event-Driven Architecture on AWS: SQS vs SNS vs EventBridge vs Kinesis — Patterns, Anti-Patterns, and When to Use What

Event-driven architecture (EDA) is how modern distributed systems communicate at scale. Instead of services calling each other directly (tight coupling), services emit events ("thi...

Read source
aws.amazon.com /1 month ago

Migrate to Amazon Keyspaces with zero downtime using ZDM Proxy

Learn how to migrate from self-managed Apache Cassandra to Amazon Keyspaces with zero downtime by deploying an extended version of the ZDM Proxy on AWS Fargate. This post covers th...

Read source
aws.amazon.com /1 month ago

High-performance Remote Shuffle Service on Amazon EMR with Apache Celeborn

In this post, we show how Apache Celeborn resolves this trade-off for Amazon EMR on EKS and Amazon EMR on EC2, improving job reliability while unlocking additional cost savings.

Read source
aws.amazon.com /1 month ago

Event-driven pipeline orchestration with Amazon MWAA and Airflow 3.0

Data engineering teams running Apache Airflow across multiple AWS accounts have no built-in way to coordinate workflows between separate Amazon MWAA environments. With Airflow 3.0...

Read source
aws.amazon.com /1 week ago

Build a real-time event pipeline with Spark Real-Time Mode on AWS Glue 6.0

With AWS Glue 6.0, you can build real-time, near-real-time, and batch data pipelines on a single platform. Using a financial market-risk example, learn how to flag high-risk trades...

Read source
aws.amazon.com /3 weeks ago

Amazon Aurora DSQL observability concepts and usage with Amazon CloudWatch

Amazon Aurora DSQL offers time-based observability through Amazon CloudWatch Database Insights. Learn how the DSQL observability model, DASH, Database Insights, PromQL, and the sys...

Read source
habr.com /2 weeks ago

Выбор Kafka UI: сравнение популярных инструментов для Apache Kafka от VK Data Platform

Apache Kafka — популярная система потоковой обработки событий, предназначенная для сбора, хранения и передачи больших объемов данных в режиме реального времени. Она используется ты...

Read source
habr.com /1 month ago

redb.Route — коннектор Amazon SQS + SNS, at-least-once и Publish-Subscribe через SNS→SQS. Уходим от MassTransit

series redb ecosystemПро Kafka и RabbitMQ в этой серии уже было. Теперь — Amazon SQS, и вместе с ним в одном пакете SNS: два транспорта, потому что в мире AWS они ходят парой. Конн...

Read source
aws.amazon.com /1 week ago

Accelerate Apache Spark debugging on Amazon EMR with AWS DevOps Agent

Extend AWS DevOps Agent to investigate Apache Spark failures on Amazon EMR. This post shows how to register the Apache Spark Troubleshooting Agent for Amazon EMR as a custom MCP ca...

Read source
aws.amazon.com /3 weeks ago

IAM authentication with OAuth 2.0 for Amazon MQ for RabbitMQ

IAM authentication with OAuth 2.0 lets clients connect to Amazon MQ for RabbitMQ using their existing IAM identity instead of static broker-local credentials. This post covers the...

Read source

Turn fresh research into a full content calendar

Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.

Start creating posts

Sources covering Amazon Managed Streaming For Apache Kafka (Amazon Msk)

aws.amazon.com

Recent coverage from public sources
Public source

aws.amazon.com

Recent coverage from public sources
Public source

dev.to

Recent coverage from public sources
Public source

habr.com

Recent coverage from public sources
Public source

Related searches

Technical How-to Advanced (300) Amazon Managed Streaming for Apache Kafka (Amazon MSK) Announcements Intermediate (200) Customer Solutions Expert (400) Amazon Aurora DSQL Foundational (100) Kinesis Data Streams Thought Leadership

Recent searches

Artificial Intelligence Machine Learning Data Science Data Engineering Business Intelligence Web Development Software Development Software Testing Programming JavaScript DevOps Cyber Security Product Management Project Management Design UX UX Research Graphic Design Video Production Video Editing