Latest updates for Kinesis Data Streams

Fresh curated links around Kinesis Data Streams are collected here so marketers can spot useful updates and turn timely ideas into posts faster.

Recent items include:

  • Deliver real-time data to streaming tables for Apache Iceberg with Amazon Kinesis Data Streams
  • Build cross-account streaming pipelines with the Amazon Kinesis Producer Library and Kinesis Client Library
  • Build a dynamic streaming data lake with Apache Iceberg and Apache Flink

Post angles to try

Share the most useful takeaway for your audience.
Turn one article into a quick practical checklist.
Ask your audience how this shift affects their work.
Turn angles into scheduled posts

Fresh articles and ideas

Recent curated links from global sources. Generate one free draft from any story, then use SocialBu to schedule and refine your content calendar.

aws.amazon.com /1 month ago

Deliver real-time data to streaming tables for Apache Iceberg with Amazon Kinesis Data Streams

Amazon Kinesis Data Streams now supports streaming tables, a fully managed capability that continuously delivers your streaming data as queryable Apache Iceberg tables on Amazon S3...

Read source
aws.amazon.com /1 week ago

Build cross-account streaming pipelines with the Amazon Kinesis Producer Library and Kinesis Client Library

Learn how to build an enterprise-scale cross-account streaming pipeline with Amazon Kinesis Data Streams using the Kinesis Producer Library (KPL) and Kinesis Client Library (KCL) a...

Read source
aws.amazon.com /1 month ago

Build a dynamic streaming data lake with Apache Iceberg and Apache Flink

Learn how to build a dynamic streaming data lake on Amazon Managed Service for Apache Flink that adapts to new event types and schema changes without stopping the pipeline, using A...

Read source
aws.amazon.com /1 month ago

Build a real-time event pipeline with Spark Real-Time Mode on AWS Glue 6.0

With AWS Glue 6.0, you can build real-time, near-real-time, and batch data pipelines on a single platform. Using a financial market-risk example, learn how to flag high-risk trades...

Read source
dev.to /1 month ago

Live streaming technologies in crypto analytics

What Live Streaming Infrastructure Actually Means for Crypto Analytics Crypto data is not like most data. Prices move in milliseconds, on-chain events cascade in bursts, and by t...

Read source
aws.amazon.com /1 month ago

How Sony LIV built real-time video streaming analytics with AWS

Real-time data analytics is transforming how streaming platforms serve their audiences. Learn how Sony LIV built a comprehensive, real-time streaming analytics solution on AWS usin...

Read source
dzone.com /3 weeks ago

Why Databricks and Snowflake Speak the Kafka Protocol: Ingestion vs Architecture

Kafka-compatible ingestion is showing up everywhere now, including in analytics platforms that have nothing to do with running Kafka. Databricks added Kafka-compatible APIs to its...

Read source
aws.amazon.com /4 weeks ago

How to stream PostgreSQL changes to Amazon S3 with AWS Fargate

In this post, we show you how to build a fully managed, event-driven change data capture (CDC) pipeline. It streams row-level changes from Amazon RDS for PostgreSQL or Amazon Auror...

Read source
aws.amazon.com /1 month ago

Scale down Kinesis Data Streams on-demand capacity with ODA warm throughput

Amazon Kinesis Data Streams now supports scaling down ingest capacity for on-demand Advantage streams with warm throughput. Learn how the scale-down works, how to monitor stream be...

Read source
aws.amazon.com /1 month ago

Run DuckDB analytics on your Amazon DynamoDB data with zero-ETL

Run ad hoc SQL analytics on your Amazon DynamoDB data with DuckDB. A zero-ETL integration replicates your table into Apache Iceberg tables on Amazon S3 Tables, and an AWS Lambda fu...

Read source
aws.amazon.com /3 weeks ago

Optimize consumer rebalancing on Amazon MSK with next generation protocol

The KIP-848 consumer protocol in Apache Kafka 4.0 redesigns consumer group rebalancing to eliminate stop-the-world pauses. This post explains how the consumer protocol works on Ama...

Read source
dzone.com /1 month ago

Dashboards and Queries for Apache Kafka

Dashboards are everywhere. Business and IT teams use them to track metrics, visualize trends, and make decisions. But when working with real-time data from Apache Kafka, it’s not o...

Read source
dzone.com /1 week ago

Kafka With Spring Boot: Introduction

Kafka is a distributed event streaming platform that enables real-time data ingestion, storage, and processing of continuous event streams. To do that, Kafka has a complex internal...

Read source
aws.amazon.com /3 weeks ago

Aurora PostgreSQL zero-ETL integration with Amazon SageMaker

Amazon Aurora PostgreSQL zero-ETL integration with Amazon SageMaker replicates your operational data to a lakehouse in near real time, without building custom ETL pipelines. Learn...

Read source
kodekloud.com /1 month ago

How to Stream LLM Responses Token by Token With Server Sent Events

Streaming does not speed anything up. The same request takes the same time either way. What changes is when the reader stops staring at nothing, and that turns out to be most of th...

Read source
dzone.com /1 month ago

Best Practices for Handling Bad Data in Stream Processing Platforms

Today, stream processing platforms facilitate the real-time analysis of data flowing continuously from Internet of Things (IOT) devices, financial transactions, web applications an...

Read source
dzone.com /1 month ago

dbt Meets Apache Flink: One Workflow for Data Engineers

Data engineers managing batch SQL pipelines on Snowflake, BigQuery, and increasingly Databricks, and streaming pipelines on Apache Flink face a familiar problem: two toolchains, tw...

Read source
aws.amazon.com /1 month ago

Announcing in-place ZooKeeper-to-KRaft cluster upgrades for Amazon MSK

Amazon MSK now supports in-place upgrades from ZooKeeper to KRaft metadata mode. You can modernize your existing cluster's metadata management through the familiar version upgrade...

Read source
kodekloud.com /1 month ago

How Kafka Works

Learn how Kafka works and why every backend uses it: producers, consumers, topics, partitions and offsets explained with a checkout example.

Read source
aws.amazon.com /1 week ago

dbt and Amazon Redshift Data Sharing: Multi-cluster pipelines without moving a byte

Learn how to set up Amazon Redshift Data Sharing between a producer and consumer cluster and use dbt Cloud to transform the shared data into analytics-ready models, with live, zero...

Read source
aws.amazon.com /1 month ago

Best practices for scaling large consumer groups on Amazon MSK

As consumer groups on Amazon MSK scale to thousands of members, the metadata record Kafka writes during rebalances can exceed the 1 MB limit and stall the group. Learn how to estim...

Read source
cloud.google.com /1 month ago

What’s new with Google Data Cloud

August 31 - September 4 Stateful processing is available in BigQuery continuous queries in PreviewStateful operations significantly expand what’s possible with BigQuery continuous...

Read source
aws.amazon.com /2 weeks ago

Cost-effective ETL with DuckDB and Amazon S3 Tables on AWS Glue

Learn how to pair DuckDB with AWS Glue 6.0 to run SQL-centric ETL on a single worker, reading Parquet from Amazon S3 and writing Apache Iceberg tables to Amazon S3 Tables. This pos...

Read source
aws.amazon.com /1 month ago

Migrate an OAuth 2.0 authenticated Apache Kafka cluster to Amazon MSK with MSK Replicator

MSK Replicator now supports OAuth 2.0 (SASL/OAUTHBEARER) authentication to external Apache Kafka clusters. This post walks through the three supported grant types, how to configure...

Read source

Turn fresh research into a full content calendar

Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.

Sources covering Kinesis Data Streams

feeds.dzone.com

Recent coverage from public sources
Public source

aws.amazon.com

Recent coverage from public sources
Public source

aws.amazon.com

Recent coverage from public sources
Public source

cloudblog.withgoogle.com

Recent coverage from public sources
Public source

dev.to

Recent coverage from public sources
Public source

kodekloud.com

Recent coverage from public sources
Public source