Latest updates for Aws Glue

Fresh curated links around AWS Glue are collected here so marketers can spot useful updates and turn timely ideas into posts faster.

Recent items include:

  • Build declarative ETL pipelines with AWS Glue 6.0
  • Cost-effective ETL with DuckDB and Amazon S3 Tables on AWS Glue
  • Build a real-time event pipeline with Spark Real-Time Mode on AWS Glue 6.0

Post angles to try

Share the most useful takeaway for your audience.
Turn one article into a quick practical checklist.
Ask your audience how this shift affects their work.
Turn angles into scheduled posts

Fresh articles and ideas

Recent curated links from global sources. Generate one free draft from any story, then use SocialBu to schedule and refine your content calendar.

aws.amazon.com /1 month ago

Build declarative ETL pipelines with AWS Glue 6.0

AWS Glue 6.0 introduces Spark Declarative Pipelines. In this post, you build a single declarative AWS Glue 6.0 job that turns raw order records into validated, aggregated tables th...

Read source
aws.amazon.com /2 weeks ago

Cost-effective ETL with DuckDB and Amazon S3 Tables on AWS Glue

Learn how to pair DuckDB with AWS Glue 6.0 to run SQL-centric ETL on a single worker, reading Parquet from Amazon S3 and writing Apache Iceberg tables to Amazon S3 Tables. This pos...

Read source
aws.amazon.com /1 month ago

Build a real-time event pipeline with Spark Real-Time Mode on AWS Glue 6.0

With AWS Glue 6.0, you can build real-time, near-real-time, and batch data pipelines on a single platform. Using a financial market-risk example, learn how to flag high-risk trades...

Read source
aws.amazon.com /1 week ago

Bring data quality to your Amazon EMR workloads with Amazon EMR Data Quality built on AWS Glue Data Quality

AWS Glue Data Quality is now available natively on Amazon EMR, bundled in AWS runtime for Apache Spark (emr-spark-8.1.0). Write the same DQDL rulesets you use in AWS Glue directly...

Read source
aws.amazon.com /1 month ago

Query Amazon S3 Tables from Amazon EMR Trino using the Iceberg REST endpoint

Learn how to query Amazon S3 Tables from Trino on Amazon EMR using the Apache Iceberg REST catalog endpoint. This post shows how to deploy the integration with AWS CloudFormation,...

Read source
aws.amazon.com /1 month ago

Build with geospatial and variant types in Iceberg v3 on AWS Glue 6.0

AWS Glue 6.0 with Apache Spark 4.1 adds support for Apache Iceberg v3: native geospatial types, nanosecond-precision timestamps, the VARIANT type, and DEFAULT column values. This p...

Read source
aws.amazon.com /1 month ago

Discover and govern Snowflake data using SageMaker Unified Studio

Connect Snowflake to Amazon SageMaker Unified Studio to build a unified data catalog. Query federated Snowflake tables without moving data, publish enriched assets to SageMaker Cat...

Read source
aws.amazon.com /1 month ago

Accelerating Spark queries with Iceberg materialized views

Accelerate slow, repetitive Apache Spark analytical queries on Apache Iceberg tables without rewriting any SQL. This post shows how automatic query rewrite in Amazon EMR and AWS Gl...

Read source
aws.amazon.com /1 month ago

How Moeve standardized dbt runs across data lakes with Amazon Athena

Moeve standardized how it runs dbt across multiple data lakes by building a centralized, serverless launcher on Amazon Athena, AWS Step Functions, AWS Fargate, Amazon DynamoDB, and...

Read source
aws.amazon.com /3 weeks ago

Aurora PostgreSQL zero-ETL integration with Amazon SageMaker

Amazon Aurora PostgreSQL zero-ETL integration with Amazon SageMaker replicates your operational data to a lakehouse in near real time, without building custom ETL pipelines. Learn...

Read source
aws.amazon.com /1 month ago

How United Airlines uses Amazon Redshift and AWS Glue Data Catalog federation to query Databricks-managed data

Learn how United Airlines uses AWS Glue Data Catalog federation to query Databricks Unity Catalog data directly from Amazon Redshift Serverless without duplicating data, using reso...

Read source
aws.amazon.com /2 weeks ago

Query across accounts and table formats with multi-catalog in Amazon EMR

Amazon EMR 8.1.0 adds multi-catalog support through the RedirectingSessionCatalog, so you can query Iceberg, Delta Lake, Hudi, and Hive tables through a single catalog and join dat...

Read source
aws.amazon.com /2 weeks ago

Monitoring MWAA-orchestrated ETL pipelines with Amazon OpenSearch Service

Troubleshooting a multi-service, MWAA-orchestrated ETL pipeline often means hunting across scattered Amazon CloudWatch log groups. This post shows how to centralize your ETL logs i...

Read source
aws.amazon.com /3 weeks ago

Building an LLM-powered DAG failure analysis plugin for Amazon MWAA

Debugging Apache Airflow DAG failures across services like AWS Glue, Amazon EMR, and Amazon Athena is slow and manual. In this post, we show you how to build a custom Airflow plugi...

Read source
aws.amazon.com /2 weeks ago

Materialize once, query anywhere: Introducing Iceberg materialized views in Amazon Redshift

Amazon Redshift now supports Iceberg materialized views. Compute an aggregation once in Amazon Redshift and store the result as a standard Apache Iceberg table in Amazon S3, querya...

Read source
aws.amazon.com /4 days ago

Build a semantic layer for agentic AI on AWS with AtScale and Amazon Bedrock AgentCore

The third post in our semantic-layer series builds a governed customer 360 model on Amazon Redshift with AtScale, then exposes it to a Strands agent on Amazon Bedrock AgentCore thr...

Read source
aws.amazon.com /1 month ago

Accelerate Apache Spark debugging on Amazon EMR with AWS DevOps Agent

Extend AWS DevOps Agent to investigate Apache Spark failures on Amazon EMR. This post shows how to register the Apache Spark Troubleshooting Agent for Amazon EMR as a custom MCP ca...

Read source
aws.amazon.com /1 month ago

Run DuckDB analytics on your Amazon DynamoDB data with zero-ETL

Run ad hoc SQL analytics on your Amazon DynamoDB data with DuckDB. A zero-ETL integration replicates your table into Apache Iceberg tables on Amazon S3 Tables, and an AWS Lambda fu...

Read source
aws.amazon.com /1 month ago

Razor Group’s journey to a modern data lakehouse on AWS

Razor Group, one of Europe's leading ecommerce aggregators managing 250+ brands, migrated from always-on Amazon Redshift clusters to an open lakehouse on Apache Iceberg, Amazon S3...

Read source
aws.amazon.com /1 month ago

How Boomi Scribe streamlines documentation using AWS

Boomi Scribe is an AI-powered agent on AWS that automatically generates documentation for enterprise integration workflows. Learn how Boomi uses Amazon Bedrock, Amazon SageMaker AI...

Read source
aws.amazon.com /1 month ago

Announcing Spark Connect on Amazon EMR on EC2: Interactive PySpark anywhere

Amazon EMR on EC2 now supports Spark Connect, so you can develop and debug PySpark interactively from Amazon SageMaker Unified Studio Data Notebooks or your own IDE while Spark run...

Read source
sourcetrail.com /3 weeks ago

AWS Aurora PostgreSQL adds direct queries for Iceberg and Parquet data lakes

AWS Aurora PostgreSQL now queries Iceberg and Parquet data in S3 without ETL, using DuckDB and familiar SQL. See versions, setup, limits, and costs. The post AWS Aurora PostgreSQL...

Read source
aws.amazon.com /3 weeks ago

Announcing Spark Connect on Amazon EMR on EKS: Interactive PySpark development, anywhere

Announcing Spark Connect on Amazon EMR on EKS: build, test, and debug Spark applications from VS Code, PyCharm, Jupyter notebooks, Amazon SageMaker Unified Studio, or dbt, while ru...

Read source
aws.amazon.com /4 days ago

Build a semantic layer for agentic AI on AWS with Denodo and Amazon Bedrock AgentCore

Build a governed semantic layer for agentic AI on AWS with the Denodo Platform and Amazon Bedrock AgentCore. It federates Amazon Aurora, Amazon Redshift, and an on-premises Postgre...

Read source

Turn fresh research into a full content calendar

Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.

Start creating posts

Sources covering Aws Glue

aws.amazon.com

Recent coverage from public sources
Public source

aws.amazon.com

Recent coverage from public sources
Public source

aws.amazon.com

Recent coverage from public sources
Public source

sourcetrail.com

Recent coverage from public sources
Public source

Related searches

Advanced (300) Technical How-to AWS Glue Amazon EMR Announcements Customer Solutions Amazon Redshift Amazon S3 Tables Amazon Bedrock Amazon Bedrock AgentCore Amazon Managed Workflows for Apache Airflow (Amazon MWAA) Amazon Athena

Recent searches

Artificial Intelligence Machine Learning Data Science Data Engineering Business Intelligence Web Development Software Development Software Testing Programming JavaScript DevOps Cyber Security Product Management Project Management Design UX UX Research Graphic Design Video Production Video Editing