aws.amazon.com /4 weeks ago

Orchestrating SageMaker AI endpoint auto scaling with AWS CDK

Updating a SageMaker AI endpoint that has Application Auto Scaling registered makes AWS CloudFormation and AWS CDK deployments fail. This post shows how to build a reusable AWS CDK...

Read source
judoscale.com /1 month ago

Judoscale on Northflank: Powerful Autoscaling for Hosted and BYOC Deployments

Originally appeared on Judoscale Dev Blog. We’re continuing to bring Judoscale to the cloud hosting platforms we love. Today that platform is Northflank. Northflank is int...

Read source
cloud.google.com /1 month ago

Scale your own way, using HPA with built-in support for PromQL metrics queries in GKE

Earlier this year, we announced native support for Google Kubernetes Engine (GKE) custom metrics. This milestone allowed you to scrap external adapters and instead collect autoscal...

Read source
cncf.io /1 month ago

How AI workloads are reshaping Kubernetes autoscaling

Kubernetes has quietly run much of the world’s containerized software on a division of labor between two control loops that rarely had to talk to each other. The scheduler places e...

Read source
dzone.com /1 week ago

Three Measured Outcomes of Manually Scaling Fleet in Prod

Every GitOps setup meets the same moment: something is on fire, someone runs kubectl scale on prod, and the fix works. What happens next depends on two settings that rarely get che...

Read source
grahamdumpleton.me /6 days ago

Graham Dumpleton: Muru: scaling from what the workers report

In the Kubernetes post the scaling was done from outside. Muru published how busy its worker slots were, and a HorizontalPodAutoscaler added pods when the number went over a target...

Read source
aws.amazon.com /4 weeks ago

Stop guessing auto scaling targets for TTS on Amazon SageMaker AI

Teams deploying custom text-to-speech models on Amazon SageMaker AI often guess at autoscaling thresholds, and a wrong guess either wastes GPU spend or breaches a latency SLO. This...

Read source
aws.amazon.com /1 month ago

Scaling MoE reinforcement learning on Amazon EKS with EFA and DeepEP with 40% more throughput

Learn how to scale Mixture-of-Experts (MoE) reinforcement learning on Amazon EKS using Elastic Fabric Adapter (EFA) and DeepEP. This post presents an architecture that combines Ama...

Read source
cloud.google.com /1 month ago

GKE becomes more elastic: Scale to zero, save costs, and keep workloads responsive

True elasticity has long been the holy grail of cloud-native engineering. And while Kubernetes has revolutionized resource management, workloads that run sporadically (e.g., batch...

Read source
cloud.google.com /1 month ago

GKE CPU startup boost: Accelerate app starts without over-provisioning

Whether you’re launching microservices in response to sudden traffic spikes, deploying new software releases, or scaling up application replicas, pod startup time is critical to ma...

Read source
aws.amazon.com /2 days ago

How Moonfrog scales analytics and lowers query cost with Amazon Redshift RG instances

Moonfrog Labs migrated a 148 TB Amazon Redshift warehouse from RA3 to Graviton-based RG instances with a single elastic resize. See how the team sized capacity for growing analytic...

Read source
dev.to /1 month ago

Scaling prod by hand during an incident, when Fleet manages it: three ways it goes, measured

Every GitOps setup meets the same moment: something is on fire, someone runs kubectl scale on prod, and the fix works. What happens next depends on two settings most people never l...

Read source
aws.amazon.com /4 days ago

How Veeva scaled big data with Amazon EMR on EKS

Veeva Systems rebuilt its petabyte-scale analytics platform on Amazon EMR on EKS with Karpenter, cutting ETL runtimes by over 50% and eliminating idle cluster costs with elastic Sp...

Read source
ksugle.com /1 month ago

VMSS için Automatic Zone Balance genel kullanımda

<p>Virtual Machine Scale Sets için automatic zone balance GA oldu: VM'leri availability zone'lar arasında otomatik dengeleyerek tek zone arızasının etkisini</p>

Read source
rooferscoffeeshop.com /1 month ago

What scaling demands from your software

what-scaling-demands-from-your-software

Read source
aws.amazon.com /1 day ago

Introducing managed cluster extensions for observability and user management in Amazon SageMaker HyperPod Slurm

Amazon SageMaker HyperPod now offers managed cluster extensions for observability and user management, bringing declarative, API- and console-driven configuration to the software r...

Read source
ksugle.com /2 weeks ago

SSM for SAP artık SAP HANA scale-out destekliyor

<p>AWS Systems Manager for SAP artД±k Г§ok dГјДџГјmlГј SAP HANA scale-out sistemlerini destekliyor: AWS Backup, uygulama farkД±ndalД±klД± baЕџlatma ve durdurma.</p>

Read source
voip.review /1 month ago

Huawei SCALE Accelerates Enterprise AI Partner Deployments

Huawei’s SCALE partner system aims to accelerate enterprise AI from pilots to production, giving VoIP providers, telecom operators, and IT partners repeatable tools for deployment,...

Read source
databricks.com /1 month ago

How to scale agentic applications without creating AI sprawl

Building an agent is getting easier. More capable models and coding agents are making...

Read source
theregister.com /1 month ago

AWS turns its best practice framework into an agent that recommends cloudy reconfigs

Possesses powers equivalent to an 'experienced architect' and will happily make cost-saving suggestions

Read source
aws.amazon.com /1 week ago

Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot

Learn how AssemblyAI runs cost-optimized speech-to-text inference at scale on AWS, using Amazon ECS, Amazon EC2 Spot GPU instances, and an Amazon SQS-based retry architecture to ac...

Read source
databricks.com /2 weeks ago

A builder’s guide to scaling Databricks Apps

Congratulations, you've built an app on Databricks Apps, and it's gone from a couple...

Read source
aws.amazon.com /1 month ago

Monitor Amazon Aurora DSQL costs with the Aurora DSQL console and CloudWatch alarms

As your Amazon Aurora DSQL workload scales, DPU consumption and storage costs can grow without a fixed instance ceiling. This post shows how to monitor Aurora DSQL usage and cost w...

Read source
databricks.com /3 weeks ago

Smarter cost controls for serverless

At Databricks, our serverless compute usage has grown more than 3x in the past year,...

Read source

Turn fresh research into a full content calendar

Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.