Introducing Autoscaling in AWS Glue jobs (Preview)
Share
Services
Autoscaling in AWS Glue jobs is now available in preview. AWS Glue 3.0 can now dynamically scale resources up and down based on the workload, for both batch and streaming jobs. With autoscaling, you no longer need to worry about over-provisioning resources for jobs, spend time optimizing the number of workers, or pay for idle workers.
[AWS Glue](/glue/) is a serverless data integration service that allows you to schedule and run data integration and extract, transform, and load (ETL) jobs without managing any computing infrastructure. AWS Glue monitors each stage of the job run and turns workers off when they are idle or adds workers if additional parallel processing is possible. For Streaming ETL jobs, AWS Glue monitors the source data stream and continually adds and removes workers based on the amount of activity in the stream.
This feature is available in the US East (Ohio) [AWS Region](/about-aws/global-infrastructure/regional-product-services/).
To learn more, visit our [documentation,](https://docs.aws.amazon.com/glue/latest/dg/auto-scaling.html) and send us feedback at [glue-auto-scaling-preview@amazon.com.](mailto:glue-auto-scaling-preview@amazon.com)
What else is happening at Amazon Web Services?
Amazon AppStream 2.0 users can now save their user preferences between streaming sessions
December 13th, 2024
Services
Share
AWS Elemental MediaConnect Gateway now supports source-specific multicast
December 13th, 2024
Services
Share
Amazon EC2 instances support bandwidth configurations for VPC and EBS
December 13th, 2024
Services
Share
AWS announces new AWS Direct Connect location in Osaka, Japan
December 13th, 2024
Services
Share
Amazon DynamoDB announces support for FIPS 140-3 interface VPC and Streams endpoints
December 13th, 2024
Services
Share