Amazon MWAA now supports Apache Airflow version 2.7 and deferrable operators
Share
Services
You can now create Apache Airflow version 2.7 environments and execute deferrable operators on Amazon Managed Workflows for Apache Airflow (MWAA). Apache Airflow 2.7 is the latest minor release of the popular open-source tool that helps customers author, schedule, and monitor workflows.
Amazon MWAA is a managed orchestration service for Apache Airflow that makes it easier to set up and operate end-to-end data pipelines in the cloud. Apache Airflow version 2.7 on Amazon MWAA introduces deferrable operator support, enabling a higher number of tasks to run concurrently with fewer resources. Deferrable operators free up worker slots while they wait for their tasks to complete, and are supported with popular AWS services such as Amazon EMR, Amazon ECS, and AWS Glue. This update also brings improvements such as the cluster activity page, automatic setup/teardown tasks, and secrets cache. Additionally, Airflow 2.7 on Amazon MWAA now runs on Python 3.11 and is built on the Amazon Linux 2023 (AL2023) base image, offering enhanced security, modern tooling, and support for the latest Python libraries and features.
You can launch a new Apache Airflow 2.7 environment on Amazon MWAA with just a few clicks in the [AWS Management Console](https://console.aws.amazon.com/mwaa/home) in all currently supported [Amazon MWAA regions](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/). To learn more about Apache Airflow 2.7, visit the [Amazon MWAA documentation](https://docs.aws.amazon.com/mwaa/latest/userguide/what-is-mwaa.html), the [blog post highlighting what’s new](https://aws.amazon.com/blogs/big-data/introducing-amazon-mwaa-support-for-apache-airflow-version-2-7-2-and-deferrable-operators/), and the [Apache Airflow 2.7 change log](https://airflow.apache.org/docs/apache-airflow/2.7.2/release%5Fnotes.html#airflow-2-7-2-2023-10-12) in the Apache Airflow documentation.
_Apache, Apache Airflow, and Airflow are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries._
What else is happening at Amazon Web Services?
Amazon AppStream 2.0 users can now save their user preferences between streaming sessions
December 13th, 2024
Services
Share
AWS Elemental MediaConnect Gateway now supports source-specific multicast
December 13th, 2024
Services
Share
Amazon EC2 instances support bandwidth configurations for VPC and EBS
December 13th, 2024
Services
Share
AWS announces new AWS Direct Connect location in Osaka, Japan
December 13th, 2024
Services
Share
Amazon DynamoDB announces support for FIPS 140-3 interface VPC and Streams endpoints
December 13th, 2024
Services
Share