AWS Glue supports reading from self-managed Apache Kafka
Share
Services
Streaming extract, transform, and load (ETL) jobs in [AWS Glue](/glue/) can now ingest data from Apache Kafka clusters that you manage yourself. Previously, AWS Glue supported reading specifically from Amazon Managed Streaming for Apache Kafka (Amazon MSK). With this update, AWS Glue allows you to perform streaming ETL on data from Apache Kafka whether it is deployed on-premises or in the cloud.
AWS Glue streaming ETL jobs continuously consume data from streaming sources, clean and transform the data in-flight, and make it available for analysis in seconds. With the addition of self-managed Apache Kafka as a source, you can now also optionally use SSL when connecting to Apache Kafka as well as connect to clusters either inside or outside of an Amazon Virtual Private Cloud.
Self-managed Apache Kafka support in AWS Glue is available in the same [AWS regions](/about-aws/global-infrastructure/regional-product-services/) as AWS Glue.
To learn more, read about adding Streaming ETL jobs in our [documentation](https://docs.aws.amazon.com/glue/latest/dg/add-job-streaming.html).
What else is happening at Amazon Web Services?
Amazon AppStream 2.0 users can now save their user preferences between streaming sessions
December 13th, 2024
Services
Share
AWS Elemental MediaConnect Gateway now supports source-specific multicast
December 13th, 2024
Services
Share
Amazon EC2 instances support bandwidth configurations for VPC and EBS
December 13th, 2024
Services
Share
AWS announces new AWS Direct Connect location in Osaka, Japan
December 13th, 2024
Services
Share
Amazon DynamoDB announces support for FIPS 140-3 interface VPC and Streams endpoints
December 13th, 2024
Services
Share