Amazon EMR on EKS now supports Apache Livy
Share
Services
Today, we are excited to announce that customers will now be able to use [Apache Livy](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-livy.html) to submit their Apache Spark jobs to [Amazon EMR on EKS](https://aws.amazon.com/emr/features/eks/), in addition to using StartJobRun API, Spark Operator, Spark Submit and Interactive Endpoints. With this launch, customers will be able to use a REST interface to easily submit Spark jobs or snippets of Spark code, retrieve results synchronously or asynchronously while continuing to get all of the Amazon EMR on EKS benefits such as EMR optimized Spark runtime, SSL secured Livy endpoint, programmatic set-up experience etc.
Apache Livy is a service that enables easy interactions with the Spark cluster over the REST interface. Prior to today’s launch, customers when running their batch or interactive workloads from their local environment over a REST interface were required to either use the StartJobRun API or Interactive endpoints. This resulted in customers required to make changes to their applications. Now, with today’s launch, we have simplified the experience where customers can easily create a Livy endpoint and use that endpoint to submit Apache Spark jobs to their Amazon EMR on EKS clusters over a REST interface. Additionally, for enhanced security, customers can also restrict access to the Livy endpoint by configuring authentication through one of the supported protocols such as Kerberos, Custom Auth.
To learn more and get started, please visit our Apache Livy section [documentation](https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/job-runs-apache-livy.html). Amazon EMR on EKS with Apache Livy is available with the EMR 7.1 release in the regions where Amazon EMR on EKS is [currently available](https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/service-quotas.html).
What else is happening at Amazon Web Services?
Amazon AppStream 2.0 users can now save their user preferences between streaming sessions
December 13th, 2024
Services
Share
AWS Elemental MediaConnect Gateway now supports source-specific multicast
December 13th, 2024
Services
Share
Amazon EC2 instances support bandwidth configurations for VPC and EBS
December 13th, 2024
Services
Share
AWS announces new AWS Direct Connect location in Osaka, Japan
December 13th, 2024
Services
Share
Amazon DynamoDB announces support for FIPS 140-3 interface VPC and Streams endpoints
December 13th, 2024
Services
Share