Maintained with ☕️ by
IcePanel logo

Serverless for Apache Spark: Runtime version 3.0 is now generally available

Share

Services

## Announcement Announcement **Serverless for Apache Spark:** Runtime version [3.0](https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-release-3.0) is now generally available. This version simplifies onboarding, improves reliability, reduces startup latency, and adds support for Spark 4.0. * Features and improvements: * Regional and multi-zonal workloads are used by default to increase obtainability of compute resources * Faster startup than previous runtimes * Fast resource cleanup that allows faster release of VPC IPs after workload completion * End-user credentials are used for all workloads by default * New `bigquery` Spark catalog, pre-configured for out-of-the-box BigQuery native table interactions * New Spark Serverless-specific IAM roles * New `dataproc-rm.googleapis.com` API enablement is required