Maintained with ☕️ by
IcePanel logo

New Dataproc Serverless for Spark runtime versions 1.1.56 1.2.0

Share

Services

## Announcement New [Dataproc Serverless for Spark runtime versions](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions): * 1.1.56 * 1.2.0 * 2.0.64 * 2.1.43 * 2.2.0 ## Announcement Announcing the [General Availability (GA)](https://cloud.google.com/products#product-launch-stages) release of Dataproc Serverless for Spark runtime versions [1.2](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions#spark%5Fruntime%5Fversion%5F12) and [2.2](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions#spark%5Fruntime%5Fversion%5F22), which include the following components: * Spark 3.5.1 * BigQuery Spark Connector 0.36.1 * Cloud Storage Connector 3.0.0 * Conda 24.1 * Java 17 * Python 3.12 * R 4.3 * Scala 2.12 (1.2 runtime) and Scala 2.13 (2.2 runtime) ## Change **Dataproc Serverless for Spark:** * Upgraded Spark to version [3.5.1](https://spark.apache.org/releases/spark-release-3-5-1.html) in the latest [1.2](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions#spark%5Fruntime%5Fversion%5F12) and [2.2](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions#spark%5Fruntime%5Fversion%5F22) runtimes. * Upgraded Conda to version [24.1](https://github.com/conda/conda/releases/tag/24.1.2) in the latest [1.2](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions#spark%5Fruntime%5Fversion%5F12) and [2.2](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions#spark%5Fruntime%5Fversion%5F22) runtimes. * Upgraded Spark BigQuery connector to version [0.36.1](https://github.com/GoogleCloudDataproc/spark-bigquery-connector/releases/tag/0.36.1) in the latest [1.2](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions#spark%5Fruntime%5Fversion%5F12) and [2.2](https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-versions#spark%5Fruntime%5Fversion%5F22) runtimes.