Maintained with ☕️ by
IcePanel logo

New Dataproc on Compute Engine subminor image versions 2.0.158-debian10, 2.0.158-ubuntu18, 2.0.158-rocky8

Share

Services

## Announcement Announcement New [Dataproc on Compute Engine subminor image versions](https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions): * 2.0.158-debian10, 2.0.158-ubuntu18, 2.0.158-rocky8 * 2.1.107-debian11, 2.1.107-ubuntu20, 2.1.107-ubuntu20-arm, 2.1.107-rocky8 * 2.2.75-debian12, 2.2.75-ubuntu22, 2.2.75-ubuntu22-arm, 2.2.75-rocky9 * 2.3.22-debian12, 2.3.22-ml-ubuntu22, 2.3.22-rocky9, 2.3.22-ubuntu22, 2.3.22-ubuntu22-arm ## Feature Feature Parquet CLI version upgraded to 1.15.2 in 2.1 and 2.2 images. ## Feature Feature Delta subminor version upgraded to 3.2.1 in Dataproc on Compute Engine image 2.2 and 2.3. ## Feature Feature Apache Pig is now available in ARM images. ## Feature Feature Added a new `dataproc:pypi.repository` property to customize the PyPI repository used for pip. The value can be a URL, or `google` to use a Google-hosted cache of PyPI, accessible without public internet connectivity. Starting in image version 3.1, `google` will be the default; to opt out and return to public PyPI, use the value `pypi`. ## Change Change Removed use of deprecated Hadoop configuration properties `fs.default.name` and `yarn.resourcemanager.system-metrics-publisher.enabled`. ## Fix Fixed Fixed a bug in the ARM image that prevented connecting to a Dataproc Metastore instance with a gRPC protocol endpoint. ## Fix Fixed Fixed the `spark.driver.extraClassPath` delimiter for the Jupyter SparkMonitor Listener.