New Dataproc on Compute Engine subminor image versions 2.0.158-debian10, 2.0.158-ubuntu18, 2.0.158-rocky8
Share
Services
## Announcement
Announcement
New [Dataproc on Compute Engine subminor image versions](https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions):
* 2.0.158-debian10, 2.0.158-ubuntu18, 2.0.158-rocky8
* 2.1.107-debian11, 2.1.107-ubuntu20, 2.1.107-ubuntu20-arm, 2.1.107-rocky8
* 2.2.75-debian12, 2.2.75-ubuntu22, 2.2.75-ubuntu22-arm, 2.2.75-rocky9
* 2.3.22-debian12, 2.3.22-ml-ubuntu22, 2.3.22-rocky9, 2.3.22-ubuntu22, 2.3.22-ubuntu22-arm
## Feature
Feature
Parquet CLI version upgraded to 1.15.2 in 2.1 and 2.2 images.
## Feature
Feature
Delta subminor version upgraded to 3.2.1 in Dataproc on Compute Engine image 2.2 and 2.3.
## Feature
Feature
Apache Pig is now available in ARM images.
## Feature
Feature
Added a new `dataproc:pypi.repository` property to customize the PyPI repository used for pip. The value can be a URL, or `google` to use a Google-hosted cache of PyPI, accessible without public internet connectivity. Starting in image version 3.1, `google` will be the default; to opt out and return to public PyPI, use the value `pypi`.
## Change
Change
Removed use of deprecated Hadoop configuration properties `fs.default.name` and `yarn.resourcemanager.system-metrics-publisher.enabled`.
## Fix
Fixed
Fixed a bug in the ARM image that prevented connecting to a Dataproc Metastore instance with a gRPC protocol endpoint.
## Fix
Fixed
Fixed the `spark.driver.extraClassPath` delimiter for the Jupyter SparkMonitor Listener.
What else is happening at Google Cloud Platform?
You can now enable automatic server certificate rotation for your Cloud SQL instance
about 1 hour ago
Services
Share
You can now enable automatic server certificate rotation for your Cloud SQL instance
about 1 hour ago
Services
Share
You can now enable automatic server certificate rotation for your Cloud SQL instance
about 1 hour ago
Services
Share
Read update
Services
Share