Maintained with ☕️ by
IcePanel logo

New Dataproc on Compute Engine subminor image versions 2.0.156-debian10, 2.0.156-ubuntu18, 2.0.156-rocky8

Share

Services

## Announcement Announcement New [Dataproc on Compute Engine subminor image versions](https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions): * 2.0.156-debian10, 2.0.156-ubuntu18, 2.0.156-rocky8 * 2.1.105-debian11, 2.1.105-ubuntu20, 2.1.105-ubuntu20-arm, 2.1.105-rocky8 * 2.2.73-debian12, 2.2.73-ubuntu22, 2.2.73-ubuntu22-arm, 2.2.73-rocky9 * 2.3.20-debian12, 2.3.20-ml-ubuntu22, 2.3.20-rocky9, 2.3.20-ubuntu22, 2.3.20-ubuntu22-arm ## Feature Feature Added a new property `dataproc:pypi.repository` to customize the PyPI repository used for pip. The value can be a URL, or `google` to use a Google-hosted cache of PyPI, accessible without public internet connectivity. Starting in image version 3.1, `google` will be the default; to opt out and return to public PyPI, use the value `pypi`. ## Change Change Removed use of deprecated Hadoop configuration properties `fs.default.name` and `yarn.resourcemanager.system-metrics-publisher.enabled`. ## Fix Fixed Fixed the `spark.driver.extraClassPath` delimiter for the Jupyter SparkMonitor Listener.