Maintained with ☕️ by
IcePanel logo

Dataproc - June 24th, 2020 [Change, Fix]

Share

Services

## Change New [subminor image versions](https://cloud.google.com/dataproc/docs/concepts/versioning/dataproc-versions#supported%5Fcloud%5Fdataproc%5Fversions): 1.2.100-debian9, 1.3.60-debian9, 1.4.31-debian9, 1.3.60-debian10, 1.4.31-debian10, 1.5.6-debian10, 1.3.60-ubuntu18, 1.4.31-ubuntu18, 1.5.6-ubuntu18, preview 2.0.0-RC2-debian10, and preview 2.0.0-RC2-ubuntu18. ## Change * **Image 2.0 preview**: * [SPARK-22404](https://issues.apache.org/jira/browse/SPARK-22404): set`spark.yarn.unmanagedAM.enabled` property to `true` on clusters where Kerberos is not enabled to run Spark Application Master in driver (not managed in YARN) to improve job execution time. * Updated R version to 3.6 * Updated Spark to [3.0.0 version](https://spark.apache.org/releases/spark-release-3-0-0.html) * **Image 1.5** * Updated R version to 3.6 ## Fix Fixed a quota validation bug where accelerator counts were squared before validation -- for example, previously if you requested 8 GPUs, Dataproc validated whether your project had quota for `8^2=64` GPUs.