Column-level lineage for Dataproc is generally available (GA)
Share
Services
## Feature
Feature
Column-level lineage for Dataproc is generally available ([GA](https://cloud.google.com/products#product-launch-stages)). This feature enables you to track the flow of data between individual columns in BigQuery, BigLake external tables, Cloud Storage buckets, and other resources as reported by Dataproc clusters and Serverless for Apache Spark. For more information, see [About data lineage](https://docs.cloud.google.com/dataplex/docs/about-data-lineage).
## Feature
Feature
The Data Lineage API is now updated with the following changes:
* The `SearchLinks` method accepts multiple source and target entity references as search criteria.
* Added support for column-level lineage information to be passed and returned from the service.
* Process resources now report Dataflow as their origin if it is used to generate lineage.
For more information, see the Data Lineage API reference for[REST](https://docs.cloud.google.com/dataplex/docs/reference/data-lineage/rest)and [RPC](https://docs.cloud.google.com/dataplex/docs/reference/data-lineage/rpc).
What else is happening at Google Cloud Platform?
Read update
Services
Share
Read update
Services
Share
The AI.DETECT_ANOMALIES function supports calling the function with a single input table that holds both the
about 5 hours ago
Services
Share
Backup and DR Service now supports customer-managed encryption keys (CMEK) for Cloud SQL enhanced backups
about 21 hours ago
Services
Share
Read update
Services
Share