AWS Glue Data Catalog now supports table optimization, statistics, and crawlers for Apache Iceberg V3
Share
Services
AWS Glue Data Catalog now supports table optimization, statistics, and crawlers for Apache Iceberg Version 3 (V3) tables. With these new capabilities, you can automatically maintain V3 tables, optimize them for query performance, and discover them in Amazon S3\. With table optimization, you can compact V3 tables using binpack, sort, or z-order strategies to improve query performance, and remove expired snapshots and orphan files to reduce storage costs. These optimizations support V3 data types, including variant, geospatial, and nanosecond-precision timestamps. You can also generate number of distinct values (NDV) statistics for V3 tables, which analytics engines use to plan queries efficiently. In addition, you can use Glue crawlers to discover V3 tables stored in Amazon S3 and register them in Glue Data Catalog, making them available to query with any V3-compatible engines. These capabilities are available for Iceberg V3 tables in all AWS Regions where Glue Data Catalog table optimization, statistics, and crawlers are available. To learn more, see [Glue Optimization](https://docs.aws.amazon.com/glue/latest/dg/table-optimizers.html), [Glue Statistics](https://docs.aws.amazon.com/glue/latest/dg/iceberg-column-statistics.html), and [Glue crawlers](https://docs.aws.amazon.com/glue/latest/dg/crawler-data-stores.html) in the Glue Developer Guide.
What else is happening at Amazon Web Services?
Amazon GuardDuty now supports centralized management using AWS Organizations declarative policies
about 5 hours ago
Services
Share
Amazon S3 Object Lock variable retention with event holds is now available in AWS GovCloud (US) Regions
about 8 hours ago
Services
Share
Read update
Services
Share
Announcing DNS analytics and insights for Route 53 Global Resolver and DNS Firewall
about 13 hours ago
Services
Share
Improve your secrets security posture with actionable recommendations in the AWS Secrets Manager console
about 14 hours ago
Services
Share