AWS Glue Data Quality now supports distribution statistics for data profiling
Share
Services
AWS Glue Data Quality now supports a new Distribution Analyzer that generates frequency distribution profiles for your data. Using this new Distribution Analyzer in the Data Quality Definition Language (DQDL), you can generate histograms for numeric columns and value distributions for categorical, date, and boolean columns. With support for custom bin counts, you can explore the shape and patterns of your data at the granularity that matters most to your use case.
Understanding how data is distributed is foundational to building reliable data pipelines. Distribution statistics help you quickly identify skewness, outliers, and unexpected patterns across your datasets, without writing custom code. The capability integrates directly with your existing DQDL rulesets, so you can add distribution profiling alongside your current data quality checks in a single evaluation run. Distribution statistics are stored in Amazon S3 for future querying through services like Amazon Athena, and are also surfaced through APIs, making it easy to integrate distribution insights into monitoring workflows and visualization tools, including SageMaker Unified Studio.
AWS Glue Data Quality distribution statistics are available in all AWS commercial regions and AWS GovCloud (US) regions.
To learn more about Glue Data Quality, visit the [AWS Glue Data Quality documentation](https://docs.aws.amazon.com/glue/latest/dg/glue-data-quality.html). To get started with using Distribution Analyzer, visit the [Analyzers documentation](https://docs.aws.amazon.com/glue/latest/dg/dqdl.html#dqdl-analyzers).
What else is happening at Amazon Web Services?
Read update
Services
Share
Amazon CloudFront now supports Origin Access Control (OAC) for Amazon S3 Multi-Region Access Points
about 19 hours ago
Services
Share
Amazon EKS now supports certificate authority (CA) rotation with automated lifecycle management
about 19 hours ago
Services
Share
Read update
Services
Share
Generative AI Inference Recommendation for Amazon SageMaker now available in the SageMaker AI Studio
about 20 hours ago
Services
Share
Amazon Redshift introduces long-term system table retention with Amazon S3 Tables integration
about 23 hours ago
Services
Share