Stream date into Snowflake using Kinesis Data Firehose and Snowflake Snowpipe Streaming (Preview)
Share
Services
Amazon Kinesis Data Firehose (Firehose) now offers direct integration with Snowflake Snowpipe Streaming in preview. Firehose enables customers to reliably capture, transform, and deliver data streams into Amazon S3, Amazon Redshift, Splunk, and other destinations for analytics. With this new feature, customers can stream clickstream, application, and AWS service logs from multiple sources, including Kinesis Data Streams, to Snowflake. With a few clicks, customers can setup a Firehose stream to deliver data to Snowflake. Firehose automatically scales to stream gigabytes of data, and records are available in Snowflake within seconds.
Snowflake offers two options to load data into Snowflake tables: Snowpipe and Snowpipe Streaming. With Snowpipe, customers load data from files in micro-batches. This requires aggregating streams into batches, writing to interim storage, and then loading into Snowflake. This multi-step process introduces several minutes of latency, and higher cost. Snowpipe Streaming enables writing rows of data into tables. Through integration with Snowpipe Streaming, Firehose delivers streams record-by-record as soon as available, so data is available for querying in Snowflake within seconds. Thus, customers reduce cost, latency, and complexity of delivering streams into Snowflake.
Firehose integration with Snowflake is available in preview in the US East (N. Virginia), US West (Oregon), and Europe (Ireland) AWS Regions. To learn more and get started, visit Amazon Kinesis Data Firehose [documentation](https://docs.aws.amazon.com/firehose/latest/dev/what-is-this-service.html), [pricing](https://aws.amazon.com/kinesis/data-firehose/pricing/), and [console](https://console.aws.amazon.com/firehose/home). Preview features are provided for evaluation and testing, and should not be used in production systems. For terms and conditions, see Beta Service Participation in [AWS Service Terms](https://aws.amazon.com/service-terms/).
What else is happening at Amazon Web Services?
Amazon AppStream 2.0 users can now save their user preferences between streaming sessions
December 13th, 2024
Services
Share
AWS Elemental MediaConnect Gateway now supports source-specific multicast
December 13th, 2024
Services
Share
Amazon EC2 instances support bandwidth configurations for VPC and EBS
December 13th, 2024
Services
Share
AWS announces new AWS Direct Connect location in Osaka, Japan
December 13th, 2024
Services
Share
Amazon DynamoDB announces support for FIPS 140-3 interface VPC and Streams endpoints
December 13th, 2024
Services
Share