Kinesis Client Library now enables multi-stream processing
Share
Services
You can now process multiple Amazon Kinesis data streams with a single [Kinesis Client Library](https://github.com/awslabs/amazon-kinesis-client) (KCL) based consumer application. Previously, each KCL based application processes a single Kinesis data stream. With this new capability, you can update the list of streams at runtime for multi-stream processing in a scalable KCL application without redeploying the application. This reduces operational overhead of maintaining multiple KCL applications.
KCL helps you quickly build custom stream consumer applications that you can run in either Amazon EC2 or containers on Amazon ECS or EKS. KCL enables you to focus on business logic while building applications. It handles complex issues such as adapting to changes in stream volume, load-balancing streaming data, coordinating distributed services, and processing data with fault-tolerance. You need to use the latest KCL version 2.3.1 to enable multi-stream processing with your KCL consumer application.
[Amazon Kinesis Data Streams](/kinesis/data-streams/) is a massively scalable and durable real-time data streaming service. It can continuously capture gigabytes of data per second from hundreds of thousands of sources like website clickstreams, IoT data, database event streams, financial transactions, social media feeds, IT logs, and location-tracking events. The data collected is available in milliseconds for real-time analytics use cases like dashboards, anomaly detection, dynamic pricing, and more.
For more information, refer to [Using Kinesis Client Library](https://docs.aws.amazon.com/streams/latest/dev/shared-throughput-kcl-consumers.html) in the Amazon Kinesis Data Streams Developer Guide. The latest KCL 2.3.1 release is available in all [AWS regions](/about-aws/global-infrastructure/regional-product-services/) where Amazon Kinesis Data Streams is available.
What else is happening at Amazon Web Services?
Amazon AppStream 2.0 users can now save their user preferences between streaming sessions
December 13th, 2024
Services
Share
AWS Elemental MediaConnect Gateway now supports source-specific multicast
December 13th, 2024
Services
Share
Amazon EC2 instances support bandwidth configurations for VPC and EBS
December 13th, 2024
Services
Share
AWS announces new AWS Direct Connect location in Osaka, Japan
December 13th, 2024
Services
Share
Amazon DynamoDB announces support for FIPS 140-3 interface VPC and Streams endpoints
December 13th, 2024
Services
Share