Kinesis Data Stream


Stream Shards

Kinesis API (Put Records)

01 Kinesis Stream

02 Kinesis Firehose

03 Kinesis Data Analytics

Firehose Vs Streams




Enables increase or decrease of the number of shards in the stream.

We can increase instance size and shards number to handle more data.

Kinesis Client Library (KCL)

In instances, used to process data from data stream. There should be same number of kcl as well as the ec2 instances as the number of open shards.

To process data, if we make use of the lambda functions, to get optimal performance, need to have same number of concurrent lambda function same as the shard number.

Enhanced Fan Out

Enabled shards get data 2MB/s per shard with 70s propagation delay to all consumers.