= AWS/Kinesis = * Streaming fully managed service provided and run by AWS, only pay for use. * It retains data for 24h by default can increase up to couple of days == Shards == * Records collected in shard (group of records) * Shard states [ OPEN, CLOSED, EXPIRED] * One shard capacity 1MB/s in, 2MB/s out, 1000Put/s * Records in shard limited to 1MB == Retrieve data from Kinesis shards == * API * Kinesis Client Library - The [[https://docs.amazonaws.cn/en_us/streams/latest/dev/shared-throughput-kcl-consumers.html|KCL]] is a Java library * [[https://docs.aws.amazon.com/apigateway/latest/developerguide/integrating-api-with-aws-services-kinesis.html|Kinesis + ApiGW]] == Links == * https://docs.aws.amazon.com/streams/latest/dev/kinesis-using-sdk-java-after-resharding.html#kinesis-using-sdk-java-resharding-data-routing * https://docs.aws.amazon.com/sdk-for-javascript/v2/developer-guide/kinesis-examples-capturing-page-scrolling-full.html