Amazon Kinesis 数据流底层原理.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.A N T 4 2 3Amazon Kinesis Data Streams under the hoodJohn MorkelDirector,Software DevelopmentAmazon Web Services(AWS)Ali AlemiPr.Data Streaming ArchitectAmazon Web S

2、ervices(AWS)2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.AgendaIntroducing Amazon Kinesis Data StreamsCommon customers asksNew featuresDemoKinesis Streams under the hood 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affil

3、iates.All rights reserved.Introducing Amazon Kinesis Data Streams 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Amazon Kinesis Data StreamsFully managed,serverless streaming data serviceCollect,process and analyze real-time data streamsServerless,Scale&Elasticity,Secure&High Ava

4、ilable 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Amazon Kinesis Data StreamsManaged Service for Apache FlinkAmazonData FirehoseSpark on EMRAmazon EC2AWS LambdaINPUTCapture and send data to Amazon Kinesis Data StreamsKinesis Data StreamsIngests and stores data streams for pro

5、cessingOUTPUTAnalyze Streaming data using your favorite BI tools 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Amazon Kinesis Data StreamsPrime DayPeak of 807 M/secondEvery Day3.4+million streams=70PBLargest streams10 GB/second 2025,Amazon Web Services,Inc.or its affiliates.All

6、rights reserved.GB/s of data ingestGB/s data fan outMillions of records per secondA multi-tenant environmentSingle Kinesis StreamHighly elastic streaming storage 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.4 Pillars of Kinesis StreamsElasticDynamically scalable data ingestion