SNIA-SDC23-Touretsky-Beyond-S3-Compatibility-Claims-A-Deep-Dive-into-Real-World-Incompatibilities.pdf

1、1|2023 SNIA.All Rights Reserved.Virtual ConferenceSeptember 28-29,2021Beyond S3 Compatibility ClaimsA Deep Dive into Real-World IncompatibilitiesGregory Touretsky,Seagate2|2021 Storage Developer Conference.Insert Company Name Here.All Rights Reserved.Is 100%compatibility with Amazon S3 just a myth?L

2、ets find outThe fine print of S3 compatibility:What vendors wont tell you3|2023 SNIA.All Rights Reserved.Amazon S3280 Trillion objects100M requests per second4B checksum calculations per second4|2023 SNIA.All Rights Reserved.Amazon S3 API90+Amazon S3 Actions60+Amazon S3 Control ActionsIAM,STS Action

3、s5|2023 SNIA.All Rights Reserved.S3-Compatible StorageSystems and Software.Cloud Services6|2023 SNIA.All Rights Reserved.Official Incompatibilities7|2023 SNIA.All Rights Reserved.Protocol Compliance Tools Home-grown 3rd party applications https:/ https:/ https:/ https:/ Mint testsMinio0Backblaze B21

4、4Google Cloud Storage S315AWS S312Is Minio more S3-compatible than Amazon S3?8|2023 SNIA.All Rights Reserved.What Is Behind the Endpoint?aws s3 ls-debug|&grep Response headers|awk-F Server print$2SolutionServer HeaderAmazon S3AmazonS3Google Cloud Storage(S3 compatible)UploadServerCeph-MinioMinIOWasa

5、biWasabiS3/7.12.1004-2023-02-17-7ff2f5bdd9(head07)Seagate Lyve CloudSeagate-LyveCloudS3Backblaze B2-9|2023 SNIA.All Rights Reserved.What Is in the Request?Example:UploadPartComponentExampleMethodPUTBucketmybucketHostus-east- Keymyprefix/myobjectpartNumber12uploadId2e1c42be-fc1d-4055-bbce-d10a55a0a66

6、2authorizationAWS4-HMAC-SHA256 Credential=REDUCTED/20230418/us-east-1/s3/aws4_request,SignedHeaders=content-length;host;user-agent;x-amz-content-sha256;x-amz-date,Signature=61b9391bc68984f634db8437779e76a8f609a5823b3ea0ac00a3df48e431d59cuser-agentAPN/1.0 Qumulo/1.0 S3Replication/6.0.210|2023 SNIA.Al