SNIA-SDC23-Etikyala-Inside-the-Cloud-A-Dive-Deep-into-Cold-Data-Archiving.pdf

1、1|2023 SNIA.All Rights Reserved.Virtual ConferenceSeptember 28-29,2021Inside the cloud:A Dive Deep into Cold Data ArchivingVikranth EtikyalaSenior Staff Software Engineer,SoFi2|2023 SNIA.All Rights Reserved.Compute Growth3|2023 SNIA.All Rights Reserved.Storage GrowthSource:Precedence Reserach Dec 20

2、224|2023 SNIA.All Rights Reserved.ZetaByte1.0 ZB1,000 EB1,000,000 PB1,000,000,000 TB1,000,000,000,000 GB1,000,000,000,000,000 MB 55,000,000 LTO-9 tapes or 18.0 TB HDDs5|2023 SNIA.All Rights Reserved.Cold DataInfrequently accessedNot required real timeLower priority Older or historical data6|2023 SNI

3、A.All Rights Reserved.Why so Cold?Regulatory Compliance-BanksAudit and Legal-GovernmentsHistorical Records-Genomic DataDisaster Recovery-Backup and RestoreAI/ML Models-ChatGPTMissing or Deleted Data will most likely be the data you need7|2023 SNIA.All Rights Reserved.Cold Data-Archival and BenefitsC

4、ostScalabilityPerformance8|2023 SNIA.All Rights Reserved.Archival Solutions on CloudAWS S3-Glacier Azure Archive StorageGoogle Cloud Storage Oracle Archive StorageIBM Cloud Object Storage9|2023 SNIA.All Rights Reserved.Cloud Archival Benefits-First Order ServerlessScalable and ElasticNative Cloud In

5、tegrationsLifecycle-Auto Transition to Archives-AI/ML,Date BasedSecurity Service Level Agreements10|2023 SNIA.All Rights Reserved.Cloud Archival Benefits-Second Order Data Center Management-Host,Racks,Temperature Energy-Carbon FootprintCapacity ManagementOperations TeamDistributed System ProblemsSto

6、rage Media Advancements11|2023 SNIA.All Rights Reserved.Example:S3 Scale12|2023 SNIA.All Rights Reserved.Access PatternsLower cost storage is slowReads and Writes are asyncStaging-WritesRestores-Reads Prefer large objects for restore performance-Part UploadEve