使用 Flink 和 OceanBase 构建实时数据仓库.pdf

1、Building a Real-Time Data Warehouse with Flink and OceanBaseDanny Higgins OceanBaseWhat is OceanBase?Trusted by 2,000+brands globally Cloud agnosticAlipay,Starbucks,T,GCash,DANA,Touch n Go,Haidilao,Taobao,ICBC Bank,VIVO,and more.Deployable on-premise,Cloud SaaS,and multi-cloud on AWS,Google Cloud,Al

2、ibaba Cloud,etc.14+years of certifications and benchmarking according to local and international standards with best-in-class,reliable disaster recovery.Developed in-house by Ant GroupDistributedTop 3 ranking globally for both TPC-C and TPC-H benchmarking in a single HTAP database Highly Scalable:10

3、00 nodes in one cluster Zero data loss(RPO=0),“always on”(RTO 15B USD)5/6 State-owned Banks(Asset Size 150B USD)Global BanksOceanBase in Other Industries3/3Telecom Service Providers70%Top Insurance CompaniesManufacturingTransportation&LogisticsInternet/Retail/A Story of Unprecedented Transaction Vol

4、umesThe scale of volume traffic we are handling in Alipay How many transactions per second does Alipay do on 11.11 Day?Peaks at 544,000 transactionsper second(TPS)61,000,000 queries per second(QPS)Chris Skinner,one of the most influential people in technologyHow many transactions per second can Visa

5、 do?Peaks at 64,000 transactionsper second(TPS)Testing result from https:/ Performance:61 million queries per second(QPS)1000NodesCluster Size:over 1,000 nodes in a single clusterAlipays Mission-Critical Workloads6PBData Volume:over 6 petabytes of data in one cluster690BrowsTable Size:single table w

6、ith more than 690 billion rows0RPODisaster Tolerance:Recovery Point Objective =0,Recovery Time Objective 8 seconds for all mission-critical applications 8RTOTradeAccountingCustomer Information(CIF)PaymentReal-time DataOceanBase AlipaySupporting all mission-critical workloads at Alipay Gartner Insigh