Apache Flink——从实时数据分析到实时人工智能.pdf

1、OriginCommunity GrowthDe-Facto StandardInnovation&Expansion200920192022202320242025Incubated Flink-Table-StoreFlink-Table-Store-ApachePaimonReal-Time Lake FormatAlibaba donatedFlink-CDC to ApacheFlinkApache Flink-2.0ReleaseAlibaba Acquired dataArtisans,donate Blink to Apache Flink dArenamed to Verve

2、ricaOriginated from TU Berlin,initially named StratosphereApache Paimon2014dataArtisans founded,donated Flink to ASFTheJourneyofApache Flink towardsDe-Facto Standard of Streaming ComputeKubernetesAPISQLJavaPythonUnified RuntimeStreamingBatchSinkApache Paimon Apache HudiApache IcebergDatabricks Delta

3、Apache DorisAlibaba MaxCompute&HologresStarRocksAWS RedshiftGCP BigqueryData LakeData WarehouseCloud Object StoreState MgmtOperational Data SystemAnalytical Data SystemAmazon AuroraIBM DB2MongoDBPostgreSQLMySQLMS SQL ServerOracleTiDBAlibaba PolarDBOceanbaseApache KafkaApache PulsarMessage QueueDatab

4、aseCDCApache Flink ThebackboneConnectingOperational&AnalyticalDataSystemApache Paimon(Real-Time Lake Format compatible with Iceberg)Data LakeBronzeSilverGoldenOLAPOnline QueryExternal DataSourcesDatabaseMessage QueueEnd-to-End Minutes LatencyStreaming LakehouseStreamingStreamingReal-TimeIngestionApa

5、che Flink Accelerating the Data Analytics on Lakehouse ArchitectureMake Business Decision in RealtimeBI ReportRecommendationCyber SecurityFraud DetectionDevice MonitoringAutopilotLogistics TrackingAnomaly DetectionDynamic PricingPostgres SQLChaotic Data SourcesTransactionsCommentsClicksImagesSignals

6、LikesInsightsStreamingData MovementStreamingData AnalyticsStreamingData ProcessingApache FlinkUsing Apache Flink for Real-Time Data Analytics and Business DecisionReal-Time Compute for Apache Flink(100%Compatible with Apache Flink,5X Faster by Flash Engine)BI ReportSearch&Ads&RecPrice MonitoringCybe