《06-云邪演讲A Deep Dive into Flink SQL - Jark Wu_compressed.pdf》由会员分享,可在线阅读,更多相关《06-云邪演讲A Deep Dive into Flink SQL - Jark Wu_compressed.pdf(34页珍藏版)》请在三个皮匠报告上搜索。
1、A Deep Dive into Flink SQL Jark Wu Software Engineer at Alibaba Apache Flink Committer & PMC member Flink SQL Architecture Content CONTENT How Flink SQL Works? Flink SQL Optimizations Summary and Futures This is joint efforts with entire Apache Flink community! Architecture before Architecture befor
2、e FlinkFlink 1.91.9 Does this look unified? A Step CloserA Step Closer Different APIs for streaming and batch Different translation path Different codes for streaming and batch What we want Future ArchitectureFuture Architecture Flink Task Runtime Planner Table API & SQL Stream Transformation Stream
3、 Operator stream & batch Architecture since Architecture since FlinkFlink 1.9+1.9+ Flink Task Runtime Blink Planner Table API & SQL Stream Transformation Stream Operator Flink Planner DataSet Driver stream & batchbatchstream How Flink SQL Works ? How Flink SQL Works? SQL Table API Logical PlanPhysical PlanTransformationsJobGraph Configurable optimizer phases Catalog Hive Metastore Code Generation