代立冬-新一代超高性能的大数据集成工具 - Apache SeaTunnel.pdf

1、新一代超高性能的大数据集成工具 Apache SeaTunnel演讲人：代立冬(David)CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 202

2、3关关于于我我白鲸开源联合创始人Apache 基金会正式成员Apache 孵化器导师Apache SeaTunnel PMCApache DolphinScheduler PMC ChairApacheCon Asia 2022/2023 大数据论坛主席代立冬(David Zollo)CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023Core

3、JavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CONTENT目录01数据集成的痛点02SeaTunnel 功能与架构03用户案例04发展规划CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023Co

4、reJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023数据集成的痛点1CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJ

5、avaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023数据源多达几百种，版本间不兼容，而且不断有新的出现频繁读取 binlog 对数据源端影响大大事务、Schema 变更影响下游低吞吐高时延导致数据无法及时到达离线同步和实时同步常被分开管理，维护困难数据割接人工进行数据丢失与重复，无法一致性出现问题无法回滚或者断点继续执行同步过程不透明，缺少监控企业数据集成面临的问题CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWee

6、k 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 2023CoreJavaWeek 20236Apache SeaTunnel 简介2023 年 6 月 1 日正式成为 Apache 顶级项目。首个国人主导的数据集成项目每天可以稳定高效同步万亿级数据，已在数百家公司生产上使用Next-generation high-performance