构建侧翼实时管道.pptx

1、 2024 Cloudera,Inc.All rights reserved.Building Real-Time Pipelines With FLaNKTim SpannPrincipal Developer AdvocateMay 8,2024 2024 Cloudera,Inc.All rights reserved.B102:Enabling Real-Time AnalyticsWednesday,May 08 202412:00 p.m.-12:45 p.m.Real-time analytics contributes to building scalable and faul

2、t-tolerant data processing pipelines.Building Real-Time Pipelines With FLaNKTimothy Spann,Principal Developer Advocate-ClouderaThe combination of Apache Flink,Apache NiFi,and Apache Kafka for building real-time data processing pipelines is extremely powerful,as demonstrated by this case study using

3、the FLaNK-MTA project.The project leverages these technologies to process and analyze real-time data from the New York City Metropolitan Transportation Authority(MTA).FLaNK-MTA demonstrates how to efficiently collect,transform,and analyze high-volume data streams,enabling timely insights and decisio

4、n-making.2024 Cloudera,Inc.All rights reserved.3Tim SpannTwitter:PaasDev /Blog:datainmotion.devPrincipal Developer Advocate.Princeton/NYC Future of Data Meetup.ex-Pivotal,ex-Hortonworks,ex-StreamNative,ex-PwC,ex-HPE,ex-E&Y.https:/ https:/ 2024 Cloudera,Inc.All rights reserved.4PaasDevhttps:/ Big Dat

5、a to AI to Streaming to Containers to Cloud to Analytics to Cloud Storage to Fast Data to Machine Learning to Microservices to.Future of Data-NYC+NJ+Philly+Virtual 2024 Cloudera,Inc.All rights reserved.5This week in Apache NiFi,Apache Flink,Apache Kafka,ML,AI,Apache Spark,Apache Iceberg,Python,Java,

6、LLM,GenAI,Vector DB and Open Source friends.https:/bit.ly/32dAJfthttps:/ Stack Weekly by Tim Spann 2024 Cloudera,Inc.All rights reserved.6https:/ Join Our Slack and Interact with LLM 2024 Cloudera,Inc.All rights reserved.AGENDAIntroduction to FLaNK AIThe World of the RealOverviewApache NiFi,Kafka,Fl