当前位置:首页 > 报告详情

9-(线上)陈航-借助Flink与Pulsar, BIGO-已美化-TY-已定稿_compressed.pdf

上传人: li 编号:29316 2021-02-07 26页 1.23MB

1、BIGO builds real-time message processing system based on Pulsar and Flink Chen Hang | BIGO Staff Engineer About BIGO Powered by Big Data and Artificial Intelligence technology, BIGOs video-based products and services have gained immense popularity, with users in more than 150 countries. BIGO Live (L

2、ive Streaming) https:/www.bigo.tv/ Likee(Short-from Video) https:/ Bigo Live is available in more than 150 countries Likee has more than 100 million users and is popular among the Generation Z. About Me - BIGO Staff Engineer - Apache Pulsar Committer - Apache Bookkeeper Contributor - StreamNative/Pu

3、lsar-Flink-Connector Contributor The Role of Apache Pulsar In BIGO #2 Why BIGO Choose Apache Pulsar #1 BIGO builds real-time message processing system based on Pulsar and Flink #3 Future Works #4 Why BIGO Choose Apache Pulsar#1 Why BIGO Choose Apache Pulsar In the past few years, BIGOs message platform, which used to support live streaming and short-form video recommendation, is composed of multip

word格式文档无特别注明外均可编辑修改,预览文件经过压缩,下载原文更清晰!
三个皮匠报告文库所有资源均是客户上传分享,仅供网友学习交流,未经上传用户书面授权,请勿作商用。
BIGO是一家利用大数据和人工智能技术的公司,其视频产品和服务在全球150多个国家拥有用户。BIGO Live和Likee是该公司的两个主要产品,分别提供实时直播和短视频分享功能。BIGO的的消息平台原采用多个开源Apache Kafka集群,但在用户数量激增后,面临着数据量增加、系统稳定性、可扩展性和低延迟消息处理需求等挑战。因此,BIGO转向使用Apache Pulsar和Flink构建实时消息处理系统,Pulsar提供了水平可扩展性、低延迟和高性能等特点。BIGO在Pulsar上进行了研究和压力测试,并在2019年11月到2020年5月期间逐步将应用迁移到Pulsar集群。BIGO还开发了与Flink集成的Pulsar连接器,用于实时ETL和AB测试。未来,BIGO计划继续优化Pulsar和Apache Bookkeeper的性能,推动更多应用迁移到Pulsar,并探索Pulsar在批处理和流处理方面的应用。
BIGO如何选择Apache Pulsar? Apache Pulsar在BIGO中的作用和性能优化? BIGO基于Pulsar和Flink构建实时消息处理系统的未来计划是什么?
客服
商务合作
小程序
服务号
折叠