AliGraph：大规模图神经网络系统架构剖析（22页）——基于图神经网络认知的智能计算专场.pdf

《AliGraph：大规模图神经网络系统架构剖析（22页）——基于图神经网络认知的智能计算专场.pdf》由会员分享，可在线阅读，更多相关《AliGraph：大规模图神经网络系统架构剖析（22页）——基于图神经网络认知的智能计算专场.pdf（22页珍藏版）》请在三个皮匠报告上搜索。

1、AliGraph:?赵 昆?Analysis of Large-scale GNN System Architecture Based on AliGraphContents01目录AliGraph?02?AliGraph平台简介AliGraph Overview01PAI：阿里巴巴机器学习平台Platform of Artificial Intelligence in AlibabaPAI机器学习平台特性Features of PAI?https:/ of GNNGNNGNN低=向量空间低=向量空间G=(V,E G=(V,E V V=V)rt)x E=E(g)=V)rt)x E=E(g)N

2、N)ura,)ura,N)tworkN)twork实践中的挑战Challenges in Practice数据不规则稀疏性，非结构化，属性同构，异构，有向，无向DataCleaner规模巨大千亿边、百亿点样本指数级膨胀?TB?CPU?计算难扩展图算子种类变化多无法结合深度学习?用AD望：一体化G决方EUsers Expect Solutions from Data to Model for GNNA APPPPGNN AlgorithmsGraph&TensorGraph&TensorEngineGraph DataGraph DataLarge-s-ale&omogeneous&eterog

3、eneous Attri,utedAliGraph：云上的“图+深度学+”平台A GNN Platform on Alibaba Cloud?Industry Level?PB?End to End?IDE?For Research and Production系统架构与核心技术System Architecture and Key Technologies02GNN编程范式GNN Programming Paradigmhop=1hop=21.Sampling2.Vectorization3.Aggregate4.CombineVertex IdVertex AttributesEdge A

4、ttributesEdge IdAggregate outputVertex outputV1V2E1E2V0一体化系统实现An Integrated System Implementation for GNNServer 0Server Server 2Server nTensor EngineGraph EngineData BridgePythonTensorFlow&PyTorchGraph QuerySamplerAggregatorCombinerLarge-scaleHeterogeneousAttributedGNNRPCFriendlyFlexibleRobustEffect

5、ive简洁的用户接4Laconic User Interface点3相2g=Graph()g.add_nodes(“node_source”,“node_format”).add_edges(“edge_source”,“edge_format”).init().2.3.4.Graph B1ildi.gg.V(“user”).shuffle().batch(512).outE(“user-click-item”).sample(10).by(“edge_weight”).run().2.3.4.Graph Sampli.g高效的图构建过程Effective Graph Building SER

6、VER iData QueueData QueueData QueueLocalPROCESSINGTHREADPROCESSINGTHREADPROCESSINGTHREADData QueueData QueueData QueuePROCESSINGTHREADPROCESSINGTHREADPROCESSINGTHREADLOADING THREADRPCRPCLocalLOADING THREADLOADING THREADRPCRPCSERVERjLOADING THREADBatch Reading