当前位置:首页 > 报告详情

Merlin : GPU 加速的推荐系统框架.pdf

上传人: li 编号:29557 2021-02-07 40页 1.71MB

1、NVIDIAMerlin:AGPUAcceleratedRecommendation Framework王泽衰(Joey Wang),Dec 17th 2020#page#Industrial Recommendation ChallengesFeatureDataloadingScaling TrainingDeploymentEngineeringTabular data scalesThe path to productionIterating over featureEmbedding tablesfrom research ispoorly using thedont fit eas

2、ily on GPUcombinations takescommon deep learningcomplex and requiresmethod of item bylonger than training.andare hard to scale.significant engineeringitemeffort.#page#Merlin Recommendation FrameworkTritonNVTabularHugeCTRFeatureDataloadingScaling TrainingDeploymentEngineeringInference time dataPrepar

3、e massiveEasy to use data andtransformsand multidatasets in minutesAsynchronous batchmodel support providemodel parallel trainingallowing for moredataloading means theallow you to scale tomaximumthroughputexploration and betterGPU is always utilizedTB sized embeddingswithlatencymodels.constraints#pa

4、ge#Merlin is in Open Beta!NVIDIA MERLIN OPEN BETADemocratizing Large-Scare Deep Learning RecommendersOpen SourceETLDATATRAININGINFERENCELOADEREasy to Use01000010GPU AcceleratedHugeCTRNVTabulaNVTabiBillions)TensorflowEnd to EndOPyTorchEWBEDCINSSUser QueryRAPIDSRAPIDSCUDNNTritonDATALAKE#page#NVTabular

5、GPU Accelerated ETL#page#The average data scientist spends 75% of their time in ETLas opposed to training modelstart ETLrs03Lmrestart ETLeh,forgottoadd afeatur1212/test model113orkflowgetacoffeegetacof8repeaCPUGPUPOWEREDPOWEREDWORKFLOWWORKFLOWdatasetcollectionFIngUneanalysisovemightETLovernightresta

6、rtETLworkflowagaintraininferencestaylateontiime#page#NVTabular: Recommender System ETL on GPUhttps:/ Transforms accelerated on GPUFully compatible with (and built upon!) the RAPIDS ecosystem CDask-cuDF)No limit on dataset size (not bound by GPU or CPU memory)A Higher level abstraction- What you want

word格式文档无特别注明外均可编辑修改,预览文件经过压缩,下载原文更清晰!
三个皮匠报告文库所有资源均是客户上传分享,仅供网友学习交流,未经上传用户书面授权,请勿作商用。
本文主要介绍了NVIDIA的Merlin和NVTabular框架,以及HugeCTR和Triton Inference Server的相关内容。 1. Merlin是一个推荐系统框架,可加速工业界的推荐系统挑战,如特征组合迭代和模型训练。NVTabular是用于处理大规模表格数据的GPU加速ETL框架,可简化数据科学家和机器学习工程师的工作。 2. HugeCTR是一个高效的GPU框架,专门用于点击通过率(CTR)估计的训练。它在MLPerf v0.7基准测试中取得了最快的系统性能,比Tensorflow快114倍,比单个V100 GPU快8.3倍。 3. Triton Inference Server是一个开源软件,用于扩展和简化推理服务,支持多种模型框架和硬件平台。它可最大化GPU的实时推理性能,并易于部署和管理。 4. 文章还提到了一些关键数据,如NVTabular在ETL阶段比CPU快80倍,在GPU训练阶段比CPU快1.6倍,比Tensorflow快20倍,比PyTorch快50倍。HugeCTR在Criteo 1TB广告数据集上的训练时间从4小时缩短到44分钟。 总之,本文主要介绍了NVIDIA在推荐系统和相关技术领域的一些创新和成果,包括Merlin、NVTabular、HugeCTR和Triton Inference Server,以及它们在实际应用中的优势和性能数据。
"GPU加速推荐框架Merlin有哪些特点?" "如何使用NVTabular进行高效的数据预处理和转换?" "HugeCTR在推荐系统训练中有什么优势?"
客服
商务合作
小程序
服务号
折叠