刘威-LLM在eBay风控RCA中的应用实践.pdf

1、刘威 eBay高级技术专家eBay 风控部门高级技术专家。曾先后主导了eBay风控实时RCA平台，风控地址标准化与模糊匹配服务，以及高并发高可用风控名单管理系统的设计与开发工作，负责多个eBay风控决策引擎核心组件的设计，开发与维护，具有丰富的高性能系统架构设计的工程经验。此外，在知识图谱与风控决策引擎的集成，大语言模型在风控领域的应用等方向具有深厚的技术积累与丰富的实践经验。演讲主题：LLM在eBay风控RCA中的应用实践Empower Risk RCA with LLMLiu,Wei eBay Payments&RiskeBay Risk RCARCA Engine 1.0(RCA+LLM

2、)RCA Engine 2.0(RCA*LLM)Discussion&Future WorkseBay Risk RCAeBay Risk RootCauseAnalysiseBay Risk Decision Platform Business FlowActionsOther9%Traffic4%SignIn5%Holds6%IRSF12%Rules14%Pre Auth38%Risk Decision Platform Alerts8101 per year,40per workday An Example-InternationalRevenue ShareFraud Fraudste

3、rsPhone CarriersSMSPhone number with premium rate SMS from small countrieslease$/monthChallenges on Manual Alert Analysis Initial CheckSite AnalysisRule AnalysisFraud Pattern DetectionUser Sample CheckBusiness InvestigationIncident AlertTake ActionHours for a seasoned analyst Challenges on Manual Al

4、ert Analysis SignInListingOfferCheckout1M+CombinationsMainUSUKDEBlockRemedyFlagApproveActiveNewGuestInactive1133423124621112358291423564RCAChallenges on Manual Alert Analysis Complex interdependencies among different risk elements Numerous data sources need to be individually checked and analyzedHig

5、hly reliant on human knowledge and experience for analysis and decision-makingRCA Engine 1.0Prerequisite-Risk Lineage Graph RuleFlowActionVarSiteModelServiceFeatureDomainUserVendorDW-Primary Nodes-Secondary NodesPrerequisite-Risk Lineage Graph 100K+Nodes2M+EdgesRCA Engine 1.0 Metadata Driven Generic

6、 Pipeline FlowActionSiteRuleUserVariableRCA Pipeline ContextElastic Data FetcherAD Algorithm(e.g.ARIMA)Shift Contribution RankingConditional DecisionRCA Engine 1.0RCA+LLMRCA Engine 1.0 LLM Assisted Detection FlowActionSiteRuleUserVariableRCA Pipeline ContextLog Data FetcherSystem LogLLM DetectionSys