李杰-eBay风控实时特征平台建设和应用案例.pdf

1、eBay Risk Real Time Feature StoreJie LiSenior ManagereBay Payments&RiskRisk RulesBLOCKDO NOTHINGREMEDYRisk CheckAI Models(Tree+DNN)Sync/AsyncAI ModelTrainingAI Model SimulationRisk Rule SimulationAI ModelReal Time InferenceAI Model Batch InferenceRisk Rule Real Time InferenceOnlineOfflineeBay Risk R

2、eal TimeFeature StoreAgendaRequirements from AI ModelsRequirements from Risk RulesTechnical HighlightsRequirements from AI ModelsPoint in Time Value Generation for New Features(Offline)Low Latency Feature Update and Batch Fetching(Online)Online Offline ParityAI ModelTrainingAI Model SimulationeBay R

3、isk Real Time Feature StorePiTPiTFeature1Feature1Feature2Feature2Feature3Feature3T1T1Value 11Value 21Value31T2T2Value 12Value 22Value32T3T3Value 13Value 23Value33T12024-01-0111:01:01T22024-02-0212:02:02T32024-03-0313:03:03TodayFeature 1,2,3T1T2T3T 10,000,000Feature 1Feature 2Feature 3Point in Time V

4、alue Generation for New Features(Offline)Offline SimulationAI ModelReal Time InferenceeBay Risk Real Time Feature StoreOnline KV StorageLow Latency Feature Update and Batch Fetching(Online)OnlineLow Latency&Data AccuracyLow Latency of Feature Bulk FetchingEventsAI ModelTrainingAI ModelReal Time Infe

5、renceOnlineOfflineeBay Risk Real Time Feature StoreTraining SetOnline Feature ValuesAI ModelBatch InferenceAI ModelSimulationParityOnline Offline ParityEventsRequirements from Risk RulesSelf ServiceOffline to Online Auto BackfillOnlineOfflineeBay Risk Real Time Feature StoreTraining SetOnline Featur

6、e ValuesSelf ServiceNew FeaturesEventsOnlineOfflineeBay Risk Real Time Feature StoreTraining SetOnline Feature ValuesEventsOffline to Online Auto BackfillAuto BackfillGMV_by_sellerId_in_last_90dayTechnical HighlightsOverviewData Storage Model&DSLFlink-based Online Stream Processing PipelineSpark-bas