1-3 当强化学习遇上高自由度动作游戏：问题研究与应用实践.pdf

1、When RL Meets Highly Free Action Game:Research and Case Study2022/09/24胡裕靖胡裕靖1Overview2Navigation3Melee Combat4FutureIntro of Fuxi&Naraka:Bladepoint How we solve navigation problem in Naraka:BladepointHow we solve melee combat problem in Naraka:BladepointWhat we wantto do nextOverviewIntro of Fuxi&N

2、araka:Bladepoint NetEase FuxiBusiness and Research InterestsFuxi is founded on the principle of bridging artificial intelligence and video gamesReinforcement LearningComputer VisionNatural Language ProcessingUser PersonaVirtual HumanRoboticsNetEase Fuxi RL GroupBusiness and Research InterestsCard Ga

3、meRevelation MobileRevelation MobileMMORPGJustice 6Justice 6-vsvs-6 6Sports GameFever Basketball 3Fever Basketball 3-vsvs-3 3ACT GameNarakaNaraka BladepointBladepointTypical Applications of RL in Games Game AI Bots60-player PVP mythical action combatMelee combatGravity defying mobilityVast arsenals

4、of melee&ranged weaponsLegendary customizable heroes with epic abilitiesAction-adventure Battle Royale Game Developed by 24 Entertainment and published by NetEase Games MontrealNaraka:Bladepoint（永劫无间）Naraka:BladepointTwo major problems in Naraka（人机模式）we want to solve1.1.NavigationNavigation in very

5、complex terrains2.2.Melee combatMelee combat bots with high skill levelReinforcement Learning Applications in NarakaNavigation and Melee CombatNavigation TaskMelee Combat TaskNavigationComplex threeComplex three-dimensional terrainsdimensional terrains:mountains,trees,rivers,temples,tall buildings(T

6、oo many disconnected areas)Problems for AI in Naraka:BladepointProblems for pathfindingNavMeshTypical terrains in Naraka:BladepointDynamic environmentDynamic environment(i.e.,poison circle,bombing zone,traps)Problems for AI in Naraka:BladepointProblems for pathfindingBombing ZonePoison CircleTrapsMu