为各种 AI 硬件架构创建软件开发工具的挑战.pdf

1、Eric StotzerSr.Group Director NeuroWeaveTMSDKThe Challenges of Creating Software Development Tools for Diverse AI Hardware Architectures 2024 Cadence Design Systems,Inc.All rights reserved.2AI at the Edge The Software Development Tools Challenge 2024 Cadence Design Systems,Inc.All rights reserved.3A

2、I at the Edge The Software Development Tools ChallengeApplications 2024 Cadence Design Systems,Inc.All rights reserved.4AI at the Edge The Software Development Tools ChallengeNetworksHardwareApplications 2024 Cadence Design Systems,Inc.All rights reserved.5AI at the Edge The Software Development Too

3、ls ChallengeTowards a Solution 2024 Cadence Design Systems,Inc.All rights reserved.6The AI Software Development Tools ChallengeWhat challenge?An intersection of multiple domains From AI model in Python to edge quality embedded code The Frontier of AI model development 2024 Cadence Design Systems,Inc

4、.All rights reserved.7What Challenge?Opensource AI compilerso“XLA,IREE,Glow,TVM,have already solved this problem.”MLIR is a graph compiler toolkit o“We solved that with a dialect.”Just map NN layers to optimized library functions o“We have a kernel for that.”2024 Cadence Design Systems,Inc.All right

5、s reserved.8 AI network theory and construction High-performance computing High Level Language(HLL)compilers and utils Embedded system software Python and C/C+and moreAn Intersection of Multiple Domains 2024 Cadence Design Systems,Inc.All rights reserved.9NeuroWeaveSDKFrom AI Model in Python to Edge

6、 Quality Embedded CodeModel Analyzer Floating-Point or QuantizedModel GraphModel Optimizer/Code GeneratorOne Single Software Toolchain flow for various deployment scenariosObjectClassificationAlways ONWakeWordObjectLocalizationSoundAnalyticsGenAIEmotionDetectionADASSystemsVision/RLC DSPsAudio DSPsPr