OCI Kubernetes Engine 助力大规模 AI 创新 [PAN1753].pdf

1、 OCI Kubernetes Engine Powers AI Innovation at ScalePAN1753Kay Singh,Mickey BoxellOKE Product ManagerOracle AI World 25 Agenda title2Copyright 2025,Oracle and/or its affiliates|Confidential:Internal/Restricted/Highly Restricted1234Why Kubernetes for AI workloads?Customer presentations(Faire,Pipefy)O

2、CIs AI InfrastructureOKE ecosystem for enabling AI workloadsYour hostsCopyright 2025,Oracle and/or its affiliates|Confidential:Internal/Restricted/Highly RestrictedKay SinghProduct Manager,OKEMickey BoxellProduct Manager,OKE3OKE customersCopyright 2025,Oracle and/or its affiliates|Confidential:Inter

3、nal/Restricted/Highly RestrictedManoj KrishnanSenior Staff ML Engineer,FaireSobhan DaliryChief Product Officer,Pipefy4AI Models,Training,and InferencingAI models are programs that learn from data to generate outputModel training is the process of teaching a model to recognize patterns and make predi

4、ctions by feeding it data and adjusting its parameters until it produces the desired behaviorTrained models are used to make inferences:generating output on novel input data based on its trainingExamples of models include Large Language Models(LLMs),Image and video recognition,Anomaly detection,Reco

5、mmender systems,Predictive modeling and forecasting,Robotics and control systemsKubernetes is the Platform for AI/ML WorkloadsTrain large-scale AI/ML models faster and more economicallyReduce the cost of training neural networksInfuse AI into apps using Cohere large language modelsPowering speech re

6、cognition for Mercedes and PandoraEmbed LLMs,narratives,and non-playable characters that evolve with each action for interactive gaming experiencesAI platform to collaborate and share,fine-tune,and run large language modelsOnline wholesale marketplace connecting independent brands with retail stores