3356 - Dive into IBM Power clients ML, GenAI ise-cases., value captures, and embarking on your AI journey v2.pdf

1、October 21-24,2024Mandalay Bay Convention CenterLas Vegas,Nevada3356Manoj KumarIBM,Chief Engineer,OpenShift&AI on PDive into IBM Powerclients ML/GenAI use-cases,value captures,and embarking on your AI journeyAgenda0102030405DemosClient use-casesGenerative AIIBM Power valueGetting StartedIBM TechXcha

2、nge|2024 IBM CorporationEntityExtractionQ&A+RAG Self Service AssistantUsing a foundation model on IBM Power10 tailored to specific data answer specific queries.What we just saw Power Virtual ServerIBM PowerEnterprise Transactional Applications&Datawatsonx SaaSwatsonx.aiLLM ModelsUsing mixtral-8x7b-i

3、nstruct LLM ModelCore Banking App1Bank personnel types in a request in English to the Gen AI Assistant2Gen AI Assistant calls watsonx.ai API with the user request3watsonx.ai returns the proper SQL statement for query4Gen AI Assistant runs SQL query and displays the resultant output in a table in the

4、 chat windowBank Personnel with no Data or AI Skills is more productive and able to gain new insights on their clientsGen AI Assistant1SQL query2Natural Language(+DB Schema)Red Hat OpenShift43SQLIBM Power/Technical Collaboration Council/June 17-20,2024/2024 IBM Corporation/IBM ConfidentialAgenda0102

5、030405DemosClient use-casesGenerative AIIBM Power valueGetting StartedIBM TechXchange|2024 IBM CorporationA financial institution in EMEAAccelerated its existing AI solutions with IBM Power10 to become superior in IT operations and detect frauds more efficiently.IBMPower10Power103-4x speed-upfor tra

6、iningIntel Xeon 6248 Intel Xeon 6248 Gold Gold 2023 IBM Corporation8AIOpsFraudDetectionAcceleration is key.AI must serve customer satisfaction.A financial institution in EMEA:ArchitectureTrain&inferencing deployment on IBM Power10.Enterprise compliance,security,and sustainability are of highest prio