3134 Watson Assistant Retrieval Augmented Generation using Elasticsearch DBaaS.pdf

1、October 21-24,2024Mandalay Bay Convention CenterLas Vegas,NevadaSession Session 31343134Daniel PittnerIBM,STSM,Cloud Platform,Cloud Database ServicesWatsonx Assistant Retrieval Augmented Generation using Elasticsearch DBaaSAgenda0102030405RAG 101Watsonx Assistant&Search(Elastic)Search IntegrationFil

2、ter and Query configurationDeploying models to ElasticIBM TechXchange|2024 IBM Corporation#IBMTechXchange3What you will learn in this sessionIBM TechXchange|2024 IBM Corporation0102030405What is Retrieval Augmented Generation?Watsonx Assistant Search IntegrationWhat parts of RAG run directly in Elas

3、ticSearch methods in ElasticDeploying custom models to Elastic#IBMTechXchange4IBM TechXchange|2024 IBM Corporation“Can you build something like ChatGPT,but with access to my calendar,mail”My Mom,asking for something that could be done with RAGAgenda0102030405RAG 101Watsonx Assistant&Search(Elastic)S

4、earch IntegrationFilter and Query configurationDeploying models to ElasticIBM TechXchange|2024 IBM Corporation#IBMTechXchange6Retrieval Augmented Generation 101Question?AnswerLoadSplitPromptLLM(Granite)Vectorstore(Elastic)IBM TechXchange|2024 IBM CorporationEmbed(ELSER)#IBMTechXchangeRAG PipelineDat

5、a PreparationLoading and chunkingdocuments using themost effective strategyfor a business domainGenerate EmbeddingsTransforming chunkschunks and questionsquestions into vectorsSearch and RankingVarious search methodssearch methods(kNN,aNN)ReRankReRank for improved relevance7IBM TechXchange|2024 IBM

6、Corporation#IBMTechXchange8RAG with Watsonx Assistant&ElasticQuestion?AnswerLoadSplitPromptLLM(Granite)Vectorstore(Elastic)IBM TechXchange|2024 IBM CorporationEmbed(ELSER)Agenda0102030405RAG 101Watsonx Assistant&Search(Elastic)Search IntegrationFilter and Query configurationDeploying models to Elast