人工智能世界中的数据安全.pptx

1、Abhishek Das-Founder,VP of EngineeringDhruv Jain-Founder,Chief Product OfficerData Security in the AI WorldIHELLO DAVE.AM HERE NOW.Only 1/3rd of AI projects have reached productionModel Output Accuracy:39%*Retool,2023 State of AI AdoptionTop pain points for AI appsData Security:33%Hallucinations:28%

2、LLMs are the new era for Natural Language ProcessingDeep Neural NetworksTransformer Architecture with Self-attentionToken Embeddings&Context Similarity OK!This is not a technical talk on LLMsFoundational(LLM)ModelsPre-trained Foundational Models1234Closed-source(e.g.GPT,Claude,PaLM)Open-source(e.g.L

3、lama)CustomCompetitive advantage Privacy/confidentialityModel behavior guardrailsSingle vs Multi-model Multi-modal Compound AI SystemsRecommendation systemsChatbotsKnowledge-base Q&ALeveraging Foundational Models for InferenceUsing Proprietary DataArchitectural PatternsUse-CasesPrompt EngineeringRAG

4、Fine-tuning23No proprietary dataNo updates/changes to model weightsUnlocking the value of your proprietary dataAdd training on domain-specific datasetUpdates/changes to model weightsAdd&continuously update domain-specific knowledge-baseNo updates/changes to model weights*Retool,2023 State of AI Adop

5、tion1Almost 75%of enterprises are looking to use RAG or Fine-Tuning architectures*75%RAG and Fine-tuning Architectures are the Growing TrendQuery ExpansionQuery RewritingRe-rankingAugmentationInference LayerUser/Application InterfacesRoutingQUERYPrompt Eng+AugmentationPost-processingLLMModel LayerRE

6、SPONSEData LayerQuery ExpansionQuery RewritingRe-rankingAugmentationInference LayerUser/Application InterfacesRoutingQUERYPrompt Eng+AugmentationPost-processingLLMData LayerModel LayerRESPONSEQuery ExpansionQuery RewritingRe-rankingAugmentationInference LayerUser/Application InterfacesRoutingQUERYPr