LLM 应用程序的红队：从原型到生产.pdf

1、2024 Databricks Inc.All rights reservedRED TEAMING RED TEAMING OF LLM OF LLM APPLICATIONSAPPLICATIONSCorey AbshireCorey AbshireJune 12,2024June 12,202412024 Databricks Inc.All rights reserved2YOUR SPEAKERSYOUR SPEAKERSCorey AbshireSr.AI Specialist Solutions Architect,Databricksin collaboration withe

2、sp.Luca Martial2024 Databricks Inc.All rights reserved Introduction Overview of risks Measure&mitigate Establish a process Resources3OVERVIEWOVERVIEWWhat are we going to talk about today?What are we going to talk about today?2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reser

3、ved4INTRODUCTIONINTRODUCTION2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved5IDEAL CHATBOT LAUNCHIDEAL CHATBOT LAUNCHHow launching AI chatbots should lookHow launching AI chatbots should look2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved6

4、ACTUAL CHATBOT LAUNCHACTUAL CHATBOT LAUNCH what happens in practice what happens in practice2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved7HOW TO HOW TO AVOID AVOID THAT?THAT?2024 Databricks Inc.All rights reserved1.1.Be aware of the risks!Be aware of the risks!Identi

5、fy key risks,understand their impact in your specific context 2.2.Assess&measureAssess&measureRed teaming,vulnerability scanning,benchmarking3.3.Make this systematicMake this systematicEstablish processes,policies,good practicesMETHODOLOGYMETHODOLOGY8How to deploy AI applications securelyHow to depl

6、oy AI applications securely2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved9OVERVIEW OF THE OVERVIEW OF THE RISKSRISKS2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved10CATEGORIES OF RISKCATEGORIES OF RISKReputationalLegal(copyright,liabilit