AI 代理的实际应用：利用 Databricks 和非结构化数据按需构建非结构化数据.pdf

1、AI Agentsin ActionStructuring unstructured data on demand with Databricks and UnstructuredChris MaddockHead of Product and EngineeringAgendaWho is Unstructured?Pain points and challenges of unstructured data prep Why custom pipelines fall shortHow Unstructured solves itModel Context ProtocolWhat it

2、is,how Unstructured uses MCPAgentic WorkflowsHow MCP unlocks next-gen data processing workflowsAgentic Data Processing In ActionDemo3Agenda1234Who is Unstructured?+10,000paying customers+30M product downloads+155,000organizations using Unstructured$65Mraised since founding in 20225We help organizati

3、ons transform their complex,unstructured data like PDFs,PPTX,HTML files and more into formats compatible with LLMs so employees can chat with their internal data.Company SnapshotAwards6Your LLMs are only as good as the data theyre trained on-80%of your data is trapped in unstructured file types.123E

4、very file type requires its own bespoke processing pipeline Home grown solutions are too brittle for production It requires a lot of time and expertise to build production grade pipelinesSetting The Stage80%Unstructured Data20%Structured Data7Document CleaningCustom Cleaning ScriptsRegExEmbeddingCus

5、tom CodeCustom CodeCustom CodeFile Transformationpython-docxpython-pptxopenpyxlXlrdCamelotpypandocmsg_parserMarkdownNvidia NIMsVLLMsDownstream ConnectionsCustom CodeUpstream ConnectionsCustom CodeIngestion&Preprocessing 1.0Without Unstructured:The Rats NestChunkingCustom CodeS3&Vector StorageSystems

6、 of RecordLLMSystems of RecordGraph&Vector DatabaseObservability&Retrieval8Unstructured saves you tens of thousands of engineering hours.Enterprise Tech StackEnterprise GenAI ETLIngestion&Preprocessing 2.09Azure Blob Storage SearchBoxConfluenceCouchbaseDatabricks VolumesDiscordDropboxElasticSearchGi