使用多模态基础模型 API 从 Databricks 中的图像数据中获取洞察.pdf

1、Gaining Insight From Image Data Using Multi-Modal Foundation Model APIAnkit MathurTuesday,June 102024 Databricks Inc.All rights reservedAccess any AI Model,be it a fully custom model,a Databricks-managed model,or a 3rd-party Foundation Model.Govern and Monitor all Models in one placeQuery Models via

2、 unified interface(Single API,SDK and UI)Model ServingDatabricks Model ServingClassic AIFoundation Models2024 Databricks Inc.All rights reservedUse Foundation Models in your applications with your data,whether its an out of the box model,a fine tuned model,or a 3rd-party Foundation Model.Govern and

3、Monitor all Foundation Models in one placeQuery any model via a standard OpenAI API(Single API,SDK and UI)External ModelsBatch InferenceFoundation Model APIFoundation Model APIProvisioned ThroughputPay per token2024 Databricks Inc.All rights reservedOur dream is to build the best end-to-end integrat

4、ed Serving platform5The most basic use case for LLMs is text to textProcessing Text with LLMs“How are you today?”LLM“Im just an AI Assistant,so I dont have feelings!”What can GenAI do for my data?6Companies have a ton of unstructured data.GenAI means you can now affordably process it with high intel

5、ligenceContracts&RFPsRegulatory policiesProduct CatalogsHealthcare ImagesPDFs of Insurance FormsGenerative AIExtract customersentiments&trendsSummarize findingsBulk personalization of communicationsProduct recommendationsStructured JSON dataTranslating documents intoanother languageNot all data is t

6、ext data!ImagesDocumentsAudioVideo8Multi-modal REST API supportIntroducingProcess image inputs from customers in real-timeLlama 4“Describe this image to me.”Its a studio shot of a single penny-loafer style shoe.The loafer is made from a smooth,matte brown sued