代理、推理和硬件.pdf

1、Agents,Inference and Hardware Andrew Ng LandingAI All rights reserved.Technical Trends In AIOn-device AI.Instead of running an LLM in the cloud,run it on your own laptop,phone or industrial PC.Image/Video analysis.LLMs brought us the text processing revolution.The visual processing revolution is com

2、ing not just generation,but analysis.This will affect,manufacturing,life sciences,self-driving,retail,etc.AI Agentic Workflows.Given an instruction(“research topic X for me”)software that can carry out a sequence of steps to generate a result.LandingAI All rights reserved.Please type out an essay on

3、 topic X from start to finish in one go,without using backspace.LLM-Based AgentsNon-agentic workflow(zero-shot)Write an essay outline on topic X Do you need any web research?Write a first draft.Consider what parts need revision or more research.Revise your draft.Agentic workflowThinking/ResearchRevi

4、seStartFinish LandingAI All rights reserved.Zero-shotReflectionTool UsePlanningMultiagentGPT-4GPT-3.5Zero-shot(67%)Zero-shot(48%)40%50%60%70%80%90%100%Coding benchmark(HumanEval)Thanks to Joaquin Dominguez and John Santerre(DeepLearning.AI)for help with analysis.LandingAI All rights reserved.Heres c

5、ode intended for task:def do_task(x):.Check the code carefully for correctness,style and efficiency,and give constructive criticism for how to improve it.Theres a bug on line 5.Fix it by Reflection with LLMs Related work:Self-Refine:Iterative Refinement with Self-Feedback,Madaan et al.(2023)Reflexio

6、n:Language Agents with Verbal Reinforcement Learning,Shinn et al.,(2023)Please write code for taskdef do_task(x):.It failed Unit Test 3.Try changing def do_task_v2(x):def do_task_v3(x):Coder Agent(LLM)LandingAI All rights reserved.def do_task_v2(x):Heres code intended for task:def do_task(x):.Check