OpenAI：2024代理型AI系统管理实践（英文版）（23页）.pdf

1、Practices for Governing Agentic AI SystemsYonadav ShavitSandhini AgarwalMiles BrundageSteven AdlerCullen OKeefeRosie CampbellTeddy LeePamela MishkinTyna EloundouAlan HickeyKatarina SlamaLama AhmadPaul McMillanAlex BeutelAlexandre PassosDavid G.RobinsonAbstractAgentic AI systemsAI systems that can pu

2、rsue complex goals with limited direct supervisionare likely to be broadly useful if we can integrate them responsibly into our society.While suchsystems have substantial potential to help people more efficiently and effectively achieve theirown goals,they also create risks of harm.In this white pap

3、er,we suggest a definition of agenticAI systems and the parties in the agentic AI system life-cycle,and highlight the importance ofagreeing on a set of baseline responsibilities and safety best practices for each of these parties.As our primary contribution,we offer an initial set of practices for k

4、eeping agents operationssafe and accountable,which we hope can serve as building blocks in the development of agreedbaseline best practices.We enumerate the questions and uncertainties around operationalizingeach of these practices that must be addressed before such practices can be codified.We then

5、highlight categories of indirect impacts from the wide-scale adoption of agentic AI systems,whichare likely to necessitate additional governance frameworks.Table of Contents1Introduction22Definitions42.1Agenticness,Agentic AI Systems,and“Agents”.42.2The Human Parties in the AI Agent Life-cycle.53Pot

6、ential Benefits of Agentic AI Systems63.1Agenticness as a Helpful Property.63.2Agenticness as an Impact Multiplier.74Practices for Keeping Agentic AI Systems Safe and Accountable74.1Evaluating Suitability for the Task.84.2Constraining the Action-Space and Requiring Approval.94.3Setting Agents Defaul