OpenAI:2025 GDPVAL:AI模型在实际经济价值任务中的性能评估报告(英文版)(29页).pdf

编号:925258 PDF  中文版  DOCX 29页 11.28MB 下载积分:VIP专享
下载报告请您先登录!

OpenAI:2025 GDPVAL:AI模型在实际经济价值任务中的性能评估报告(英文版)(29页).pdf

1、GDPVAL:EVALUATINGAI MODELPERFORMANCEONREAL-WORLDECONOMICALLYVALUABLETASKSTejal PatwardhanRachel DiasElizabeth ProehlGrace KimMichele WangOlivia WatkinsSim on Posada FishmanMarwan AljubehPhoebe ThackerLaurance FauconnetNatalie S.KimPatrick ChaoSamuel MiserendinoGildas ChabotDavid LiMichael SharmanAle

2、xandra BarrAmelia GlaeseJerry TworekOpenAIABSTRACTWe introduce GDPval,a benchmark evaluating AI model capabilities on real-world economically valuable tasks.GDPval covers the majority of U.S.Bureauof Labor Statistics Work Activities for 44 occupations across the top 9 sectorscontributing to U.S.GDP(

3、Gross Domestic Product).Tasks are constructed fromthe representative work of industry professionals with an average of 14 years ofexperience.We fi nd that frontier model performance on GDPval is improvingroughly linearly over time,and that the current best frontier models are approach-ing industry e

4、xperts in deliverable quality.We analyze the potential for frontiermodels,when paired with human oversight,to perform GDPval tasks cheaper andfaster than unaided experts.We also demonstrate that increased reasoning effort,increased task context,and increased scaffolding improves model performance on

5、GDPval.Finally,we open-source a gold subset of 220 tasks and provide a pub-lic automated grading service at to facilitate future research inunderstanding real-world model capabilities.1INTRODUCTIONThere is growing debate about how increasingly capable AI models could affect the labor marketwhether b

6、y automating specifi c tasks,replacing entire occupations,or creating entirely new kindsof work(Brynjolfsson et al.,2025;Chen et al.,2025).Current approaches to measure the economicimpact of AI focus on indicators such as adoption rates,usage patterns,and GDP growth attributedto AI(Chatterji et al.,

友情提示

1、下载报告失败解决办法
2、PDF文件下载后,可能会被浏览器默认打开,此种情况可以点击浏览器菜单,保存网页到桌面,就可以正常下载了。
3、本站不支持迅雷下载,请使用电脑自带的IE浏览器,或者360浏览器、谷歌浏览器下载即可。
4、本站报告下载后的文档和图纸-无水印,预览文档经过压缩,下载后原文更清晰。

本文(OpenAI:2025 GDPVAL:AI模型在实际经济价值任务中的性能评估报告(英文版)(29页).pdf)为本站 (111111) 主动上传,三个皮匠报告文库仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对上载内容本身不做任何修改或编辑。 若此文所含内容侵犯了您的版权或隐私,请立即通知三个皮匠报告文库(点击联系客服),我们立即给予删除!

温馨提示:如果因为网速或其他原因下载失败请重新下载,重复下载不扣分。
客服
商务合作
小程序
服务号
折叠