三个皮匠报告—— 严选型全行业研究报告分享下载平台，您的专属行业智库！
欢迎来到三个皮匠报告！
登录
帮助中心
首页
最新
研搜
BETA
合集
英文
会议
数据
财报库
政策库
自研报告
入驻
您的当前位置：
首页
>
行业数据
>
MoE的理念起源（专家和门控网络系统）
MoE的理念起源（专家和门控网络系统）
其它
下载Excel
下载图片
原图定位
图片属性
图片格式：PNG
图片大小：117KB
图片尺寸：1112*881
同报告图片
/
4
fCDkuJPlrrbnvZHnu5wgMSB8IOS4k+Wutue9kee7nCAyIHwg5LiT5a62572R57ucIDMgfAp8LS0tLS0tLS0tLS0tfC0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS18Cnwg6L6T5YWlICAgICAgIHwg6L6T5YWlICAgICAgIHwg6L6T5YWlICAgICAgIHwKCui1hOaWmeadpea6kO+8muOAikFkYXB0aXZlIE1peHR1cmUgb2YgTG9jYWwgRXhwZXJ0c+OAi++8jEphY29ic++8iDIwMjHvvInvvIzljY7ms7DnoJTnqbY=
fCDmqKHlnosgICAgICAgICAgICAgICB8IOi+k+WFpeS7t+agvCAoJC8xTSB0b2tlbnMpIHwg6L6T5Ye65Lu35qC8ICgkLzFNIHRva2VucykgfAp8LS0tLS0tLS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tfC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLXwKfCBvcGVuLW1pc3RyYWwtN2IgICAgfCAwLjI1ICAgICAgICAgICAgICAgICAgIHwgMC4yNSAgICAgICAgICAgICAgICAgICB8Cnwgb3Blbi1taXh0cmFsLTh4N2IgIHwgMC43ICAgICAgICAgICAgICAgICAgICB8IDAuNyAgICAgICAgICAgICAgICAgICAgfAp8IG9wZW4tbWl4dHJhbC04eDIyYiB8IDIgICAgICAgICAgICAgICAgICAgICAgfCA2ICAgICAgICAgICAgICAgICAgICAgIHwKfCBtaXN0cmFsLXNtYWxsICAgICAgfCAxICAgICAgICAgICAgICAgICAgICAgIHwgMyAgICAgICAgICAgICAgICAgICAgICB8CnwgbWlzdHJhbC1tZWRpdW0gICAgIHwgMi43ICAgICAgICAgICAgICAgICAgICB8IDguMSAgICAgICAgICAgICAgICAgICAgfAp8IG1pc3RyYWwtbGFyZ2UgICAgICB8IDQgICAgICAgICAgICAgICAgICAgICAgfCAxMiAgICAgICAgICAgICAgICAgICAgIHwKCui1hOaWmeadpea6kO+8mk1pc3RyYWwg5a6Y572R44CB5Y2O5rOw56CU56m2
所属报告：
计算机行业深度研究：全球大模型将往何处去？-240701（61页）.pdf
打包全文图表
相关数据
2024公司发布MoE具身大模型萤石蓝海大模型
PHxiZWdpbl9vZl9ib3h8Pnwg5bGC57qnICAgICAgICAgfCDlhbfkvZPlhoXlrrkgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHwKfC0tLS0tLS0tLS0tLS0tfC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tfAp8IOWfuuehgOWkp+aooeWeiyAgIHwg6KeG6KeJ5Lqk5LqS5aSn5qih5Z6L44CB6Z+z6aKR5Lqk5LqS5aSn5qih5Z6L44CB6K+t6KiA5Lqk5LqS5aSn5qih5Z6L44CB5aSa5qih5oCB5Lqk5LqS5aSn5qih5Z6LICAgICAgICAgfAp8IOinkuiJsuWMluS7o+eQhiAgIHwg5a6g54mp566h5a6244CB6Zmq5Ly05Yqp5omL44CB5Yqe5YWs5Yqp5omL44CB5a625bGF566h5a62ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8Cnwg5bqU55So5Yqf6IO9ICAgICB8IOWuoOeJqeaZuuiDveWvueivneOAgeWEv+erpeaVmeiCsuS6kuWKqOOAgeiAgeS6uuWBpeW6t+ebkea1i+OAgeivremfs+aOp+WItuWutueUteOAgeWutuW6reWuiemYsuebkeaOp+OAgeWutuW6reWoseS5kOWGheWuueaOqOiNkOOAgeWuoOeJqeaXtuWFieebuOWGjOOAgeiAgeS6uuWBpeW6t+aho+ahiOOAgee0p+aApeWRvOWPq+aMiemSruOAgeaZuuiDveWutuWxheaOp+WItuOAgeivremfs+aPkOmGkuOAgeWutuWKoeS6i+aJi+WGmeiusOW9leOAgei/kOWKqOi9qOi/ueiusOW9leOAgeWutuW6reW8gOaUr+e7n+iuoeOAgeaZuuiDveWutuWxheeKtuaAgeafpeivouOAgeaVsOWtl+S6uuaDheaEn+mZquS8tOOAgeefpeivhumXruetlOezu+e7n+OAgeWutuW6reaXtuWFieebuOWGjOOAgeWutuW6reWuieWFqOaOp+WItiB8CgrotYTmlpnmnaXmupDvvJrlhazlj7jlhazlkYo8fGVuZF9vZl9ib3h8Pg==
收藏
其它
2025-09-08
原图定位
查看详情
MoE模型训练时仅激活一部分专家及参数
fCDlm74xIHwg5Zu+MiB8IOWbvjMgfCDlm740IHwKfC0tLS0tLXwtLS0tLS18LS0tLS0tfC0tLS0tLXwKfCAxICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCAyICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCAzICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCA0ICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCA1ICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCA2ICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCA3ICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCA4ICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCA5ICAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKfCAxMCAgIHwgICAgICB8ICAgICAgfCAgICAgIHwKCgrotYTmlpnmnaXmupDvvJrjgIpEZWVwU2Vla01vRTogVG93YXJkcyBVbHRpbWF0ZSBFeHBlcnQgU3BlY2lhbGl6YXRpb24gaW4gTWl4dHVyZS1vZi1FeHBlcnRzIExhbmd1YWdlIE1vZGVsc+OAi++8iERlZXBTZWVr5Zui6ZifMjAyNOW5tOWPkeihqO+8iQ==
收藏
行业数据
2025-06-10
原图定位
查看详情
MoE模型训练时仅激活一部分专家及参数
fCDkuJPlrrbnsbvliKsgICB8IOa/gOa0u+eKtuaAgSB8CnwtLS0tLS0tLS0tLS18LS0tLS0tLS0tLXwKfCDmoIfngrnnrKblj7cgICB8IOacqua/gOa0uyAgIHwKfCDliqjor40gICAgICAgfCDmnKrmv4DmtLsgICB8Cnwg6L+e6K+NICAgICAgIHwg5pyq5r+A5rS7ICAgfAp8IOaVsOWtlyAgICAgICB8IOa/gOa0uyAgICAgfA==
收藏
行业数据
2025-05-22
原图定位
查看详情
元象MoE效果超越同期多个同类模型
5aW955qE77yM5Lul5LiL5piv5oKo5Zu+54mH5Lit55qE5pWw5o2u55Sf5oiQ55qE6KGo5qC877yM5bm25Zyo6KGo5qC85LiL5pa55bGV56S65LqG6LWE5paZ5p2l5rqQ44CCCgp8IOiDveWKm+e7tOW6piB8IOadg+Wogea1i+ivlembhiB8IOWFg+ixoSB8IE1pc3RyYWwgQUkgfCDmmIbku5HkuIfnu7QgfCDmt7HluqbmsYLntKIgfCB4QUkgfCBNZXRhIHwg6Zi/6YeM5be05be0IHwgT3BlbkFJIHwgTWluaU1heCB8CnwtLS0tLS0tLS0tfC0tLS0tLS0tLS0tLXwtLS0tLS18LS0tLS0tLS0tLS0tfC0tLS0tLS0tLS18LS0tLS0tLS0tLXwtLS0tLXwtLS0tLS18LS0tLS0tLS0tLXwtLS0tLS0tLXwtLS0tLS0tLS18Cnwg5qih5Z6LICAgICB8ICAgICAgICAgICAgfCBYVlZFUlNFLU1vRS1BMzZCIHwgTWlzdHJhbC04eDIyQi1BMzlCIHwgU2t5d29yay1Nb0UtQTIyQiB8IERlZXBTZWVrLVYyLUEyMUIgfCBHcm9rLTEtQTg2QiB8IExsYW1hMy4xLTcwQiB8IFF3ZW4xLjUtNzJCIHwgR1BULTRvIHwgYWJhYiA2LjUgfAp8IOaYr+WQpuW8gOa6kCB8ICAgICAgICAgICAgfCDmmK8gICB8IOaYryAgICAgICAgIHwg5pivICAgICAgIHwg5pivICAgICAgIHwg5pivICB8IOaYryAgIHwg5pivICAgICAgIHwg5ZCmICAgICB8IOWQpiAgICAgIHwKfCDoi7Hmlofpl67nrZQgfCBNTUxVICAgICAgIHwgODAuOCB8IDc3LjggICAgICAgfCA3Ny40ICAgICB8IDc4LjUgICAgIHwgNzMuMHwgNzkuMyB8IDc3LjUgICAgIHwgODguNyAgIHwgNzguNyAgICB8Cnwg5o6o55CGICAgICB8IFBJUUEgICAgICAgfCA4NC44IHwgODQuMSAgICAgICB8IC0gICAgICAgIHwgODMuNyAgICAgfCAtICAgfCA4My44IHwgLSAgICAgICAgfCAtICAgICAgfCAtICAgICAgIHwKfCDmlbDlraYgICAgIHwgR1NNOEsgICAgICB8IDg5LjUgfCA4Mi4zICAgICAgIHwgNzYuMSAgICAgfCA3OS4yICAgICB8IDYyLjl8IDgzLjcgfCA3OS41ICAgICB8IC0gICAgICB8IDkxLjcgICAgfAp8IOaVsOWtpiAgICAgfCBNQVRIICAgICAgIHwgNTMuMyB8IDM0LjEgICAgICAgfCAzMS45ICAgICB8IDQzLjYgICAgIHwgMjMuOXwgNDEuNCB8IDM0LjEgICAgIHwgNzYuNiAgIHwgNTEuMyAgICB8Cnwg5Luj56CBICAgICB8IEh1bWFuRXZhbCAgfCA1MS44IHwgNDUuMSAgICAgICB8IDQzLjkgICAgIHwgNDguOCAgICAgfCA2My4yfCA1OC41IHwgNDYuMyAgICAgfCA5MC4yICAgfCA3OC4wICAgIHwKfCDkuK3mlofpl67nrZQgfCBDTU1VICAgICAgIHwgODEuNyB8IDU5LjkgICAgICAgfCA3OS41ICAgICB8IDg0LjAgICAgIHwgLSAgIHwgLSAgICB8IDgzLjUgICAgIHwgLSAgICAgIHwgLSAgICAgICB8CgrotYTmlpnmnaXmupDvvJrlhYPosaFYVkVSU0XlhazkvJflj7c=
收藏
行业数据
2025-05-06
原图定位
查看详情
MoE架构下GPU通信机制的迭代历程
fCAgfCDkvKDnu58gKE5DQ0wpIHwgRGVlcEVQIChOVlNITUVNKSB8CnwgLS0tIHwgLS0tIHwgLS0tIHwKfCDpgJrkv6HnibnlvoEgfCDmnInlkK/liqjlu7bov5/jgIHlpKfmtYHph4/jgIHov57nu63jgIHlkIzmraXpgJrkv6EgfCDkvY7lu7bov5/jgIHlj6/ljZXkvqfjgIHpq5jnu4bnspLluqbjgIHlvILmraXpgJrkv6EgfAp8IOmAgueUqOS7u+WKoSB8IOmAguWQiOS4gOasoeaAp+eahOWQjOi0qOmbhuS9k+aTjeS9nO+8jOS7juiAjOaRiuiWhOmAmuS/oeWQr+WKqOWSjOWQjOatpeeahOW8gOmUgCB8IOmAguWQiOmikee5geeahOWwj+inhOaooeS8oOi+k++8jOmZjeS9juWQr+WKqOW7tui/nyB8Cnwg5byA5Y+R6Zq+5bqmIHwgTkNDTOaPkOS+m+eugOWNleS4lOmrmOaViOeahOiuoemAmuS/oeaOpeWPo++8jOWPr+aXoOe8neiwg+eUqCB8IE5WU0hNRU3pnIDopoHlvIDlj5HogIXph43mlrDorr7orqHmlbDmja7osIPluqblkozpgJrkv6HnrZbnlaXvvIzlvIDlj5Hlkoznu7TmiqTnmoTlpI3mnYLluqbmm7Tpq5ggfAoK6LWE5paZ5p2l5rqQ77yaR2l0SHViLCBNZWRpdW0sIOaWueato+ivgeWIuOeglOeptuaJgA==
收藏
产业概述
2025-03-17
原图定位
查看详情
图7.EPLB两层混合专家（MoE）模型示例
fCBMYXllciAwIHwgNSB8IDYgfCA1IHwgNyB8IDggfCA0IHwgMyB8IDQgfCAxMCB8IDkgfCAxMCB8IDIgfCAwIHwgMSB8IDExIHwgMSB8CnwtLS0tLS0tLS18LS0tfC0tLXwtLS18LS0tfC0tLXwtLS18LS0tfC0tLXwtLS0tfC0tLS18LS0tLXwtLS0tfC0tLS18LS0tLXwtLS0tfC0tLS18CnwgTGF5ZXIgMSB8IDcgfCAxMCB8IDYgfCA4IHwgNiB8IDExIHwgOCB8IDkgfCAyIHwgNCB8IDUgfCAxIHwgNSB8IDAgfCAzIHwgMSB8CgrotYTmlpnmnaXmupDvvJpEZWVwU2VlayDlrpjmlrnvvIzotKLpgJror4HliLjnoJTnqbbmiYA=
收藏
行业数据
2025-03-03
原图定位
查看详情
MoE模型训练时仅激活一部分专家及参数
fCDkuJPlrrbnsbvliKsgICB8IOa/gOa0u+eKtuaAgSAgIHwKfC0tLS0tLS0tLS18LS0tLS0tLS0tLXwKfCDmoIfngrnnrKblj7cgICAgIHwg5pyq5r+A5rS7ICAgICAgfAp8IOWKqOivjSAgICAgICB8IOacqua/gOa0uyAgICAgIHwKfCDov57or40gICAgICAgfCDmnKrmv4DmtLsgICAgICB8Cnwg5pWw5a2XICAgICAgIHwg5r+A5rS7ICAgICAgIHwKCui1hOaWmeadpea6kO+8mjUzYWnvvIhBSeWkp+aooeWei+W6lOeUqOW5s+WPsO+8ie+8jOeUs+S4h+Wuj+a6kOeglOeptg==
收藏
行业数据
2025-02-08
原图定位
查看详情
DeepSeekMoE与传统MoE架构比较
fCDlm74xMCB8IERlZXBTZWVrTW9F5LiO5Lyg57ufTW9F5p625p6E5q+U6L6DIHwKfC0tLS0tLXwtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLXwKfCAoYSkgIHwgQ29udmVudGlvbmFsIFRvcC0yIFJvdXRpbmcgIHwKfCAoYikgIHwgRmluZS1ncmFpbmVkIEV4cGVydCBTZWdtZW50YXRpb24gfAp8IChjKSAgfCBTaGFyZWQgRXhwZXJ0IElzb2xhdGlvbiAoRGVlcFNlZWtNb0UpIHwKCui1hOaWmeadpea6kO+8mkRlZXBTZWVrTW9F6K665paH44CB5oub5ZWG6K+B5Yi4
收藏
行业数据
2025-02-06
原图定位
查看详情
发布会上英伟达表示GB200的GPT-MoE推理性能能够达到H200的30倍
fCBUaHJvdWdocHV0IHBlciBHUFUgKFRva2VucyBwZXIgU2Vjb25kKSB8IEdCMjAwIEZQNCB8IEdCMjAwIEZQOCB8IEgyMDAgRlA4IHwKfC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLXwtLS0tLS0tLS0tLXwtLS0tLS0tLS0tfAp8IFRQMi5FUDguRFA0ICAgICAgICAgICAgICAgICAgICAgICAgICAgfCAxNDAgICAgICAgfCAxNDAgICAgICAgfCAxNDAgICAgICB8CnwgVFAyLkVQMTYuUFAyICAgICAgICAgICAgICAgICAgICAgICAgICB8IDEyMCAgICAgICB8IDEyMCAgICAgICB8IDEyMCAgICAgIHwKfCBUUDQuRVAxNiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHwgMTAwICAgICAgIHwgMTAwICAgICAgIHwgMTAwICAgICAgfAp8IFRQOC5QUDQuRFAyICAgICAgICAgICAgICAgICAgICAgICAgICAgfCA4MCAgICAgICAgfCA4MCAgICAgICAgfCA4MCAgICAgICB8CnwgVFA4LlBQMi5EUDQgICAgICAgICAgICAgICAgICAgICAgICAgICB8IDYwICAgICAgICB8IDYwICAgICAgICB8IDYwICAgICAgIHwKfCBUUDguUFA0LkRQMiAgICAgICAgICAgICAgICAgICAgICAgICAgIHwgNDAgICAgICAgIHwgNDAgICAgICAgIHwgNDAgICAgICAgfAp8IFRQOC5QUDIuRFA0ICAgICAgICAgICAgICAgICAgICAgICAgICAgfCAyMCAgICAgICAgfCAyMCAgICAgICAgfCAyMCAgICAgICB8CnwgVFA4ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8IDEwICAgICAgICB8IDEwICAgICAgICB8IDEwICAgICAgIHwKfCBUUDQgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHwgNSAgICAgICAgIHwgNSAgICAgICAgIHwgNSAgICAgICAgfAoK6LWE5paZ5p2l5rqQ77ya6Iux5Lyf6L6+44CBU2VtaUFuYWx5c2lz44CB5Zu96YeR6K+B5Yi456CU56m25omA
收藏
行业数据
2024-11-29
原图定位
查看详情
国内外典型MoE模型比较
fCDluo/lj7cgfCDlhazlj7jlkI3np7AgICAgICAgfCDmqKHlnovlkI3np7AgICAgICAgICB8IE1vRSDlj4LmlbDnrYnkv6Hmga8gICAgICAgICAgICAgICAgICAgICAgICAgICB8CnwtLS0tLS18LS0tLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tfAp8IDEgICAgfCBPcGVuQUkgICAgICAgICB8IEdQVC00ICAgICAgICAgICAgfCAxLjhULCAxNiDkuKrkuJPlrrbvvIzmr4/kuKogdG9rZW4g5r+A5rS7IDIg5Liq5LiT5a62IHwKfCAyICAgIHwgTWlzdHJhbCBBSSAgICAgfCBNaXh0cmFsIDh4N0IgICAgIHwgNDYuN0IsIDgg5Liq5LiT5a6277yM5q+P5LiqIHRva2VuIOa/gOa0uyAyIOS4quS4k+WutiB8CnwgMyAgICB8IEdvb2dsZSAgICAgICAgIHwgR2VtaW5pIDEuNSBQcm8gICB8IOWumOaWueacqumAj+mcsiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8CnwgNCAgICB8IHhBSSAgICAgICAgICAgIHwgR3Jvay0xICAgICAgICAgICB8IDMxNEIsIDgg5Liq5LiT5a6277yM5q+P5LiqIHRva2VuIOa/gOa0uyAyIOS4quS4k+WutiB8CnwgNSAgICB8IERhdGFicmlja3MgICAgIHwgREJSWCAgICAgICAgICAgICB8IDEzMkIsIDE2IOS4quS4k+Wutu+8jOavj+S4qiB0b2tlbiDmv4DmtLsgNCDkuKrkuJPlrrYgfAp8IDYgICAgfCBBSTIxICAgICAgICAgICB8IEphbWJhICAgICAgICAgICAgfCA1MkIsIDE2IOS4quS4k+Wutu+8jOavj+S4qiB0b2tlbiDmv4DmtLsgNCDkuKrkuJPlrrYgIHwKfCA3ICAgIHwgTWluaU1heCAgICAgICAgfCBhYmFiIDYuNSAgICAgICAgIHwg5LiH5Lq/5Y+C5pWwICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgfAp8IDggICAgfCDpmL/ph4wgICAgICAgICAgIHwgUXdlbi0xLjUgTW9FICAgICB8IDE0LjNCLCA2NCDkuKrkuJPlrrbvvIzmr4/kuKogdG9rZW4g5r+A5rS7IDQg5Liq5LiT5a62IHwKfCA5ICAgIHwg5piG5LuR5LiH57u0ICAgICAgIHwg5aSp5belIDMuMCAgICAgICAgIHwgNDAwMCDkur/lj4LmlbAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8CnwgMTAgICB8IOmYtui3g+aYn+i+sCAgICAgICB8IFN0ZXAgMiAgICAgICAgICAgfCDkuIfkur/lj4LmlbAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8CnwgMTEgICB8IOWVhuaxpCAgICAgICAgICAgfCDml6Xml6XmlrAgNS4wICAgICAgIHwgNjAwMCDkur/lj4LmlbAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8CnwgMTIgICB8IOiFvuiuryAgICAgICAgICAgfCDmt7flhYMgICAgICAgICAgICAgfCDkuIfkur/lj4LmlbAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8CgrotYTmlpnmnaXmupDvvJrlkITlhazlj7jlrpjnvZHjgIHljY7ms7DnoJTnqbY=
收藏
其它
2024-07-02
原图定位
查看详情
Jamba架构（左）吸收了Mamba+Transformer+MoE多种技术
fCBMYXllciBUeXBlICAgICAgICAgIHwgQ29tcG9uZW50cyAgICAgICAgICB8CnwtLS0tLS0tLS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tLS0tLS0tLS0tfAp8IFRyYW5zZm9ybWVyIExheWVyICAgfCBNTFAsIFJNU05vcm0sIEF0dGVudGlvbiwgUk1TTm9ybSB8CnwgQXR0ZW50aW9uK01vRSBMYXllciB8IE1vRSwgUk1TTm9ybSwgQXR0ZW50aW9uLCBSTVNOb3JtIHwKfCBNYW1iYSBMYXllciAgICAgICAgIHwgTUxQLCBSTVNOb3JtLCBNYW1iYSwgUk1TTm9ybSB8CnwgTWFtYmErTW9FIExheWVyICAgICB8IE1vRSwgUk1TTm9ybSwgTWFtYmEsIFJNU05vcm0gfAoK6LWE5paZ5p2l5rqQ77yaQTIxIOWumOe9keOAgeWNjuazsOeglOeptg==
收藏
其它
2024-07-02
原图定位
查看详情
国内外典型MoE模型比较
fCDluo/lj7cgfCDlhazlj7jlkI3np7AgfCDmqKHlnovlkI3np7AgfCBNb0Xlj4LmlbDnrYnkv6Hmga8gfAp8LS0tLS0tfC0tLS0tLS0tLXwtLS0tLS0tLS0tfC0tLS0tLS0tLS0tLS0tLS18CnwgMSAgICB8IE9wZW5BSSAgfCBHUFQtNCAgICB8IDEuOFQsIDE25Liq5LiT5a6277yM5q+P5LiqdG9rZW7mv4DmtLsy5Liq5LiT5a62IHwKfCAyICAgIHwgTWlzdHJhbCBBSSB8IE1peHRyYWwgOHg3QiB8IDQ2LjdCLCA45Liq5LiT5a6277yM5q+P5LiqdG9rZW7mv4DmtLsy5Liq5LiT5a62IHwKfCAzICAgIHwgR29vZ2xlICB8IEdlbWluaSAxLjUgUHJvIHwg5a6Y5pa55pyq6YCP6ZyyIHwKfCA0ICAgIHwgeEFJICAgIHwgR3Jvay0xICAgfCAzMTRCLCA45Liq5LiT5a6277yM5q+P5LiqdG9rZW7mv4DmtLsy5Liq5LiT5a62IHwKfCA1ICAgIHwgRGF0YWJyaWNrcyB8IERCUlggICAgfCAxMzJCLCAxNuS4quS4k+Wutu+8jOavj+S4qnRva2Vu5r+A5rS7NOS4quS4k+WutiB8CnwgNiAgICB8IEFJMjEgICB8IEphbWJhICAgIHwgNTJCLCAxNuS4quS4k+Wutu+8jOavj+S4qnRva2Vu5r+A5rS7NOS4quS4k+WutiB8CnwgNyAgICB8IE1pbmlNYXggfCBhYmFiIDYuNSB8IOS4h+S6v+WPguaVsCB8CnwgOCAgICB8IOmYv+mHjCAgICB8IFF3ZW4tMS41IE1vRSB8IDE0LjNCLCA2NOS4quS4k+Wutu+8jOavj+S4qnRva2Vu5r+A5rS7NOS4quS4k+WutiB8CnwgOSAgICB8IOaYhuS7keS4h+e7tCB8IOWkqeW3pTMuMCAgfCA0MDAw5Lq/5Y+C5pWwIHwKfCAxMCAgIHwg6Zi26LeD5pif6L6wIHwgU3RlcCAyICAgfCDkuIfkur/lj4LmlbAgfAp8IDExICAgfCDllYbmsaQgICAgfCDml6Xml6XmlrAgNS4wIHwgNjAwMOS6v+WPguaVsCB8CnwgMTIgICB8IOiFvuiuryAgICB8IOa3t+WFgyAgICB8IOS4h+S6v+WPguaVsCB8CgrotYTmlpnmnaXmupDvvJrlkITlhazlj7jlrpjnvZHjgIHljY7ms7DnoJTnqbY=
收藏
其它
2024-06-05
原图定位
查看详情
2024年更新的部分重点大模型产品，其中采用MoE架构的显著增多
fCDmqKHlnovlkI3np7AgfCDlm6LpmJ8gfCDmm7TmlrDml7bpl7QgfCDmnIDmlrDniYjmnKwgfCDlr7nmoIfmtbflpJbkuqflk4HmsLTlubMgfCDlupXlsYLmioDmnK8gfAp8IC0tLSB8IC0tLSB8IC0tLSB8IC0tLSB8IC0tLSB8IC0tLSB8Cnwg6IGK5aSpR0xNIChDaGF0R0xNKSB8IOaZuuiwseWNjueroCB8IDIwMjQuMS4xNiB8IEdMTS00IHwg6YC86L+RIEdQVC00IHwgZW5jb2Rlci1kZWNvZGVyIHRyYW5zZm9ybWVyIHwKfCDmloflv4PkuIDoqIAgfCDnmb7luqYgfCAyMDI0LjEuMjkgfCDmloflv4PlpKfmqKHlnosgNC4wIHwg5o6l6L+RIEdQVC00IHwgdHJhbnNmb3JtZXIgfAp8IOaWh+a+nOWkp+aooeWeiyB8IOeZvuW3neaZuuiDvSB8IDIwMjQuMS4yOSB8IEJhaWNodWFuIDMgfCDlpKfluYXotoXotoogR1BULTMuNSwg5o6l6L+RIEdQVC00IHwgdHJhbnNmb3JtZXIrUkFHIHwKfCDnp5jloZRMTE0gfCDnp5jloZQgfCAyMDI0LjMgfCDnp5jloZQgQUkg5pCc57SiIHwgLSB8IHRyYW5zZm9ybWVyIHwKfCDmmJ/ngavpgJrnlKjlpKfmqKHlnosgfCDpmLbot4PmmJ/ovrAgfCAyMDI0LjMuMjMgfCBTdGVwIOezu+WIl+mAmueUqOWkp+aooeWeiyB8IEdQVC0zLjXjgIFHUFQtNCB8IFN0ZXAtMiDkuIfkur/lj4LmlbAgTW9FIOivreiogOWkp+aooeWei+S4uiBNb0UgfAp8IOmAmuS5ieWNg+mXruWkp+aooeWeiyB8IOmYv+mHjOW3tOW3tOi+vuaRqemZoiB8IDIwMjQuNC45IHwg6YCa5LmJ5Y2D6ZeuIDIuNeOAgVF3ZW4xLjUtMTEwQiB8IExsYW1hMy03MEIgfCBRd2VuMS41LU1vRS1BMi43QiDkuLogTW9FIHwKfCDlpKnlt6XigJ3lpKfmqKHlnosgfCDmmIbku5HkuIfnu7QgfCAyMDI0LjQuMTcgfCDlpKnlt6UgMy4wIHwgR3Jvay0xIHwgTU9FIHwKfCDml6Xml6XmlrAgfCDllYbmsaTnp5HmioAgfCAyMDI0LjQuMjMgfCDjgIzml6Xml6XmlrAgU2Vuc2VOb3ZhIDUuMOOAjeWkp+aooeWeiyB8IEdQVC00IFR1cmJvIHwgTU9FIHwKfCDmmJ/ngavorqTnn6XlpKfmqKHlnosgfCDnp5HlpKforq/po54gfCAyMDI0LjQuMjYgfCDmmJ/ngavlpKfmqKHlnosgVjMuNSDmm7TmlrDniYggfCBHUFQtNCBUdXJibyB8IHRyYW5zZm9ybWVyIHwKfCBEZWVwU2VlayB8IOW5u+aWuSB8IDIwMjQuNS42IHwgRGVlcFNlZWstVjIgfCBHUFQtNCBUdXJibyB8IE1vRSB8CnwgTW9vbnNob3QgfCDmnIjkuYvmmpfpnaIgfCAyMDI0LjUuOSB8IEtpbWkg5pm66IO95Yqp5omL5o6o5Ye6IEtpbWkrIHwgLSB8IHRyYW5zZm9ybWVyIHwKfCBhYmFiIHwg56iA5a6H56eR5oqAIChtaW5pbWF4KSB8IDIwMjQuNS45IHwgYWJhYiA2LjUg57O75YiX5qih5Z6LIHwg5o6l6L+RIEdQVC00LCBDbGF1ZGUgMyBPcHVzLCBHZW1pbmkgMS41IFBybyDnrYkgfCBNT0UgfAp8IOmcsuWNoSBMVUNBIHwg6Z2i5aOB5pm66IO9IHwgMjAyNC41LjIwIHwgTWluaUNQTS1MbGFtYTMtVjIuNSB8IEdQVC00VuOAgUdlbWluaSBQcm8g562JIHwgTWluaUNQTS1Nb0UtOHgyQiDkuLogTW9FIHwKCui1hOaWmeadpea6kO+8muaWsOaZuuWFg+OAgemHj+WtkOS9jeOAgeacuuWZqOS5i+W/g+OAgU92ZXJDb21wYXNz44CB5Zu95rOw5ZCb5a6J6K+B5Yi456CU56m2
收藏
其它
2024-05-31
原图定位
查看详情
V-MoE与ViT图像处理性能对比
fCDlm77ooaggfCBWLU1vRSB8IFZpVCB8IAp8IDotLTogfCA6LS06IHwgOi0tOiB8IAp8IEpGVC0zMDBNIFByZWNpc2lvbkAxICglKSB8IDMwIHwgMzIgfCAKfCBMLzMyIHwgNDUgfCA1MCB8IAp8IEIvMzIgfCA0MCB8IDQ1IHwgCnwgSC8xNCB8IDU1IHwgNjAgfCAKfCBMLzE2IHwgNTAgfCA1NSB8IAp8IFMvMzIgfCAzNSB8IDQwIHwgCnwgSW1hZ2VOZXQgNS1zaG90IEFjY3VyYWN5ICglKSB8IDQ1IHwgNTAgfCAKfCBMLzMyIHwgNjUgfCA3MCB8IAp8IEIvMzIgfCA1NSB8IDYwIHwgCnwgSC8xNCB8IDc1IHwgODAgfCAKfCBMLzE2IHwgNzAgfCA3NSB8IAp8IFMvMzIgfCA1MCB8IDU1IHwgCgrotYTmlpnmnaXmupDvvJrjgIpTY2FsaW5nIFZpc2lvbiB3aXRoIFNwYXJzZSBNaXh0dXJlIG9mIEV4cGVydHPjgIvvvIzkuK3kv6Hlu7rmipU=
收藏
其它
2023-12-11
原图定位
查看详情
最新数据
全球全年龄段奶粉市场规模（亿美元）
收藏
行业数据
2026-07-30
原图定位
查看详情
全球酸奶及发酵乳制品市场规模（亿美元）
收藏
行业数据
2026-07-30
原图定位
查看详情
全球药用级益生菌市场规模（百万美元）
收藏
行业数据
2026-07-30
原图定位
查看详情
全球益生菌膳食补充剂市场规模及增速
收藏
行业数据
2026-07-30
原图定位
查看详情
全球拥有AKK专利菌株的核心企业
收藏
行业数据
2026-07-30
原图定位
查看详情
Google 是 MoE 架构的早期探索者之一，OpenAI 实现了 MoE 的商业化落地。MoE 的理念起源于 1991 年的论文《Adaptive Mixture of Local Experts》。在 ChatGPT 问世之前，Google 已经有了较深入的 MoE 研究，典型代表是 20 年的 Gshard 和 21 年的开源 1.6 万亿Switch-Transformer 模型。23 年 3 月 GPT-4 问世，OpenAI 继续走了闭源路线，没有公布模型参数。但是据 SemiAnalysis 信息，GPT-4 的参数约 1.8 万亿，采用 MoE 架构，专家 数为 16， 每次推理调用两个专家，生成 1 个 token 约激 活 2800 亿参数（GPT-3 为 1750亿参数），消耗 560 TFLOPs 算力。在 GTC 2024 演讲上，黄仁勋展示了 GB200 训练 GPT模型示意图，给出的参数也是 GPT-MoE-1.8T，交叉印证。
其它
原图定位
当前图表所属：
计算机行业深度研究：全球大模型将往何处去？-240701（61页）.pdf
Mistral的模型谱系和价格（截至2024年5月28日）
Meta提出首个生成式推荐系统模型
微软在财报中公布的Copilot产品矩阵用户数情况
Rabbit基本参数及多模态识别展示
下载图片或Excel，需升级至尊VIP会员或「预见者」VIP
立即去升级
客服
商务合作
小程序
服务号
回到顶部
折叠
微信扫码登录
微信扫码登录
双重福利，扫码领取！
关注公众号『三个皮匠报告』，免费领取报告
1.100+最新优质行业报告
2.每周免费精选报告分享
手机快捷登录
账号登录
记住密码
忘记密码？
验证即登录，未注册将自动创建账号
获取验证码
收不到验证码注意事项
登录代表您已阅读并同意
《三个皮匠服务条款》
研搜
0731-84720580
商务合作：really158d
下载Excel
下载图片
原图定位
打包全文图表
收藏
2025-09-08
原图定位
微信扫码登录
手机快捷登录
账号登录
