您的当前位置：首页 > 行业数据 > MLA和MHA在困难测评集上性能和KVcache对比

MLA和MHA在困难测评集上性能和KVcache对比

其它

下载图片

原图定位

同报告图片

/ 4

5Lul5LiL5piv5o+Q5Y+W55qE5pWw5o2u5bm255Sf5oiQ55qE6KGo5qC877yaCgp8IOaOkuWQjSB8IOaooeWei+WQjeensCAgICAgICAgICAgICAgICAgICAgICAgICAgIHwg5YiG5pWwICB8CnwtLS0tLS18LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLXwtLS0tLS0tfAp8IDEgICAgfCBHUFQtNC1UdXJiby0wMTI1ICAgICAgICAgICAgICAgICB8IDc5LjEzIHwKfCAyICAgIHwgR1BULTQtVHVyYm8tMDQwOSAgICAgICAgICAgICAgICAgfCA3Ny4wMiB8CnwgMyAgICB8IEdQVC00ICAgICAgICAgICAgICAgICAgICAgICAgICAgICB8IDc1LjMyIHwKfCA0ICAgIHwgQ2xhdWRlMy1PcHMgICAgICAgICAgICAgICAgICAgICAgfCA3NC40NyB8CnwgNSAgICB8IEJhaWNodWFuMyAgICAgICAgICAgICAgICAgICAgICAgIHwgNzMuMzIgfAp8IDYgICAgfCBHTE0tNCAgICAgICAgICAgICAgICAgICAgICAgICAgICB8IDcyLjU4IHwKfCA3ICAgIHwg6IW+6K6vSHVueXUtcHJvICAgICAgICAgICAgICAgICAgICB8IDcyLjEyIHwKfCA4ICAgIHwgTW9vbnNob3QgICAgICAgICAgICAgICAgICAgICAgICAgfCA3MC40MiB8CnwgOSAgICB8IOWxsea1t+Wkp+aooeWeiyAgICAgICAgICAgICAgICAgICAgICAgIHwgNjkuNTEgfAp8IDEwICAgfCBMbGFtYS0zLTcwQi1JbnN0cnVjdCAgICAgICAgICAgICB8IDY4Ljc3IHwKfCAxMSAgIHwg6Zi26LeD5pif6L6wc3RlcC0xLTMyayAgICAgICAgICAgICAgIHwgNjguNjkgfAp8IDEyICAgfCBxd2VuLTEuNS03MmItY2hhdCAgICAgICAgICAgICAgICB8IDY4LjA3IHwKfCAxMyAgIHwg5LqR6ZuA5aSn5qih5Z6LICAgICAgICAgICAgICAgICAgICAgICAgfCA2Ny4xMSB8CnwgMTQgICB8IDM2MGdwdC1wcm8gICAgICAgICAgICAgICAgICAgICAgIHwgNjYuNjAgfAp8IDE1ICAgfCBHUFQtMy41LVR1cmJvLTAxMjUgICAgICAgICAgICAgICB8IDY2LjU2IHwKfCAxNiAgIHwgR2VtaW5pLVBybyAgICAgICAgICAgICAgICAgICAgICAgfCA2NC4yMiB8CnwgMTcgICB8IHF3ZW4tMS41LTE0Yi1jaGF0ICAgICAgICAgICAgICAgIHwgNjMuNTEgfAp8IDE4ICAgfCBMbGFtYS0zLTZCLUluc3RydWN0ICAgICAgICAgICAgICB8IDU3LjQ0IHwKfCAxOSAgIHwgWFZFUlNFLTEzQi1MICAgICAgICAgICAgICAgICAgICAgfCA1NS44MiB8CnwgMjAgICB8IHF3ZW4tMS41LTdCLUNoYXQgICAgICAgICAgICAgICAgIHwgNTUuNDkgfAp8IDIxICAgfCBMbGFtYTMtNzBCLUluc3RydWN0ICAgICAgICAgICAgICB8IDUzLjUyIHwKfCAyMiAgIHwgQmFpY2h1YW4yLTEzQi1DaGF0LXYyICAgICAgICAgICAgfCA1My4wNSB8CnwgMjMgICB8IENoYXRHTE0zLTZCICAgICAgICAgICAgICAgICAgICAgIHwgNTAuNjAgfAp8IDI0ICAgfCBHZW1tYS03Yi1pdCAgICAgICAgICAgICAgICAgICAgICB8IDQ0LjQ2IHwKfCAyNSAgIHwgQ2hpbmVzZS1BbHBhY2EyLTEzQiAgICAgICAgICAgICAgfCA0My41NSB8CnwgMjYgICB8IExsYW1hMi0xM0ItQ2hhdCAgICAgICAgICAgICAgICAgIHwgNDAuNzEgfAp8IDI3ICAgfCBMbGFtYTItN0ItQ2hhdCAgICAgICAgICAgICAgICAgICB8IDQwLjE3IHwKCui1hOaWmeadpea6kO+8mkNMVUUg5a6Y572R44CB5Y2O5rOw56CU56m2