HC2022.KAIST.ZhiyongLi.v04.pdf

1、1 of 26HOTCHIPS 2022An Efficient High-quality FHD Super-resolution Mobile Accelerator SoC with Hybrid-precision and Energy-efficient CacheAn Efficient High-quality FHD Super-resolution Mobile Accelerator SoC with Hybrid-precision and Energy-efficient CacheZhiyong Li,Sangjin Kim,Dongseok Im,Donghyeon

2、 Han,and Hoi-Jun Yoozhiyong_likaist.ac.krSemiconductor System Lab.School of EE,KAIST2 of 26HOTCHIPS 2022An Efficient High-quality FHD Super-resolution Mobile Accelerator SoC with Hybrid-precision and Energy-efficient CacheSuper-Resolution on Mobile Platform Improve User Experience with High Quality

3、Images Expansion of image feature channels and maintain higher image resolution Enhance quality of streaming media/camera shot for better QoS*QoS:Quality of Service720p SR ON!1080p SR ON!3 of 26HOTCHIPS 2022An Efficient High-quality FHD Super-resolution Mobile Accelerator SoC with Hybrid-precision a

4、nd Energy-efficient CacheCharacteristic of SR CNN Large and Non-zero Feature Resolution Maintaining or enlarging feature resolution 9x input image resolution Non-ReLu act.func.remove sparsity zero skipping is impossible Classification CNNSuper-Resolution CNN640 x360 x31920 x1080 x3224x224x31000 x1Bu

5、tterflyTiger Flower*Measured VGG-16,*Measured FSRCNN(Set 5)4 of 26HOTCHIPS 2022An Efficient High-quality FHD Super-resolution Mobile Accelerator SoC with Hybrid-precision and Energy-efficient CacheHigh Memory Requirement Large Data Transactions Total 11x data transaction than classification CNN HW d

6、esign issue of on-chip cache units and processing unitsExt.MemOn-chipCacheExt.MemOn-chipCacheMore PUMore MemT0T1T2Mem0Mem1Mem2LargeEMALowThoughputReuseReuse11TimesClassification CNN*91MBData Transaction(MB/Frame)20406080Feature Map Weight8.3MBSuper-resolution CNN*Challenge 1)High Memory Requirement5