Space Efficient Quantization for Deep Convolutional Neural Networks

来源 :计算机科学技术学报(英文版) | 被引量 : 0次 | 上传用户:Norazhongli
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Deep convolutional neural networks (DCNNs) have shown outstanding performance in the fields of computer vision,natural language processing,and complex system analysis.With the improvement of performance with deeper layers,DCNNs incur higher computational complexity and larger storage requirement,making it extremely difficult to deploy DCNNs on resource-limited embedded systems (such as mobile devices or Intet of Things devices).Network quantization efficiently reduces storage space required by DCNNs.However,the performance of DCNNs often drops rapidly as the quantization bit reduces.In this article,we propose a space efficient quantization scheme which uses eight or less bits to represent the original 32-bit weights.We adopt singular value decomposition (SVD) method to decrease the parameter size of fully-connected layers for further compression.Additionally,we propose a weight clipping method based on dynamic boundary to improve the performance when using lower precision.Experimental results demonstrate that our approach can achieve up to approximately 14x compression while preserving almost the same accuracy compared with the full-precision models.The proposed weight clipping method can also significantly improve the performance of DCNNs when lower precision is required.
其他文献
2018年我国挖掘机械和掘进机械的销售又创历史新高.为了进一步提高挖掘机械和掘进机械的科技水平,保证行业健康,可持续发展,2018年11月25日,由中国工程机械学会挖掘机械分会
期刊
请下载后查看,本文暂不支持在线获取查看简介。 Please download to view, this article does not support online access to view profile.
期刊
期刊
目的:探讨富含半胱氨酸( Cys)的酸性分泌蛋白( SPARC蛋白)在胃腺癌组织中的表达及与胃腺癌患者预后的关系。方法免疫组化法检测104例胃腺癌组织和30例癌旁组织中SPARC蛋白的表达差
期刊
The combination of visual and textual information in image retrieval remarkably alleviates the semantic gap of traditional image retrieval methods,and thus it h
患者男,36岁.上唇肿胀月余,近又自觉肿大,并觉上颌前牙疼痛.查体:鼻外翻,上唇肿大,口内3、2、1|1、2、3/|叩痛(+),不松动,上唇前庭沟处有肿物存在,扪之柔软,有波动感,鼻孔底
1月11日,全球最大塔机智能工厂——中联重科塔机智能工厂开园仪式在湖南常德隆重举行.常德市委书记、市人大常委会主任周德睿,常德市委副书记、市长曹立军,中联重科董事长、C
期刊
请下载后查看,本文暂不支持在线获取查看简介。 Please download to view, this article does not support online access to view profile.
期刊