TY - GEN
T1 - Sparse ternary connect
T2 - 23rd Asia and South Pacific Design Automation Conference, ASP-DAC 2018
AU - Jin, Canran
AU - Sun, Heming
AU - Kimura, Shinji
N1 - Funding Information:
Thanks are due to members of Kimura-lab in Waseda University for their discussions. The work is supported in part by the fund from NEC.
Publisher Copyright:
© 2018 IEEE.
PY - 2018/2/20
Y1 - 2018/2/20
N2 - Convolutional Neural Networks (CNNs) are indispensable in a wide range of tasks to achieve state-of-the-art results. In this work, we exploit ternary weights in both inference and training of CNNs and further propose Sparse Ternary Connect (STC) where kernel weights in float value are converted to 1, -1 and 0 based on a new conversion rule with the controlled ratio of 0. STC can save hardware resource a lot with small degradation of precision. The experimental evaluation on 2 popular datasets (CIFAR-10 and SVHN) shows that the proposed method can reduce resource utilization (by 28.9% of LUT, 25.3% of FF, 97.5% of DSP and 88.7% of BRAM on Xilinx Kintex-7 FPGA) with less than 0.5% accuracy loss.
AB - Convolutional Neural Networks (CNNs) are indispensable in a wide range of tasks to achieve state-of-the-art results. In this work, we exploit ternary weights in both inference and training of CNNs and further propose Sparse Ternary Connect (STC) where kernel weights in float value are converted to 1, -1 and 0 based on a new conversion rule with the controlled ratio of 0. STC can save hardware resource a lot with small degradation of precision. The experimental evaluation on 2 popular datasets (CIFAR-10 and SVHN) shows that the proposed method can reduce resource utilization (by 28.9% of LUT, 25.3% of FF, 97.5% of DSP and 88.7% of BRAM on Xilinx Kintex-7 FPGA) with less than 0.5% accuracy loss.
UR - http://www.scopus.com/inward/record.url?scp=85045315293&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85045315293&partnerID=8YFLogxK
U2 - 10.1109/ASPDAC.2018.8297304
DO - 10.1109/ASPDAC.2018.8297304
M3 - Conference contribution
AN - SCOPUS:85045315293
T3 - Proceedings of the Asia and South Pacific Design Automation Conference, ASP-DAC
SP - 190
EP - 195
BT - ASP-DAC 2018 - 23rd Asia and South Pacific Design Automation Conference, Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 22 January 2018 through 25 January 2018
ER -