PQ-HDC: Projection-Based Quantization Scheme for Flexible and Efficient Hyperdimensional Computing - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2021

PQ-HDC: Projection-Based Quantization Scheme for Flexible and Efficient Hyperdimensional Computing

Chi-Tse Huang
  • Function : Author
  • PersonId : 1105412
Cheng-Yang Chang
  • Function : Author
  • PersonId : 1105413
Yu-Chuan Chuang
  • Function : Author
  • PersonId : 1105414
An-Yeu (andy) Wu
  • Function : Author
  • PersonId : 1105411

Abstract

Brain-inspired Hyperdimensional (HD) computing is an emerging technique for low-power/energy designs in many machine learning tasks. Recent works further exploit the low-cost quantized (bipolarized or ternarized) HD model and report dramatic improvements in energy efficiency. However, the quantization loss of HD models leads to a severe drop in classification accuracy. This paper proposes a projection-based quantization framework for HD computing (PQ-HDC) to achieve a flexible and efficient trade-off between accuracy and efficiency. While previous works exploit thresholding-quantization schemes, the proposed PQ-HDC progressively reduces quantization loss using a linear combination of bipolarized HD models. Furthermore, PQ-HDC allows quantization with flexible bit-width while preserving the computational efficiency of the Hamming distance computation. Experimental results on the benchmark dataset demonstrate that PQ-HDC achieves a 2.82% improvement in accuracy over the state-of-the-art method.
Fichier principal
Vignette du fichier
509922_1_En_34_Chapter.pdf (581.19 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03287667 , version 1 (15-07-2021)

Licence

Identifiers

Cite

Chi-Tse Huang, Cheng-Yang Chang, Yu-Chuan Chuang, An-Yeu (andy) Wu. PQ-HDC: Projection-Based Quantization Scheme for Flexible and Efficient Hyperdimensional Computing. 17th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2021, Hersonissos, Crete, Greece. pp.425-435, ⟨10.1007/978-3-030-79150-6_34⟩. ⟨hal-03287667⟩
67 View
62 Download

Altmetric

Share

More