Presentation
FeBiM: Efficient and Compact Bayesian Inference Engine Empowered with Ferroelectric In-Memory Computing
DescriptionIn scenarios with limited training data or where explainability is crucial, conventional neural network-based machine learning models often face challenges.
In contrast, Bayesian inference-based algorithms excel in providing interpretable predictions and reliable uncertainty estimation in these scenarios.
While many state-of-the-art in-memory computing (IMC) architectures leverage emerging non-volatile memory (NVM) technologies to offer unparalleled computing capacity and energy efficiency for neural network workloads, their application in Bayesian inference is limited.
This is because the core operations in Bayesian inference, i.e., cumulative multiplications of prior and likelihood probabilities, differ significantly from the multiplication-accumulation (MAC) operations common in neural networks, rendering them generally unsuitable for direct implementation in most existing IMC designs.
In this paper, we propose FeBiM, an efficient and compact Bayesian inference engine powered by multi-bit ferroelectric field-effect transistor (FeFET)-based IMC.
FeBiM effectively encodes the trained probabilities of a Bayesian inference model within a compact FeFET-based crossbar.
It maps quantized logarithmic probabilities to discrete FeFET states.
As a result, the accumulated outputs of the crossbar naturally represent the posterior probabilities, i.e., the Bayesian inference model's output given a set of observations.
This approach enables efficient in-memory Bayesian inference without the need for additional calculation circuitry.
As the first FeFET-based in-memory Bayesian inference engine, FeBiM achieves an impressive storage density of 26.32 Mb/mm2 and a computing efficiency of 581.40 TOPS/W in a representative Bayesian classification task.
These results demonstrate 10.7x/43.4x improvement in compactness/efficiency compared to the state-of-the-art hardware implementation of Bayesian inference.
In contrast, Bayesian inference-based algorithms excel in providing interpretable predictions and reliable uncertainty estimation in these scenarios.
While many state-of-the-art in-memory computing (IMC) architectures leverage emerging non-volatile memory (NVM) technologies to offer unparalleled computing capacity and energy efficiency for neural network workloads, their application in Bayesian inference is limited.
This is because the core operations in Bayesian inference, i.e., cumulative multiplications of prior and likelihood probabilities, differ significantly from the multiplication-accumulation (MAC) operations common in neural networks, rendering them generally unsuitable for direct implementation in most existing IMC designs.
In this paper, we propose FeBiM, an efficient and compact Bayesian inference engine powered by multi-bit ferroelectric field-effect transistor (FeFET)-based IMC.
FeBiM effectively encodes the trained probabilities of a Bayesian inference model within a compact FeFET-based crossbar.
It maps quantized logarithmic probabilities to discrete FeFET states.
As a result, the accumulated outputs of the crossbar naturally represent the posterior probabilities, i.e., the Bayesian inference model's output given a set of observations.
This approach enables efficient in-memory Bayesian inference without the need for additional calculation circuitry.
As the first FeFET-based in-memory Bayesian inference engine, FeBiM achieves an impressive storage density of 26.32 Mb/mm2 and a computing efficiency of 581.40 TOPS/W in a representative Bayesian classification task.
These results demonstrate 10.7x/43.4x improvement in compactness/efficiency compared to the state-of-the-art hardware implementation of Bayesian inference.
Event Type
Research Manuscript
TimeTuesday, June 253:30pm - 3:45pm PDT
Location3002, 3rd Floor
Design
Emerging Models of Computation