Hysteresis Activation Function for Efficient Inference
Published in NeurIPS ENLSP Workshop · PMLR 262, 2024
Revisit the activation function to address dying ReLUs with minimal inference complexity.
Authors: Moshe Kimhi, Idan Kashani, Chaim Baskin, Avi Mendelson
Kimhi, Kashani & Mendelson: Technion · Baskin: Ben-Gurion University. Author order follows the published PMLR record.