SYSTEM AND METHOD FOR EMULATING QUANTIZATION NOISE FOR A NEURAL NETWORK

Chaim Baskin (Inventor), Eliyahu Schwartz (Inventor), Evgenii Zheltonozhskii (Inventor), Alexander Bronstein (Inventor), Natan Liss (Inventor), Abraham Mendelson (Inventor)

Research output: Patent

Abstract

A system for training a quantized neural network dataset, comprising at least one hardware processor adapted to: receive input data comprising a plurality of training input value sets and a plurality of target value sets; in each of a plurality of training iterations: for each layer, comprising a plurality of weight values, of one or more of a plurality of layers of a neural network: compute a set of transformed values by applying to a plurality of layer values one or more emulated non-uniformly quantized transformations by adding to each of the plurality of layer values one or more uniformly distributed random noise values; and compute a plurality of output values; compute a plurality of training output values; and update one or more of the plurality of weight values to decrease a value of a loss function; and output the updated plurality of weight values of the plurality of layers.

Original languageAmerican English
Patent numberUS2021241096
IPCG06N 3/ 08 A I
Priority date22/04/19
StatePublished - 5 Aug 2021

Fingerprint

Dive into the research topics of 'SYSTEM AND METHOD FOR EMULATING QUANTIZATION NOISE FOR A NEURAL NETWORK'. Together they form a unique fingerprint.

Cite this