Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: FAT: Learning Low-Bitwidth Parametric Representation via Frequency-Aware
  Transformation   Learning convolutional neural networks (CNNs) with low bitwidth is
challenging because performance may drop significantly after quantization.
Prior arts often discretize the network weights by carefully tuning
hyper-parameters of quantization (e.g. non-uniform stepsize and layer-wise
bitwidths), which are complicated and sub-optimal because the full-precision
and low-precision models have a large discrepancy. This work presents a novel
quantization pipeline, Frequency-Aware Transformation (FAT), which has several
appealing benefits. (1) Rather than designing complicated quantizers like
existing works, FAT learns to transform network weights in the frequency domain
before quantization, making them more amenable to training in low bitwidth. (2)
With FAT, CNNs can be easily trained in low precision using simple standard
quantizers without tedious hyper-parameter tuning. Theoretical analysis shows
that FAT improves both uniform and non-uniform quantizers. (3) FAT can be
easily plugged into many CNN architectures. When training ResNet-18 and
MobileNet-V2 in 4 bits, FAT plus a simple rounding operation already achieves
70.5% and 69.2% top-1 accuracy on ImageNet without bells and whistles,
outperforming recent state-of-the-art by reducing 54.9X and 45.7X computations
against full-precision models. We hope FAT provides a novel perspective for
model quantization. Code is available at
\url{https://github.com/ChaofanTao/FAT_Quantization}.

6
The categories of this paper are: astro-ph
8
The categories of this paper are: hep-ex
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
26
The categories of this paper are: bayes-an
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex