Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Adaptive Differential Filters for Fast and Communication-Efficient
  Federated Learning   Federated learning (FL) scenarios inherently generate a large communication
overhead by frequently transmitting neural network updates between clients and
server. To minimize the communication cost, introducing sparsity in conjunction
with differential updates is a commonly used technique. However, sparse model
updates can slow down convergence speed or unintentionally skip certain update
aspects, e.g., learned features, if error accumulation is not properly
addressed. In this work, we propose a new scaling method operating at the
granularity of convolutional filters which 1) compensates for highly sparse
updates in FL processes, 2) adapts the local models to new data domains by
enhancing some features in the filter space while diminishing others and 3)
motivates extra sparsity in updates and thus achieves higher compression
ratios, i.e., savings in the overall data transfer. Compared to unscaled
updates and previous work, experimental results on different computer vision
tasks (Pascal VOC, CIFAR10, Chest X-Ray) and neural networks (ResNets,
MobileNets, VGGs) in uni-, bidirectional and partial update FL settings show
that the proposed method improves the performance of the central server model
while converging faster and reducing the total amount of transmitted data by up
to 377 times.

29
The categories of this paper are: funct-an
0
The categories of this paper are: hep-ph
22
The categories of this paper are: chao-dyn
25
The categories of this paper are: patt-sol
16
The categories of this paper are: stat
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
18
The categories of this paper are: econ
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
20
The categories of this paper are: acc-phys