Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Speeding Up Distributed Gradient Descent by Utilizing Non-persistent
  Stragglers   Distributed gradient descent (DGD) is an efficient way of implementing
gradient descent (GD), especially for large data sets, by dividing the
computation tasks into smaller subtasks and assigning to different computing
servers (CSs) to be executed in parallel. In standard parallel execution,
per-iteration waiting time is limited by the execution time of the straggling
servers. Coded DGD techniques have been introduced recently, which can tolerate
straggling servers via assigning redundant computation tasks to the CSs. In
most of the existing DGD schemes, either with coded computation or coded
communication, the non-straggling CSs transmit one message per iteration once
they complete all their assigned computation tasks. However, although the
straggling servers cannot complete all their assigned tasks, they are often
able to complete a certain portion of them. In this paper, we allow multiple
transmissions from each CS at each iteration in order to make sure a maximum
number of completed computations can be reported to the aggregating server
(AS), including the straggling servers. We numerically show that the average
completion time per iteration can be reduced significantly by slightly
increasing the communication load per server.

21
The categories of this paper are: adap-org
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
23
The categories of this paper are: solv-int
28
The categories of this paper are: alg-geom
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
14
The categories of this paper are: math-ph
30
The categories of this paper are: q-alg