Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning to Generate Synthetic Training Data using Gradient Matching and
  Implicit Differentiation   Using huge training datasets can be costly and inconvenient. This article
explores various data distillation techniques that can reduce the amount of
data required to successfully train deep networks. Inspired by recent ideas, we
suggest new data distillation techniques based on generative teaching networks,
gradient matching, and the Implicit Function Theorem. Experiments with the
MNIST image classification problem show that the new methods are
computationally more efficient than previous ones and allow to increase the
performance of models trained on distilled data.

10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
11
The categories of this paper are: hep-lat
23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics
14
The categories of this paper are: math-ph
6
The categories of this paper are: astro-ph
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
24
The categories of this paper are: dg-ga
36
The categories of this paper are: cmp-lg
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas