Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Dataset Distillation by Matching Training Trajectories   Dataset distillation is the task of synthesizing a small dataset such that a
model trained on the synthetic set will match the test accuracy of the model
trained on the full dataset. In this paper, we propose a new formulation that
optimizes our distilled data to guide networks to a similar state as those
trained on real data across many training steps. Given a network, we train it
for several iterations on our distilled data and optimize the distilled data
with respect to the distance between the synthetically trained parameters and
the parameters trained on real data. To efficiently obtain the initial and
target network parameters for large-scale datasets, we pre-compute and store
training trajectories of expert networks trained on the real dataset. Our
method handily outperforms existing methods and also allows us to distill
higher-resolution visual data.

23
The categories of this paper are: solv-int
27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
12
The categories of this paper are: nucl-th
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
19
The categories of this paper are: eess
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
13
The categories of this paper are: quant-ph
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg