Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Can Neural Nets Learn the Same Model Twice? Investigating
  Reproducibility and Double Descent from the Decision Boundary Perspective   We discuss methods for visualizing neural network decision boundaries and
decision regions. We use these visualizations to investigate issues related to
reproducibility and generalization in neural network training. We observe that
changes in model architecture (and its associate inductive bias) cause visible
changes in decision boundaries, while multiple runs with the same architecture
yield results with strong similarities, especially in the case of wide
architectures. We also use decision boundary methods to visualize double
descent phenomena. We see that decision boundary reproducibility depends
strongly on model width. Near the threshold of interpolation, neural network
decision boundaries become fragmented into many small decision regions, and
these regions are non-reproducible. Meanwhile, very narrows and very wide
networks have high levels of reproducibility in their decision boundaries with
relatively few decision regions. We discuss how our observations relate to the
theory of double descent phenomena in convex models. Code is available at
https://github.com/somepago/dbViz

20
The categories of this paper are: acc-phys
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph
2
The categories of this paper are: math