Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Combinatorial Testing for Deep Learning Systems   Deep learning (DL) has achieved remarkable progress over the past decade and
been widely applied to many safety-critical applications. However, the
robustness of DL systems recently receives great concerns, such as adversarial
examples against computer vision systems, which could potentially result in
severe consequences. Adopting testing techniques could help to evaluate the
robustness of a DL system and therefore detect vulnerabilities at an early
stage. The main challenge of testing such systems is that its runtime state
space is too large: if we view each neuron as a runtime state for DL, then a DL
system often contains massive states, rendering testing each state almost
impossible. For traditional software, combinatorial testing (CT) is an
effective testing technique to reduce the testing space while obtaining
relatively high defect detection abilities. In this paper, we perform an
exploratory study of CT on DL systems. We adapt the concept in CT and propose a
set of coverage criteria for DL systems, as well as a CT coverage guided test
generation technique. Our evaluation demonstrates that CT provides a promising
avenue for testing DL systems. We further pose several open questions and
interesting directions for combinatorial testing of DL systems.

8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
12
The categories of this paper are: nucl-th
28
The categories of this paper are: alg-geom
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
16
The categories of this paper are: stat
25
The categories of this paper are: patt-sol
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
18
The categories of this paper are: econ
0
The categories of this paper are: hep-ph
11
The categories of this paper are: hep-lat
6
The categories of this paper are: astro-ph