Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for
  Natural Language Understanding   Data augmentation has been demonstrated as an effective strategy for
improving model generalization and data efficiency. However, due to the
discrete nature of natural language, designing label-preserving transformations
for text data tends to be more challenging. In this paper, we propose a novel
data augmentation framework dubbed CoDA, which synthesizes diverse and
informative augmented examples by integrating multiple transformations
organically. Moreover, a contrastive regularization objective is introduced to
capture the global relationship among all the data samples. A momentum encoder
along with a memory bank is further leveraged to better estimate the
contrastive loss. To verify the effectiveness of the proposed framework, we
apply CoDA to Transformer-based models on a wide range of natural language
understanding tasks. On the GLUE benchmark, CoDA gives rise to an average
improvement of 2.2% while applied to the RoBERTa-large model. More importantly,
it consistently exhibits stronger results relative to several competitive data
augmentation and adversarial training base-lines (including the low-resource
settings). Extensive experiments show that the proposed contrastive objective
can be flexibly combined with various data augmentation approaches to further
boost their performance, highlighting the wide applicability of the CoDA
framework.

31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
17
The categories of this paper are: q-fin
7
The categories of this paper are: hep-th
3
The categories of this paper are: physics
19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
20
The categories of this paper are: acc-phys
25
The categories of this paper are: patt-sol
24
The categories of this paper are: dg-ga
4
The categories of this paper are: cond-mat
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
10
The categories of this paper are: q-bio