Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: CORAL: COde RepresentAtion Learning with Weakly-Supervised Transformers
  for Analyzing Data Analysis   Large scale analysis of source code, and in particular scientific source
code, holds the promise of better understanding the data science process,
identifying analytical best practices, and providing insights to the builders
of scientific toolkits. However, large corpora have remained unanalyzed in
depth, as descriptive labels are absent and require expert domain knowledge to
generate. We propose a novel weakly supervised transformer-based architecture
for computing joint representations of code from both abstract syntax trees and
surrounding natural language comments. We then evaluate the model on a new
classification task for labeling computational notebook cells as stages in the
data analysis process from data import to wrangling, exploration, modeling, and
evaluation. We show that our model, leveraging only easily-available weak
supervision, achieves a 38% increase in accuracy over expert-supplied
heuristics and outperforms a suite of baselines. Our model enables us to
examine a set of 118,000 Jupyter Notebooks to uncover common data analysis
patterns. Focusing on notebooks with relationships to academic articles, we
conduct the largest ever study of scientific code and find that notebook
composition correlates with the citation count of corresponding papers.

12
The categories of this paper are: nucl-th
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
23
The categories of this paper are: solv-int
3
The categories of this paper are: physics