Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Navigating the Data Lake with Datamaran: Automatically Extracting
  Structure from Log Datasets   Organizations routinely accumulate semi-structured log datasets generated as
the output of code; these datasets remain unused and uninterpreted, and occupy
wasted space - this phenomenon has been colloquially referred to as "data lake"
problem. One approach to leverage these semi-structured datasets is to convert
them into a structured relational format, following which they can be analyzed
in conjunction with other datasets. We present Datamaran, an tool that extracts
structure from semi-structured log datasets with no human supervision.
Datamaran automatically identifies field and record endpoints, separates the
structured parts from the unstructured noise or formatting, and can tease apart
multiple structures from within a dataset, in order to efficiently extract
structured relational datasets from semi-structured log datasets, at scale with
high accuracy. Compared to other unsupervised log dataset extraction tools
developed in prior work, Datamaran does not require the record boundaries to be
known beforehand, making it much more applicable to the noisy log files that
are ubiquitous in data lakes. Datamaran can successfully extract structured
information from all datasets used in prior work, and can achieve 95%
extraction accuracy on automatically collected log datasets from GitHub - a
substantial 66% increase of accuracy compared to unsupervised schemes from
prior work. Our user study further demonstrates that the extraction results of
Datamaran are closer to the desired structure than competing algorithms.

34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
18
The categories of this paper are: econ
16
The categories of this paper are: stat
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
6
The categories of this paper are: astro-ph
12
The categories of this paper are: nucl-th
10
The categories of this paper are: q-bio
20
The categories of this paper are: acc-phys
13
The categories of this paper are: quant-ph
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph