Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: WebFormer: The Web-page Transformer for Structure Information Extraction   Structure information extraction refers to the task of extracting structured
text fields from web pages, such as extracting a product offer from a shopping
page including product title, description, brand and price. It is an important
research topic which has been widely studied in document understanding and web
search. Recent natural language models with sequence modeling have demonstrated
state-of-the-art performance on web information extraction. However,
effectively serializing tokens from unstructured web pages is challenging in
practice due to a variety of web layout patterns. Limited work has focused on
modeling the web layout for extracting the text fields. In this paper, we
introduce WebFormer, a Web-page transFormer model for structure information
extraction from web documents. First, we design HTML tokens for each DOM node
in the HTML by embedding representations from their neighboring tokens through
graph attention. Second, we construct rich attention patterns between HTML
tokens and text tokens, which leverages the web layout for effective attention
weight computation. We conduct an extensive set of experiments on SWDE and
Common Crawl benchmarks. Experimental results demonstrate the superior
performance of the proposed approach over several state-of-the-art methods.

21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
34
The categories of this paper are: chem-ph
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
17
The categories of this paper are: q-fin
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
14
The categories of this paper are: math-ph
16
The categories of this paper are: stat
25
The categories of this paper are: patt-sol
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
9
The categories of this paper are: nlin
2
The categories of this paper are: math