Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: HOP: History-and-Order Aware Pre-training for Vision-and-Language
  Navigation   Pre-training has been adopted in a few of recent works for
Vision-and-Language Navigation (VLN). However, previous pre-training methods
for VLN either lack the ability to predict future actions or ignore the
trajectory contexts, which are essential for a greedy navigation process. In
this work, to promote the learning of spatio-temporal visual-textual
correspondence as well as the agent's capability of decision making, we propose
a novel history-and-order aware pre-training paradigm (HOP) with VLN-specific
objectives that exploit the past observations and support future action
prediction. Specifically, in addition to the commonly used Masked Language
Modeling (MLM) and Trajectory-Instruction Matching (TIM), we design two proxy
tasks to model temporal order information: Trajectory Order Modeling (TOM) and
Group Order Modeling (GOM). Moreover, our navigation action prediction is also
enhanced by introducing the task of Action Prediction with History (APH), which
takes into account the history visual perceptions. Extensive experimental
results on four downstream VLN tasks (R2R, REVERIE, NDH, RxR) demonstrate the
effectiveness of our proposed method compared against several state-of-the-art
agents.

10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
14
The categories of this paper are: math-ph
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
3
The categories of this paper are: physics
9
The categories of this paper are: nlin
11
The categories of this paper are: hep-lat
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con