Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: PIP: Physical Interaction Prediction via Mental Simulation with Span
  Selection   Accurate prediction of physical interaction outcomes is a crucial component
of human intelligence and is important for safe and efficient deployments of
robots in the real world. While there are existing vision-based intuitive
physics models that learn to predict physical interaction outcomes, they mostly
focus on generating short sequences of future frames based on physical
properties (e.g. mass, friction and velocity) extracted from visual inputs or a
latent space. However, there is a lack of intuitive physics models that are
tested on long physical interaction sequences with multiple interactions among
different objects. We hypothesize that selective temporal attention during
approximate mental simulations helps humans in physical interaction outcome
prediction. With these motivations, we propose a novel scheme: Physical
Interaction Prediction via Mental Simulation with Span Selection (PIP). It
utilizes a deep generative model to model approximate mental simulations by
generating future frames of physical interactions before employing selective
temporal attention in the form of span selection for predicting physical
interaction outcomes. To evaluate our model, we further propose the large-scale
SPACE+ dataset of synthetic videos with long sequences of three prime physical
interactions in a 3D environment. Our experiments show that PIP outperforms
human, baseline, and related intuitive physics models that utilize mental
simulation. Furthermore, PIP's span selection module effectively identifies the
frames indicating key physical interactions among objects, allowing for added
interpretability.

26
The categories of this paper are: bayes-an
36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga
15
The categories of this paper are: nucl-ex
16
The categories of this paper are: stat
23
The categories of this paper are: solv-int
4
The categories of this paper are: cond-mat
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph
3
The categories of this paper are: physics
22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
21
The categories of this paper are: adap-org
2
The categories of this paper are: math