Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Intrinsic Temporal Regularization for High-resolution Human Video
  Synthesis   Temporal consistency is crucial for extending image processing pipelines to
the video domain, which is often enforced with flow-based warping error over
adjacent frames. Yet for human video synthesis, such scheme is less reliable
due to the misalignment between source and target video as well as the
difficulty in accurate flow estimation. In this paper, we propose an effective
intrinsic temporal regularization scheme to mitigate these issues, where an
intrinsic confidence map is estimated via the frame generator to regulate
motion estimation via temporal loss modulation. This creates a shortcut for
back-propagating temporal loss gradients directly to the front-end motion
estimator, thus improving training stability and temporal coherence in output
videos. We apply our intrinsic temporal regulation to single-image generator,
leading to a powerful "INTERnet" capable of generating $512\times512$
resolution human action videos with temporal-coherent, realistic visual
details. Extensive experiments demonstrate the superiority of proposed INTERnet
over several competitive baselines.

23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin