Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: LiveCap: Real-time Human Performance Capture from Monocular Video   We present the first real-time human performance capture approach that
reconstructs dense, space-time coherent deforming geometry of entire humans in
general everyday clothing from just a single RGB video. We propose a novel
two-stage analysis-by-synthesis optimization whose formulation and
implementation are designed for high performance. In the first stage, a skinned
template model is jointly fitted to background subtracted input video, 2D and
3D skeleton joint positions found using a deep neural network, and a set of
sparse facial landmark detections. In the second stage, dense non-rigid 3D
deformations of skin and even loose apparel are captured based on a novel
real-time capable algorithm for non-rigid tracking using dense photometric and
silhouette constraints. Our novel energy formulation leverages automatically
identified material regions on the template to model the differing non-rigid
deformation behavior of skin and apparel. The two resulting non-linear
optimization problems per-frame are solved with specially-tailored
data-parallel Gauss-Newton solvers. In order to achieve real-time performance
of over 25Hz, we design a pipelined parallel architecture using the CPU and two
commodity GPUs. Our method is the first real-time monocular approach for
full-body performance capture. Our method yields comparable accuracy with
off-line performance capture techniques, while being orders of magnitude
faster.

0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int
16
The categories of this paper are: stat
28
The categories of this paper are: alg-geom
19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
7
The categories of this paper are: hep-th
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
22
The categories of this paper are: chao-dyn
8
The categories of this paper are: hep-ex
35
The categories of this paper are: mtrl-th
24
The categories of this paper are: dg-ga
36
The categories of this paper are: cmp-lg
3
The categories of this paper are: physics
2
The categories of this paper are: math