Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in
  Time-of-Flight Imaging   We introduce Mask-ToF, a method to reduce flying pixels (FP) in
time-of-flight (ToF) depth captures. FPs are pervasive artifacts which occur
around depth edges, where light paths from both an object and its background
are integrated over the aperture. This light mixes at a sensor pixel to produce
erroneous depth estimates, which can adversely affect downstream 3D vision
tasks. Mask-ToF starts at the source of these FPs, learning a microlens-level
occlusion mask which effectively creates a custom-shaped sub-aperture for each
sensor pixel. This modulates the selection of foreground and background light
mixtures on a per-pixel basis and thereby encodes scene geometric information
directly into the ToF measurements. We develop a differentiable ToF simulator
to jointly train a convolutional neural network to decode this information and
produce high-fidelity, low-FP depth reconstructions. We test the effectiveness
of Mask-ToF on a simulated light field dataset and validate the method with an
experimental prototype. To this end, we manufacture the learned amplitude mask
and design an optical relay system to virtually place it on a high-resolution
ToF sensor. We find that Mask-ToF generalizes well to real data without
retraining, cutting FP counts in half.

6
The categories of this paper are: astro-ph
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
18
The categories of this paper are: econ
7
The categories of this paper are: hep-th
36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
32
The categories of this paper are: atom-ph
8
The categories of this paper are: hep-ex