Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Seeing Through Noise: Visually Driven Speaker Separation and Enhancement   Isolating the voice of a specific person while filtering out other voices or
background noises is challenging when video is shot in noisy environments. We
propose audio-visual methods to isolate the voice of a single speaker and
eliminate unrelated sounds. First, face motions captured in the video are used
to estimate the speaker's voice, by passing the silent video frames through a
video-to-speech neural network-based model. Then the speech predictions are
applied as a filter on the noisy input audio. This approach avoids using
mixtures of sounds in the learning process, as the number of such possible
mixtures is huge, and would inevitably bias the trained model. We evaluate our
method on two audio-visual datasets, GRID and TCD-TIMIT, and show that our
method attains significant SDR and PESQ improvements over the raw
video-to-speech predictions, and a well-known audio-only method.

0
The categories of this paper are: hep-ph
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
37
The categories of this paper are: supr-con
34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
25
The categories of this paper are: patt-sol
3
The categories of this paper are: physics
13
The categories of this paper are: quant-ph
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin
8
The categories of this paper are: hep-ex
7
The categories of this paper are: hep-th