Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multi-Level Feature Abstraction from Convolutional Neural Networks for
  Multimodal Biometric Identification   In this paper, we propose a deep multimodal fusion network to fuse multiple
modalities (face, iris, and fingerprint) for person identification. The
proposed deep multimodal fusion algorithm consists of multiple streams of
modality-specific Convolutional Neural Networks (CNNs), which are jointly
optimized at multiple feature abstraction levels. Multiple features are
extracted at several different convolutional layers from each modality-specific
CNN for joint feature fusion, optimization, and classification. Features
extracted at different convolutional layers of a modality-specific CNN
represent the input at several different levels of abstract representations. We
demonstrate that an efficient multimodal classification can be accomplished
with a significant reduction in the number of network parameters by exploiting
these multi-level abstract representations extracted from all the
modality-specific CNNs. We demonstrate an increase in multimodal person
identification performance by utilizing the proposed multi-level feature
abstract representations in our multimodal fusion, rather than using only the
features from the last layer of each modality-specific CNNs. We show that our
deep multi-modal CNNs with multimodal fusion at several different feature level
abstraction can significantly outperform the unimodal representation accuracy.
We also demonstrate that the joint optimization of all the modality-specific
CNNs excels the score and decision level fusions of independently optimized
CNNs.

15
The categories of this paper are: nucl-ex
35
The categories of this paper are: mtrl-th
19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
22
The categories of this paper are: chao-dyn
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th