Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Assessing Multilingual Fairness in Pre-trained Multimodal
  Representations   Recently pre-trained multimodal models, such as CLIP, have shown exceptional
capabilities towards connecting images and natural language. The textual
representations in English can be desirably transferred to multilingualism and
support downstream multimodal tasks for different languages. Nevertheless, the
principle of multilingual fairness is rarely scrutinized: do multilingual
multimodal models treat languages equally? Are their performances biased
towards particular languages? To answer these questions, we view language as
the fairness recipient and introduce two new fairness notions, multilingual
individual fairness and multilingual group fairness, for pre-trained multimodal
models. Multilingual individual fairness requires that text snippets expressing
similar semantics in different languages connect similarly to images, while
multilingual group fairness requires equalized predictive performance across
languages. We characterize the extent to which pre-trained multilingual
vision-and-language representations are individually fair across languages.
However, extensive experiments demonstrate that multilingual representations do
not satisfy group fairness: (1) there is a severe multilingual accuracy
disparity issue; (2) the errors exhibit biases across languages conditioning
the group of people in the images, including race, gender and age.

9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
11
The categories of this paper are: hep-lat
0
The categories of this paper are: hep-ph
2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
15
The categories of this paper are: nucl-ex
37
The categories of this paper are: supr-con
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga