MIEB: Massive Image Embedding Benchmark
Paper • 2504.10471 • Published • 21
MIEB
MIEB(Multilingual) is a comprehensive image embeddings benchmark, spanning 10 task types, covering 130 tasks and a total of 39 languages. In ad...
-
-
mteb/birdsnap
Viewer • Updated • 17.9k • 246 -
mteb/Caltech101
Viewer • Updated • 9.14k • 81 -
mteb/cifar10
Viewer • Updated • 60k • 118 • 3 -
mteb/cifar100
Viewer • Updated • 60k • 237 -
mteb/wds_country211
Updated • 229 -
mteb/dtd
Viewer • Updated • 5.64k • 201 -
mteb/eurosat-rgb
Viewer • Updated • 27k • 216 -
mteb/wds_fer2013
Preview • Updated • 168 -
mteb/FGVCAircraft
Viewer • Updated • 10k • 55 -
mteb/food101
Viewer • Updated • 101k • 235 -
mteb/wds_gtsrb
Preview • Updated • 223 -
mteb/wds_imagenet1k
Viewer • Updated • 1.38M • 160 -
mteb/mnist
Viewer • Updated • 70k • 47 -
mteb/oxford-flowers
Viewer • Updated • 8.19k • 42 -
mteb/OxfordPets
Viewer • Updated • 7.35k • 233 -
mteb/wds_vtab-pcam
Viewer • Updated • 295k • 233 -
mteb/resisc45
Viewer • Updated • 31.5k • 166 -
mteb/StanfordCars
Viewer • Updated • 16.2k • 249 -
mteb/stl10
Viewer • Updated • 13k • 156 -
mteb/sun397
Viewer • Updated • 109k • 495 -
mteb/ucf101
Viewer • Updated • 2.48M • 118 -
mteb/VOC2007
Viewer • Updated • 9.96k • 36 -
mteb/imagenet-dog-15
Viewer • Updated • 2.58k • 131 -
mteb/imagenet-10
Viewer • Updated • 13k • 24 -
mteb/tiny-imagenet
Viewer • Updated • 110k • 135 -
mteb/wds_vtab-clevr_closest_object_distance
Updated • 29 -
mteb/wds_vtab-clevr_count_all
Preview • Updated • 29 -
mteb/FGVCAircraftZeroShot
Viewer • Updated • 10.1k • 244 -
mteb/wds_renderedsst2
Viewer • Updated • 8.74k • 35 -
mteb/blink-it2i-multi
Viewer • Updated • 2.01k • 130 -
mteb/blink-it2t-multi
Viewer • Updated • 3.07k • 34 -
mteb/CV-Bench
Viewer • Updated • 5.28k • 197 -
mteb/ARO-COCO-order
Viewer • Updated • 25k • 216 -
mteb/ARO-Flickr-Order
Viewer • Updated • 5k • 120 -
mteb/ARO-Visual-Attribution
Viewer • Updated • 28.7k • 186 -
mteb/ARO-Visual-Relation
Viewer • Updated • 23.9k • 167 -
mteb/SUGARCREPE_fmt
Viewer • Updated • 7.51k • 37 -
facebook/winoground
Viewer • Updated • 400 • 1.2k • 114 -
mteb/imagecode-multi
Viewer • Updated • 48.3k • 152 -
mteb/rendered-sts12
Viewer • Updated • 5.34k • 35 -
mteb/rendered-sts13
Viewer • Updated • 1.5k • 221 -
mteb/rendered-sts14
Viewer • Updated • 3.75k • 30 -
mteb/rendered-sts15
Viewer • Updated • 3k • 186 -
mteb/rendered-sts16
Viewer • Updated • 1.19k • 28 -
mteb/blink-it2i
Viewer • Updated • 1.61k • 101 -
mteb/blink-it2t
Viewer • Updated • 1.61k • 84 -
mteb/mbeir_cirr_task7
Viewer • Updated • 29.9k • 232 -
mteb/cub200_retrieval
Viewer • Updated • 175k • 292 -
mteb/mbeir_edis_task2
Viewer • Updated • 1.06M • 180 -
mteb/mbeir_fashion200k_task3
Viewer • Updated • 71.5k • 186 -
mteb/mbeir_fashion200k_task0
Viewer • Updated • 208k • 140 -
mteb/mbeir_fashioniq_task7
Viewer • Updated • 86.4k • 130 -
mteb/flickr30ki2t
Viewer • Updated • 11k • 954 -
mteb/flickr30kt2i
Viewer • Updated • 11k • 2.32k -
mteb/forb_retrieval
Viewer • Updated • 80.5k • 356 -
mteb/gld-v2
Viewer • Updated • 778k • 358 -
mteb/gld-v2-i2t
Viewer • Updated • 4.59k • 58 -
mteb/MMSoc_HatefulMemes
Viewer • Updated • 10k • 294 -
mteb/imagecode
Viewer • Updated • 27.6k • 78 -
mteb/InfoSeekIT2ITRetrieval
Viewer • Updated • 631k • 283 -
mteb/mbeir_infoseek_task6
Viewer • Updated • 697k • 298 -
mteb/MMSoc_Memotion
Viewer • Updated • 6.99k • 156 -
mteb/met
Viewer • Updated • 521k • 204 -
mteb/mbeir_mscoco_task3
Viewer • Updated • 54.8k • 122 -
mteb/mbeir_mscoco_task0
Viewer • Updated • 54.8k • 166 -
mteb/mbeir_nights_task4
Viewer • Updated • 44.3k • 263 -
mteb/mbeir_oven_task8
Viewer • Updated • 611k • 173 -
mteb/mbeir_oven_task6
Viewer • Updated • 1.22M • 296 -
mteb/r-oxford-easy-multi
Viewer • Updated • 351k • 240 -
mteb/r-oxford-medium-multi
Viewer • Updated • 353k • 313 -
mteb/r-oxford-hard-multi
Viewer • Updated • 350k • 207 -
mteb/rp2k
Viewer • Updated • 4.49M • 328 -
mteb/r-paris-easy-multi
Viewer • Updated • 431k • 85 -
mteb/r-paris-medium-multi
Viewer • Updated • 442k • 81 -
mteb/r-paris-hard-multi
Viewer • Updated • 435k • 95 -
mteb/SciMMIR
Viewer • Updated • 531k • 620 -
mteb/sketchy
Viewer • Updated • 91.1M • 245 -
mteb/stanford-online-products
Viewer • Updated • 1.08M • 291 -
mteb/stanford_cars_retrieval
Viewer • Updated • 342k • 179 -
mteb/tu-berlin
Viewer • Updated • 40.3k • 94 -
mteb/arxivqa_test_subsampled_beir
Viewer • Updated • 1.5k • 1.26k -
mteb/docvqa_test_subsampled_beir
Viewer • Updated • 1.45k • 996 -
mteb/infovqa_test_subsampled_beir
Viewer • Updated • 1.49k • 956 -
mteb/tabfquad_test_subsampled_beir
Viewer • Updated • 630 • 1.11k -
mteb/tatdqa_test_beir
Viewer • Updated • 3.58k • 965 -
mteb/shiftproject_test_beir
Viewer • Updated • 1.2k • 956 -
mteb/syntheticDocQA_artificial_intelligence_test_beir
Viewer • Updated • 1.17k • 941 -
mteb/syntheticDocQA_energy_test_beir
Viewer • Updated • 1.18k • 852 -
mteb/syntheticDocQA_government_reports_test_beir
Viewer • Updated • 1.17k • 864 -
mteb/syntheticDocQA_healthcare_industry_test_beir
Viewer • Updated • 1.16k • 865 -
mteb/mbeir_visualnews_task3
Viewer • Updated • 578k • 270 -
mteb/mbeir_visualnews_task0
Viewer • Updated • 582k • 179 -
mteb/vizwiz
Viewer • Updated • 10.7k • 116 -
mteb/vqa-2
Viewer • Updated • 450k • 454 -
mteb/mbeir_webqa_task2
Viewer • Updated • 409k • 367 -
mteb/mbeir_webqa_task1
Viewer • Updated • 552k • 116 -
mteb/wit
Viewer • Updated • 8.55k • 264 -
mteb/xflickrco
Viewer • Updated • 64k • 3.02k -
mteb/xm3600
Viewer • Updated • 782k • 942 -
Pixel-Linguist/rendered-sts17
Viewer • Updated • 10.7k • 184 -
Pixel-Linguist/rendered-stsb
Viewer • Updated • 173k • 365 • 3