FSMBench

university

AI & ML interests

Evaluating and Benchmarking Large Multimodal Models

Recent Activity

taesiri submitted a paper 2 days ago

GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents

taesiri submitted a paper 2 days ago

PokeGym: A Visually-Driven Long-Horizon Benchmark for Vision-Language Models

taesiri submitted a paper 2 days ago

SkillClaw: Let Skills Evolve Collectively with Agentic Evolver

View all activity

spaces 3

FSMBenchLeaderboard

Heatmaps

Display heatmaps for model performance comparisons

Something

models 0

None public yet

datasets 13

FSMBench/fsmbench_reborn_subset_864

Viewer • Updated May 13, 2024 • 864 • 8

FSMBench/fsmbench_reborn_12k

Viewer • Updated May 13, 2024 • 12.8k • 6

FSMBench/simple_fsm_vision_qa

Viewer • Updated May 6, 2024 • 1.92k • 15

FSMBench/fsmbench_what_will_be_the_state_12K_with_output_instruction

Viewer • Updated May 5, 2024 • 12.8k • 7

FSMBench/fsmbench_intersection_set_2

Viewer • Updated Apr 21, 2024 • 1.58k • 10

FSMBench/fsmbench_what_will_be_the_state_12K_oneshot

Viewer • Updated Apr 16, 2024 • 12.8k • 6

FSMBench/fsmbench_intersection_set_1

Viewer • Updated Apr 16, 2024 • 500 • 13

FSMBench/fsmbench_what_will_be_the_state_12K_think_step_by_step_image

Viewer • Updated Apr 13, 2024 • 12.8k • 8

FSMBench/fsmbench_what_will_be_the_state_12K_image

Viewer • Updated Mar 23, 2024 • 12.8k • 6

FSMBench/fsmbench_what_will_be_the_state_12K_think_step_by_step

Viewer • Updated Mar 18, 2024 • 12.8k • 10

View 13 datasets