Awesome-Multimodal-Large-Language-Models icon indicating copy to clipboard operation
Awesome-Multimodal-Large-Language-Models copied to clipboard
verified publisher icon BradyFU

How many samples are in the dataset?

Open thbupt opened this issue 1 year ago • 2 comments

In the paper, it seems 2000 for perception and 800 for cognition. But only 2374 samples are in the .tsv file.

thbupt avatar Jul 11 '24 06:07 thbupt

I have the same problem. The number of samples in the dataset doesn't match the full scores stated in the paper; the full scores of perception and cognition are 2000 and 800, respectively. But the total samples are 2374

deepML2020 avatar Mar 31 '25 04:03 deepML2020

Hello, the socre of 2800 (perception 2000 + cognition 800) is only related to the number of subtasks (10 + 4, each task has a score of 200, including acc and acc+), instead of samples (2374 is right).

BradyFU avatar Mar 31 '25 07:03 BradyFU