AIME2024 dataset on opencompass is different from the dataset on huggingface #1970
ljliu
started this conversation in
View all discussions
Replies: 1 comment 1 reply
-
Could you clarify what differences you are referring to? If you are wondering why the question representation differs, it is because the OpenCompass version was collected independently by our team members and does not rely on the Hugging Face version. Consequently, there may be minor differences in certain aspects. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
the one in compass is downloaded from http://opencompass.oss-cn-shanghai.aliyuncs.com/datasets/data/aime.zip, the related code is
opencompass/opencompass/utils/datasets_info.py
Line 673 in 07930b8
the other is on https://huggingface.co/datasets/Maxwell-Jia/AIME_2024
you can see that they are so different.
So my question is which is the correct one ?
Beta Was this translation helpful? Give feedback.
All reactions