You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Please refer to [example output](https://github.com/MMMU-Benchmark/MMMU/blob/main/eval/example_outputs/llava1.5_13b/total_val_output.json) for a detailed prediction file form.
26
+
Please refer to [example output](https://github.com/MMMU-Benchmark/MMMU/blob/main/mmmu/example_outputs/llava1.5_13b/total_val_output.json) for a detailed prediction file form.
27
27
28
28
29
29
## Parse and Evaluation
@@ -76,7 +76,7 @@ Each `output.json`` has a list of dict containing instances for evaluation ().
76
76
```
77
77
python main_parse_and_eval.py --path ./example_outputs/llava1.5_13b --subject ALL # all subject
78
78
79
-
# OR you can sepecify one subject for the evaluation
79
+
# OR you can specify one subject for the evaluation
80
80
81
81
python main_parse_and_eval.py --path ./example_outputs/llava1.5_13b --subject elec # short name for Electronics. use --help for all short names
0 commit comments