-
Notifications
You must be signed in to change notification settings - Fork 374
Issues: open-compass/VLMEvalKit
[Help Wanted] Supporting the
chat_inner
API for existing VLMs.
#323
opened Jul 27, 2024 by
kennymckormick
Open
2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Unable to reproduce llava_v1.5_7b scores on several benchmarks including MME, TextVQA, POPE etc.
#1029
opened May 29, 2025 by
sanghyunna
Support for Heron-Bench
Feature Request
Extra attention is needed
#1011
opened May 25, 2025 by
okojoalg
Are there any problems with using vlmeval for the model evaluation of qwen2/2.5?
#997
opened May 19, 2025 by
warmsnow-sh
测试api based model时preprocess_message_with_role()会造成system prompt无限叠加
BUG
Something isn't working
#977
opened May 4, 2025 by
vvirgooo2
Adding LiveXiv - a live benchmark
Feature Request
Extra attention is needed
#976
opened May 3, 2025 by
NimrodShabtay
support for MV-Math
Feature Request
Extra attention is needed
#933
opened Apr 18, 2025 by
SakurajimaMaiii
Error in analyzing video datasets with Qwen2.5-VL-3B-Instruct
#927
opened Apr 16, 2025 by
DanialTaheri
Previous Next
ProTip!
What’s not been updated in a month: updated:<2025-04-29.