Skip to content

Type classifier model has wrong shape (2-way instead of 4-way classification)? #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
talkhaldi opened this issue May 16, 2022 · 0 comments

Comments

@talkhaldi
Copy link

Hi,

Thank you for your work and repository.

I'm trying to use the type classifier explained in your paper in Sec. 3.4 (Pipeline Approach), where you first predict the reasoning type of the question. You use a BERT model with a 4-way classifier on top. However, examining the type classifier model file released in "DecompRC-all-models-and-data.zip", the classifier is 2-way (similar to the scorer model). Am I missing something? Is the "type-classifier" folder released different than the reasoning type classifier explained in the paper?

Since only the type predictions of dev are released, can you please either release the train questions type predictions or the classifier model?

Thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant