Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there a pre-trained model trained on coQA available #79

Open
abhishek-jha13 opened this issue Jan 29, 2020 · 12 comments
Open

Is there a pre-trained model trained on coQA available #79

abhishek-jha13 opened this issue Jan 29, 2020 · 12 comments

Comments

@abhishek-jha13
Copy link

I want to use pre-trained question answering model trained on coQA like hugging face. Do we have something available?

@stevezheng23
Copy link
Owner

Sorry, I haven't released trained CoQA model to public yet

@abhishek-jha13
Copy link
Author

No Worries, I was able to train the model using your code

@stevezheng23
Copy link
Owner

Great!

@imagine3D-ai
Copy link

No Worries, I was able to train the model using your code

what accuracy were you able to achieve?

@imagine3D-ai
Copy link

Sorry, I haven't released trained CoQA model to public yet

Hi! I’m wondering if you’vr released trained CoQa model by now?

@abhishek-jha13
Copy link
Author

No Worries, I was able to train the model using your code

what accuracy were you able to achieve?

I was able to achieve an F1 score of 87. If you need my help, email me at [email protected]

@imagine3D-ai
Copy link

Sorry, I haven't released trained CoQA model to public yet

I'm trying to train XLNET on COQA using your 'run_coqa' script, but my Google Colab notebooks keep crashing. I tried using both CPU and GPU notebook instances and changing batch_size to 1, but they still keep crashing and showing the:

'Allocation of 16777216 exceeds 10% of system memory.' error.

Did you face any similar memory usage errors and did you manage to fix them?

@abhishek-jha13
Copy link
Author

There is bug in the code which causes an infinite loop which causes crashing. Try to fix that.

@imagine3D-ai
Copy link

imagine3D-ai commented Sep 9, 2020 via email

@abhishek-jha13
Copy link
Author

There is a bug in the run_coqa.py

@imagine3D-ai
Copy link

imagine3D-ai commented Sep 9, 2020 via email

@stevezheng23
Copy link
Owner

There is a bug in the run_coqa.py

Please feel free to send out a PR for fixing the bug, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants