Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task1 is not learned well #2

Open
jojonki opened this issue Jun 5, 2018 · 0 comments
Open

Task1 is not learned well #2

jojonki opened this issue Jun 5, 2018 · 0 comments

Comments

@jojonki
Copy link

jojonki commented Jun 5, 2018

This is a really nice repository and I really appreciate it!

Although I have tried task1, the accuracy didn't increase well. The accuracy is around 21.4% after 60 epochs. How did you obtain almost 100% accuracy in your environment?

python train.py --train data/train-task-1.tsv --dev data/dev-task-1-500.tsv --vocab data/vocab-task-1.tsv --save_dir checkpoints/task-1/model
...
[INFO] 2018-06-05T15:41:36-0400: Evaluation: (0, 0, 0) (train.py:105)
[DEBUG] 2018-06-05T15:41:36-0400: Saving checkpoint (train.py:108)
[INFO] 2018-06-05T15:41:55-0400: Epoch: 61; Train loss: 0.03631829832971794; Dev loss: 0; (train.py:101)
[INFO] 2018-06-05T15:42:17-0400: Epoch: 62; Train loss: 0.035734415055687974; Dev loss: 0; (train.py:101)
0it [00:00, ?it/s]
[INFO] 2018-06-05T15:42:17-0400: Evaluation: (0, 0, 0) (train.py:105)
[DEBUG] 2018-06-05T15:42:17-0400: Saving checkpoint (train.py:108)
python test.py --test data/test-task-1.tsv --candidates data/candidates.tsv \
  --vocab data/vocab-task-1.tsv --checkpoint_dir checkpoints/task-1 --emb_dim 32 
(1274, 4662, 0.21462264150943397)
// (pos, neg, pos/(pos+neg))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant