-
Notifications
You must be signed in to change notification settings - Fork 8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Failed to reproduce #2
Comments
you can try other dataset, not only ICEWS14s. And I fail to run other datasets rather than ICEWS14s. |
I am also unable to run on the 05-15 and GDELT datasets, but my confusion is whether the results in the paper were obtained by testing Mrr after 500 epochs_ The value of the raw parameter. |
You're right. On ICEWS05-15, I found "val_Mrr_raw:0.46"(expected) in validating, but didn't find it in testing. # main.py
...
if val_result[1][0] > best_val_Mrr_raw:
best_val_Mrr_raw = val_result[1][0]
torch.save(model.state_dict(), save_model_path)
print('#'*10, 'better model found')
print('\tStart testing: ', format_now())
... |
Thank your code for this paper, but I failed to reproduce .Can someone tell me where the results in the paper came from? I ran 500 epochs on ICEWS14s and the results are shown in the following figure, but did not achieve the expected results. I slightly modified the code so that ICEWS14s can also be loaded from folder
The text was updated successfully, but these errors were encountered: