-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Question about test #8
Comments
When evaluating different mAP, you only need to pass different iou_thr value to evaluate function here in tools/test.py here. We suggest to save the inference results first (set --out when testing), then run evaluation with different iou_thr, since inference is quite time-consuming. While comparing to training process which only deal with a clip of 768-frame-length per video, testing would process whole video. Since the model can only process limited length of sequential data, videos are cropped by an overlap ratio of 25% when testing. Besides, processing video data is quite time-consuming already. That's what makes testing process look much more slower than training. After our optimization, the speed of testing process is already lifted a lot. |
Thanks for your clarification! |
Since the inference needs so much time, will you support the DDP testing in the future? |
Hi,
I ran the code of test, and the results are shown as blow.
![image](https://user-images.githubusercontent.com/21001460/132433338-27430902-fae8-4812-b23e-b9f09c7233d5.png)
I wonder whether the repo supports evaluation of mAP of iou@[03:0.7], as reported in the paper.
Another question is why the inference needs so much time?
Thanks.
The text was updated successfully, but these errors were encountered: