Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Calculate mAP/PR curves and view both losses training/validation at same time #173

Open
PythonImageDeveloper opened this issue Mar 10, 2018 · 2 comments

Comments

@PythonImageDeveloper
Copy link

PythonImageDeveloper commented Mar 10, 2018

Hi,
I want to Calculate mAP/PR curves and view both losses training/validation at same time , what do i do ? your work is excellent but why didn't calculate those metrics ? in my opinion ,if we can to plot both losses training/validation at the same time of training duration , we can decide to when to stop the training procedure , and we can to know when the Early stopping occurred.
I've always been questioned why in the deep frameworks didn't use any scripts about view of both losses. in my opinion , if didn't have such plots ,Where to know When should stop the training procedure?

@experiencor
Copy link
Owner

experiencor commented Mar 10, 2018

@zeynali You may refer to #27 for the code to compute mAP. It's lots of code to write. If I remember it correctly, https://github.com/tensorflow/models/tree/master/research/object_detection allows you to visualize mAP progress in TensorBoard.

@RichardSieg
Copy link

Hey. You should consider using https://pypi.python.org/pypi/plotille for plotting the curve. Internally, we used the algorithm proposed in the very well written code for RetinaNet: https://github.com/fizyr/keras-retinanet/blob/master/keras_retinanet/utils/eval.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants