-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The dimension about the Av and Ao #4
Comments
Hi, N_v and N_o are the numbers of verb categories and object categories respectively. For example, on HICO-DET, N_v is 117 and N_o is 80. A_v is the verb-HOI co-occurrence matrix and A_o is the object-HOI co-occurrence matrix. You can see this line of the code: Line 88 in 7d2b559
For example, if the i HOI category is composed by verb j and object k, we have A_v[j][i] == 1 and A_o[k][I] == 1. Regards, |
Thanks! I am also confused that lo is the label of an object, is it also an one-hot label? But what is the label dimension for a new object? y = (loAo)&(lvAv), so the lo should be 1*80, but the new object is not in HOI's obj_class. |
Sorry to bother you again. In "Visual Compositional Learning for Human-Object Interaction Detection", according to my own understanding, I calculated according to equation (1) and (2), but it seems that only the composited HOIs which have appeared in the list of datasets' HOIs will be valid. For example, if the composited HOI is 'play basketball', it will be valid only when there is an annotation of 'play basketball' in the list of datasets' HOIs. But if there has 'play baseball' in the datasets' annotations, and there is no 'play basketball', the composited HOI of 'play basketball' will be invalid, right? Could you please tell me about it in detail? Thank you very much !
…------------------ 原始邮件 ------------------
发件人: "zhihou7/HOI-CL" ***@***.***>;
发送时间: 2021年5月24日(星期一) 下午3:12
***@***.***>;
***@***.******@***.***>;
主题: Re: [zhihou7/HOI-CL] The dimension about the Av and Ao (#4)
Hi, N_v and N_o are the numbers of verb categories and object categories respectively. For example, on HICO-DET, N_v is 117 and N_o is 80. A_v is the verb-HOI co-occurrence matrix and A_o is the object-HOI co-occurrence matrix. You can see this line of the code: https://github.com/zhihou7/HOI-CL/blob/7d2b55947f8e5a75d32345508f70c929c8d4e8d1/lib/networks/tools.py#L88
For example, if the i HOI category is composed by verb j and object k, we have A_v[j][i] == 1 and A_o[k][I] == 1.
Regards,
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.
|
Currently, we only consider the objects whose categories are the same or a subset of object categories of HOI dataset. Sorry for getting you latter. I did not receive the email notification. |
Yes, it is right. Thanks for your nice question! However, you can simply set the co-occurrence matrix by hand to enable the composite HOI of 'play basketball'. Then, the model can learn 'play basketball' although there are no 'play basketball' instance in HICO-DET. Well, I guess this also answer your question about composing HOIs with novel types of objects. In fact, our next work also address your problem. we'll release it once it is accepted. regards, |
thank you^-^
…---Original---
From: ***@***.***>
Date: Wed, May 26, 2021 22:15 PM
To: ***@***.***>;
Cc: ***@***.******@***.***>;
Subject: Re: [zhihou7/HOI-CL] The dimension about the Av and Ao (#4)
Yes, it is right. Thanks for your nice question!
However, you can simply set the co-occurrence matrix by hand to enable the composite HOI of 'play basketball'. Then, the model can learn 'play basketball' although there are no 'play basketball' instance in HICO-DET.
regards,
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.
|
Hi! How can I set the co-occurrence matrix? |
hi @rouge012, Feel free to post if you have further questions Regards, |
Thanks for the quick and detailed clarification, and I am wondering where I can find the code for setting the co-occurrence matrix. Thank you! |
Hi @rouge012, I have posted in #25. If you need to generate a matrix by yourself, you can just open the three files "https://github.com/zhihou7/HOI-CL/blob/master/misc/hico_list_hoi.txt", "https://github.com/zhihou7/HOI-CL/blob/master/misc/hico_list_obj.txt", "https://github.com/zhihou7/HOI-CL/blob/master/misc/hico_list_vb.txt", and link them together according to the object name and verb name. I think it requires just several lines of code. |
Hello, it's very kind and excellent of you to share your work! The logic of this article is very clear, but as a green-hand, I am confused about the Nv and No in Av and Ao. The Nv and No are the numbers of verbs and objects about which dataset or things else? Looking forward to your answer~ ^_^
The text was updated successfully, but these errors were encountered: