You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Let me try to answer this. It should be that there is no need to expand the total-tokens, but you need to ensure that the total tokens of the modified depth tree (complete k-ary tree, k is the value of top-k) are greater than the total-tokens you set, such as the original 60.
Hi, my question is: if I adjusted depth, do I also need to adjust total tokens?
If so, what's the formula I should use, is it (depth+1) x topk?
The text was updated successfully, but these errors were encountered: