You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There are currently three mixing schedules available: linear, cosine, and logistic. It's possible that other mixing strategies could produce interesting results, such as completely non-linear schedules or schedules that involve randomness. You could for instance mix z_prime only during 25% of the steps. Our node here should allow for another input that can receive a mixing schedule as a tensor that could be produced by other nodes.
The text was updated successfully, but these errors were encountered:
There are currently three mixing schedules available: linear, cosine, and logistic. It's possible that other mixing strategies could produce interesting results, such as completely non-linear schedules or schedules that involve randomness. You could for instance mix z_prime only during 25% of the steps. Our node here should allow for another input that can receive a mixing schedule as a tensor that could be produced by other nodes.
The text was updated successfully, but these errors were encountered: