Guest
Race Result Details |
| Racer | nootscoot (sonniko) |
| Race Number | 12 |
| Date | Wed, 27 Aug 2025 1:57:07 |
| Universe | magic |
| Speed |
79 WPM
 Try to beat?
|
| Accuracy | 97.2% |
| Rank | 3rd place (out of 5) |
| Opponents | _fingers (5th place) stephanie_kate (4th place) zomglings (2nd place) |
Text typed:
|
By dynamically updating the bias of each expert according to its recent load, Loss-Free Balancing can consistently maintain a balanced distribution of expert load. In addition, since Loss-Free Balancing does not produce any interference gradients, it also elevates the upper bound of model performance gained from MoE training.
— (other)
by AUXILIARY-LOSS-FREE LOAD BALANCING STRATEGY FOR MIXTURE-OF-EXPERTS
(see stats)
|