Deep Dive into how Predicting Future Weights of Neural Network is used to mitigate Data Staleness while Distributed Training
Introducing SpecTrain as means to predict future weights of neural network to alleviate data staleness and improve speed of training via distributed training.
