µ-Parametrization could be the key to tuning hyperparameters for massive AI models.

New technique helps to fine-tune massive neural networks without having to start from scratch.