🏢 Institute of Mathematics, EPFL
The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks
·1538 words·8 mins·
loading
·
loading
Machine Learning
Deep Learning
🏢 Institute of Mathematics, EPFL
New ‘Feature Speed Formula’ predicts & controls deep learning’s hierarchical feature learning by linking hyperparameter tuning to the angle between feature updates and backward pass.