🏢 National Key Laboratory for Novel Software Technology, School of Computer Science, Nanjing University
Ordered Momentum for Asynchronous SGD
·2380 words·12 mins·
loading
·
loading
AI Generated
Machine Learning
Deep Learning
🏢 National Key Laboratory for Novel Software Technology, School of Computer Science, Nanjing University
Ordered Momentum (OrMo) significantly boosts asynchronous stochastic gradient descent (ASGD) convergence by cleverly incorporating momentum, resolving prior convergence issues. This novel approach is…