Should Your Learning Rate Get Smaller As Your Neural Net Gets Larger

Leo Migdal
-
should your learning rate get smaller as your neural net gets larger