ROGER
RObustness and GEneralization in tRaining deep neural networks
Toghether with Holger and Mark Schmidt we are working on a new stochastic
line search algorithm for training deep neural networks. The goal is to
enable faster and more error-resistant training, as well as to prove
rigorous mathematical guarantees for the success of the algorithm.
You can find a preprint of our paper on Arxiv.