Surya Ganguli    @SuryaGanguli
Great thread by @KuninDaniel on our new preprint "Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion." https://t.co/JffAMLVhsv on how the loss landscape, batch size, learning rate and momentum yield anomalous diffusion





ian bremmer    @ianbremmer
Strongly endorse people rethinking a position on basis of learning new facts and changing their mind.



 







Surya Ganguli

Simone Scardapane

Wojciech Czarnecki

Aran Komatsuzaki

Gabriel Peyré

Sergey Levine