Stochastic Optimization from the perspective of dynamical systems
| Title | Stochastic Optimization from the perspective of dynamical systems |
| Publication Type | Presentation |
| Year of Publication | 2017 |
| Authors | Emmanouil Daskalakis, Rachel Kuske, Mengmeng Yang, Felix J. Herrmann |
| Keywords | Presentation, SINBAD, SINBADFALL2017, SLIM |
| Abstract | We present improvements to a family of methods (Linearized Bregman, Kaczmarz and Stochastic Gradient Descent) that are often use in optimization problems. We explain the link of those methods with dynamical systems and we draw ideas for improving their performance. We use a simple idea to improve the stability and the performance of our family of optimization methods especially for ill-posed, inconsistent large-scale problems. Finally we present an application at a least squares migration problem, which highlight the importance of the suggested improvements on large scale Geophysical problems. |
| URL | https://slim.gatech.edu/Publications/Public/Conferences/SINBAD/2017/Fall/daskalakis2017SINBADFsof/daskalakis2017SINBADFsof.pdf |
| URL2 | |
| Citation Key | daskalakis2017SINBADFsof |