Alert button
Picture for Ebisa Wollega

Ebisa Wollega

Alert button

Efficient Stochastic Gradient Descent for Distributionally Robust Learning

Add code
Bookmark button
Alert button
May 22, 2018
Soumyadip Ghosh, Mark Squillante, Ebisa Wollega

Figure 1 for Efficient Stochastic Gradient Descent for Distributionally Robust Learning
Figure 2 for Efficient Stochastic Gradient Descent for Distributionally Robust Learning
Figure 3 for Efficient Stochastic Gradient Descent for Distributionally Robust Learning
Figure 4 for Efficient Stochastic Gradient Descent for Distributionally Robust Learning

We consider a new stochastic gradient descent algorithm for efficiently solving general min-max optimization problems that arise naturally in distributionally robust learning. By focusing on the entire dataset, current approaches do not scale well. We address this issue by initially focusing on a subset of the data and progressively increasing this support to statistically cover the entire dataset.

* 19 Pages, NIPS 2018 submission 
Viaarxiv icon
Github IconAccess Paper or Ask Questions
Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon