Do You Optimize the Training You Get?