- Change/relative change in objective function value - norm of gradient - number of steps - Change/relative change in validation performance