During training a neural net, maintain a validation set and stop training when error on validation set stops decreasing. Validate every few iterations to reduce overhead.