Non convex optimization problem Initializing weights and biases Saturation Vanishing Gradient Problem and Exploding Gradient Problem Overfitting in Neural Networks