Some common activation functions if none, its identity function ReLU activation Sigmoid or Logistic Activation Tanh activation Softmax activation