• Neuron：Things that holds a number
  • The number inside a neuron is called its activation.
  • The way the network operates activations on the one layer determines the activations on the next layer.
  • sigmoid function: $\sigma(x) = \frac{1}{1 + e^{-x}}$