Neurons

The most fundamental unit of a deep neural network is called an **artificial neuron.

Inspiration: biological neurons = neural cells = neural processing units

Biological Neurons

• dendrite: receives signals from other neurons
• synapse: point of connection to other neurons
• soma: processes the information
• axon: transmits the output of this neuron

Working of Neurons

• Our sense organs interact with the outside world.
• They relay information to the neurons. The sense organs relay information to the lowest layer of neurons
  • There is a massively parallel interconnected network of neurons
• Some of these neurons may fire (in red) in response to this information and in turn relay information to other neurons they are connected to
• These neurons may also fire (again, in red) and the process continues eventually resulting in a response (laughter in this case)

An average human brain has around 10111011(100 billion) neurons!