Parameters

ReLU Sigmoid Tanh

GPT-2 has 124M parameters.
Your brain has 86 billion neurons and ~150 trillion synapses.
That's 0.00008% of your brain's synapses.

Scroll to zoom out ↓