← Back
▶ Tour
?
Parameters
ReLU
Sigmoid
Tanh
🧠
GPT-2 has
124M
parameters.
Your brain has
86 billion
neurons and ~150 trillion synapses.
That's 0.00008% of your brain's synapses.
Scroll to zoom out ↓
drag to rotate ✦
Scale is not understanding
Each star you see is one weight.
The model has read more text than any human ever has —
and still cannot tell you what it knows.
— end of exhibit
Neuron
Layer
Block
Transformer
Model
Leap
Galaxy
Navigation
scroll
/
↑↓
Zoom through the levels
1
–
7
Jump to a specific level
space
Toggle the auto-tour
?
Show / hide this help
esc
Close help
tap
labels
Click any level name on the bar
drag
In the Galaxy, drag to rotate
Click anywhere to close
One Trillion Parameters
From one neuron to a trillion
scroll, or press
▶ Tour