Why large language models are mysterious – even to their creators
Created to accompany an exhibition at the Computer History Museum in California, this nifty explainer from the video essayist Grant Sanderson (aka 3Blue1Brown) helps to demystify how large language models (LLMs) operate – even though, as Sanderson details, the inner workings can be mysterious even to those who program them. Offering a brief history of their evolution up to today, he deconstructs both the hidden scaffolding of these technologies and the innovations that have allowed them to improve so dramatically over the past decade. With a narrow focus that avoids controversies around the ethics of LLMs, Sanderson focuses on what’s actually happening when one interacts with these technologies. Through this lens, he elucidates how LLMs are an intricate – and rather ingenious – collaboration between human and machine inputs.
Video by 3Blue1Brown

videoMathematics
After centuries of trying, we’ve yet to arrive at a perfect way to map colour
20 minutes

videoMusic
A riveting audiovisual dive into what makes sounds harmonious, or not
28 minutes

videoMathematics
Spiral into the ‘golden ratio’ – and separate the myths from the maths
4 minutes

videoHistory of science
How we came to know the size of the Universe – and what mysteries remain
26 minutes

videoEcology and environmental sciences
Join endangered whooping cranes on their perilous migratory path over North America
6 minutes

videoLanguage and linguistics
Do button-pushing dogs have something new to say about language?
9 minutes

videoHistory of science
Ideas ‘of pure genius’ – how astronomers have measured the Universe across history
29 minutes

videoComputing and artificial intelligence
A future in which ‘artificial scientists’ make discoveries may not be far away
9 minutes

videoEthics
Plato saw little value in privacy. How do his ideas hold up in the information age?
5 minutes