Up next
How might LLMs store facts | Deep Learning Chapter 7 23 min 
Orphanage 2 min 
iPhone 18 Pro - Does variable aperture matter? 1 min 
COMPILATION: Fascinating Horror Shorts 31 - 60 | Fascinating Horror 27 min 
SEXTANT 2 min 
Samsung Z Fold 8 (Wide) Impressions: Better Than I Thought! 10 min 
Glass is glass 5 min 
N 2 min 
Pro Consoles - Scott The Woz 44 min 
BYE 3 min 
I Investigated IKEA’s Suspiciously Cheap Tech 18 min 
Hackers Don’t Take Coffee Breaks ☕ 1 min 
BETA SQUAD ROAD TRIP: USA EDITION 112 min 
How to Film Cinematic Vlogs By Yourself! (with the Luna Ultra) 13 min 
My Favorite Twilight Knockoff 101 min 
What if that one video changes everything for your channel? 1 min 
The DJI Pocket 4 & 4P Just Got a BIG Update! 9 min 
I Tested 47 Sony Cameras – These Are My Favorite! 18 min 
Your Next Budget PC Upgrade is...Custom Watercooling?? 25 min 
How to Start a Faceless YouTube Channel in 2026! 18 min 
Jakey - DRIVE OFF A BRIDGE (Official Video) 5 min 
Josh Johnson: The Comedian Taking Over YouTube 92 min 
What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 min 
DJI Pocket 4 & 4P ❌ USA 2 min 
How SubwayTakes Became the Internet's Favorite Show 97 min 
"How to Go Viral" Videos are Scams 12 min 
How AI Coding Agents Understand Your Codebase & Developer Tools 7 min 
9 YouTube Rules No One Talks About 14 min 
People are going to be angry about pylons. 8 min 
What Air Gap Really Means💨 1 min 
Surprising our editor with a car 2 min 
Match Day #PeppaPig #Shorts 1 min 
UV printing on a Smith Blade? @Morpho.Global #uvprinting #engineering 2 min 
1000+ hours of Learning Claude in 15 Minutes (Beginner to Pro) 15 min 
MYSTERY Button! #PeppaPigTales #Shorts #LEGODUPLO 1 min 
Going to School | Good Morning Song | Preschool Learning Song | BabyBus 20 min 
Play Ball Safely! | Good Habits & Safety Song for Preschoolers | BabyBus 34 min 
Don't Put It in Your Mouth | Baby Care & Home Safety | Kids Songs | BabyBus 21 min 
Our projects create A LOT of damage #Aiper #AiperIrriSense2 #SummerWithAiper #PrimeDay #2026PrimeDay 2 min 
The Force is strong with this build. The instructions are not #tbt #hacksmith #makeitreal #starwars 2 min 
AI News: Microsoft Finally Reveals Their Plan! 31 min 
YouTuber Merch Tier List 1 min 
Sapper's Tree 2 min 
World's LARGEST headphones! 1 min 
I Tried All The Best (and Worst) Doorbells 18 min 
THROUGH THE FIRE 6 min 
Unfolding 6 min 
The Best Wii Remote EVER! 1 min 
The Prisoner of Bogan 32 min 
I Cooled my PC with a SLUSHIE MACHINE 25 min 
LORN - THERE IS STILL TIME 2 min Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video's start: https://www.alignmentforum.org/posts/iGuwZTHWb6DFY3sKB/fact-finding-attempting-to-reverse-engineer-factual-recall Anthropic posts about superposition referenced near the end: https://transformer-circuits.pub/2022/toy_model/index.html https://transformer-circuits.pub/2023/monosemantic-features Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading list https://www.alignmentforum.org/posts/NfFST5Mio7BCAQHPA/an-extremely-opinionated-annotated-list-of-my-favourite Getting started in mechanistic interpretability https://www.neelnanda.io/mechanistic-interpretability/getting-started An interactive demo of sparse autoencoders (made by Neuronpedia) https://www.neuronpedia.org/gemma-scope#main Coding tutorials for mechanistic interpretability (made by ARENA) https://arena3-chapter1-transformer-interp.streamlit.app/ Звуковая дорожка на русском языке: Влад Бурмистров. Sections: 0:00 - Where facts in LLMs live 2:15 - Quick refresher on transformers 4:39 - Assumptions for our toy example 6:07 - Inside a multilayer perceptron 15:38 - Counting parameters 17:04 - Superposition 21:37 - Up next ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request