ਅਗਲਾ
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 ਮਿੰਟ 
Lisbon, Portugal 🇵🇹 | Summer 2026 | 4K HDR Walking Tour 185 ਮਿੰਟ 
Wildlife Of Japan & China In 4K | BBC Earth 42 ਮਿੰਟ 
The Biggest Aquarium Collapse in History | Fascinating Horror Shorts 1 ਮਿੰਟ 
They Found 4,500-Year-Old Giant Dams Near Egypt's Pyramids 10 ਮਿੰਟ 
Their parents left for work and never came home: From the 9/11 archives 13 ਮਿੰਟ 
DeepSeek is back... and Silicon Valley is terrified 6 ਮਿੰਟ 
The weird history of the internet... 9 ਮਿੰਟ 
He Predicted His Death: Clairvaux's Grim Prophecy Comes True! #shorts 1 ਮਿੰਟ 
Preparing for 9/11 trials inside Guantanamo | 60 Minutes Archive 14 ਮਿੰਟ 
The Truth About the "Whoop Killer" 18 ਮਿੰਟ 
Why do Human Feet Wash up on This Beach? | Fascinating Horror Shorts 1 ਮਿੰਟ 
Nintendo Switch: Six Years In - Scott The Woz 130 ਮਿੰਟ 
Folding 2 ਮਿੰਟ 
Greatest Silence 3 ਮਿੰਟ 
TIMESINK 5 ਮਿੰਟ 
PAUSE 4 ਮਿੰਟ 
A Deadly Mistake When On Safari | Fascinating Horror 11 ਮਿੰਟ 
iPhone 18 Pro Review: All About that Chip 17 ਮਿੰਟ 
titan speakerman vs. astros (skibidi toilet 81) 1 ਮਿੰਟ 
Defunctland VR: 20,000 Leagues Under the Sea 15 ਮਿੰਟ 
They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror 11 ਮਿੰਟ 
a colorful front lit scene from a version of a muppets sitcom done entirely with white trash mupp... 1 ਮਿੰਟ 
Побачив інший бік Кореї… і я приголомшений! 35 ਮਿੰਟ 
Luna Pro 4K Vertical Video Is a HUGE Upgrade! 1 ਮਿੰਟ 
This Might Actually Work 1 ਮਿੰਟ 
Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥 12 ਮਿੰਟ 
Alita Battle Angel 2 #shorts #alita #alitabattleangel2 #alita2 1 ਮਿੰਟ 
Numb & Tingling Feet? How to Reverse Nerve Damage 7 ਮਿੰਟ 
What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 ਮਿੰਟ 
Zara Larsson - Midnight Sun (Lyrics) 4 ਮਿੰਟ 
I took a long walk on a dangerous beach. 27 ਮਿੰਟ 
5 open source tools that replaced my $320/mo AI stack... 6 ਮਿੰਟ 
Crazy Larper Scammed $1.3 Million from Victims 23 ਮਿੰਟ 
LORN - PAWO 3 ਮਿੰਟ 
Defunctland: The History of Disneyland's Adventure Thru Inner Space 36 ਮਿੰਟ 
What Is Digital Sovereignty? AI, Data & Control Explained 10 ਮਿੰਟ 
The YouTube Playbook in 37 Minutes 38 ਮਿੰਟ 
This was a hard year. 13 ਮਿੰਟ 
How TV’s are Changing YouTube 1 ਮਿੰਟ 
Passkeys Stop Phishing Attacks🎣 2 ਮਿੰਟ 
DefunctTV: The History of Under the Umbrella Tree 26 ਮਿੰਟ 
I'm so glad this hidden monorail broke down. 28 ਮਿੰਟ 
Baby Evie's in JAIL! 🚔 #PeppaPig #Shorts 1 ਮਿੰਟ 
Trying To Solve The Biggest AI Problem 21 ਮਿੰਟ 
Peppa Pig Tales 2026 🤫 Peppa Finds a SECRET Shop Passageway 🔒 BRAND NEW Peppa Pig Episodes 31 ਮਿੰਟ 
CANOE Obstacle Race! 🛶 #PeppaPigTales #Shorts #LEGODUPLO 1 ਮਿੰਟ 
Julia Roberts Discovers Dolce Far Niente | Eat Pray Love 3 ਮਿੰਟ 
Kids in the Escape Room Challenge | Learn Colors | Learn Teamwork | Kids Songs | BabyBus 32 ਮਿੰਟ 
Peppa Pig Finds a SECRET Shop Passageway 🤫🔒 #PeppaPig #Shorts 1 ਮਿੰਟ 
Covering the POWER ARMOR in this SUPER ALLOY | Real Life Power Armor (Part 9/6) 30 ਮਿੰਟ Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request