بعدی
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 دقیقه 
The Deadly 36c/97f British Heatwave of 1976 | Fascinating Horror 12 دقیقه 
Tomb Raider: Legacy of Atlantis Could Be Great, But There's Some Things We Can't Ignore... 12 دقیقه 
The Rust Movie Set Accident | Fascinating Horror 14 دقیقه 
Why do Human Feet Wash up on This Beach? | Fascinating Horror Shorts 1 دقیقه 
What’s really happening in the ocean’s “dark zones” 32 دقیقه 
They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror 11 دقیقه 
Defunctland: Walt Disney's City of the Future, E.P.C.O.T. 50 دقیقه 
The Publishers Who Built Google Are Now Suing It #shorts 2 دقیقه 
China's Hidden Wilderness | Double Episode - Wild China | BBC Earth 
Void II 3 دقیقه 
Digging A SECRET GARAGE Part 1 25 دقیقه 
HEX 2 دقیقه 
How Tech Companies Lie to You. 25 دقیقه 
LORN - THERE AIN'T NOTHING IT'S JUST PAIN AND THEN YER GONE 2 دقیقه 
I Made a Bet with Tesla 12 دقیقه 
1950's ATV Concept Build Part 2 18 دقیقه 
The Magnet Suspension Bike 27 دقیقه 
Android 17 Is the Biggest Upgrade in Years 18 دقیقه 
The Bizarre Bases of Antenna Towers 19 دقیقه 
Lynxie - Nothing Left To Lose | House | NCS - Copyright Free Music 3 دقیقه 
BETA SQUAD MAFIA GAME: YOUTUBER ALL STARS EDITION 68 دقیقه 
Small details take Time 2 دقیقه 
Stopping the Unstoppable 16 دقیقه 
Killed By A View Of Mount Fuji: BOAC Flight 911 | Fascinating Horror 11 دقیقه 
Dating Girls In Front Of Their Dads 14 دقیقه 
How Private Equity Ruined American Youth Sports 19 دقیقه 
What should security leaders do with AI? They don’t know. 30 دقیقه 
Abandoned - Fort Rapids Indoor Water Park 19 دقیقه 
A wake-up call for the Democratic establishment | America, Actually 48 دقیقه 
The Unbreakable Kryptos Code 48 دقیقه 
Why we can’t stop thinking about aliens | The Gray Area 48 دقیقه 
So You Want to Build a Tunnel... 21 دقیقه 
S̶i̶l̶k̶s̶o̶n̶g̶ NakeyJakey is Outdated 42 دقیقه 
Ever walk into a room and forget what you were doing? - Gabriel Radvansky 6 دقیقه 
Why is everyone suddenly neurodivergent? 8 دقیقه 
How to attack (and defend) a medieval castle - Connor C. Wilson 6 دقیقه 
Have you HEARD this?? 2 دقیقه 
Is it Possible to Prepare for an Earthquake?: Crash Course Geology #15 13 دقیقه 
They’re cooking our brains, for real! #science #pollution 2 دقیقه 
Scientists Finally Figured Out Why This River Flows Uphill 12 دقیقه 
The Insane Engineering of Europa Clipper 21 دقیقه 
The Insane Engineering of the F-14 Tomcat 30 دقیقه 
What Dinosaurs, Pyramids, and the Atomic Bomb Have in Common 2 دقیقه 
Peppa Pig Tales 2026 🤫 Peppa Finds a SECRET Shop Passageway 🔒 BRAND NEW Peppa Pig Episodes 31 دقیقه 
AI News: GPT-5.6 and the new Super App are a Massive Leap! 39 دقیقه 
i didn't want to like this.... 18 دقیقه 
Taking Care of Baby Dino | Dinosaur Song | Baby Care | Nursery Rhymes & Kids Songs | BabyBus 32 دقیقه 
Boat Picnic 🧺 #shorts #peppapig 1 دقیقه 
Row Your Boat Song 🚣 #shorts #peppapig 1 دقیقه 
Why your best ideas usually start as bad ones | Think Like A Musician 5 دقیقه Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request