Sıradaki
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 dk 
Their parents left for work and never came home: From the 9/11 archives 13 dk 
La Bola Negra | In Theaters October 16 1 dk 
The Modern Middle East, Explained 187 dk 
Passenger Ferry Sinks While The Crew Parties - The MV Dona Paz | Fascinating Horror 12 dk 
BIOSHOCK 2 + DLC Full Gameplay Walkthrough / No Commentary【FULL GAME】4K 60FPS Ultra HD 602 dk 
The FDNY band that played at funerals for fallen brothers | 60 Minutes Archive 12 dk 
They Left 6,000 Sheep on an Empty Island - Then This Happened 10 dk 
The Japanese Tsunami That Killed 20,000 People | Fascinating Horror 12 dk 
Why do Human Feet Wash up on This Beach? | Fascinating Horror Shorts 1 dk 
Horror Games - Scott The Woz 31 dk 
Automaton 4 dk 
OUT OF THE FRAME 5 dk 
L'APPEL DU VIDE 6 dk 
UNDEAD DOGS 1 dk 
Solar Farms in Space - Reflect Orbital 32 dk 
Mac vs Windows - It's not close in 2026! 22 dk 
Unfolding 6 dk 
Прохождение стартовой локации на 100% (A Difficult Game About Climbing) 33 dk 
I Travelled Around The Entire Earth With $0: AUSTRALIA 72 dk 
The Rust Movie Set Accident | Fascinating Horror 14 dk 
The Unsolved Mystery of The Oakville Blobs | Fascinating Horror Shorts 1 dk 
He Built a Better Way to Live Off-Grid (40 Acres) 52 dk 
Archaeologists Found an Ancient Treasure Worth Millions in Belize 95 dk 
What Happened On The Jetline Coaster? | Fascinating Horror 12 dk 
Abandoned - Terrible's Hotel & Casino (Jean, Nevada) 20 dk 
Scientists Found Perfect Geometric Structures Beneath the Mediterranean 20 dk 
LAST TO LEAVE THE FOOTBALL PITCH 63 dk 
What is sumo, and why is it so popular? - Lee Thompson 6 dk 
Annual Christmas mission 2024 with Welsh Greg: "Encircling Aldridge" 38 dk 
There’s NO Excuse Not To Try Linux! 18 dk 
BE SLOW, GET SHOCKED!!! (feat. @Kouman ) 19 dk 
The Handwich: Disney's Failed Sandwich of the Future 24 dk 
How do Maglev trains work? - Ning Zhao 7 dk 
The Most Interesting Displays In The World! 16 dk 
Why is everyone suddenly neurodivergent? 8 dk 
The Biggest Lie About AI 6 dk 
People are going to be angry about pylons. 8 dk 
This Led To The Sterile Cockpit Rule: Eastern Airlines 212 | Fascinating Horror 12 dk 
Why your best ideas usually start as bad ones | Think Like A Musician 5 dk 
What Happens When Science Clashes with the Public?: Crash Course Scientific Thinking #7 13 dk 
The missing ingredient in how we learn 6 dk 
It’s not to stop you from rolling over 2 dk 
Peppa Meets a Hedgehog 🦔 #shorts #peppapig 1 dk 
Tales VS Toys: Dollhouse DISASTER! 🏠 #PeppaPig #Shorts #toys #toyplay 1 dk 
My Donkey Got a Boo-Boo | Caring & Doctor Song for Preschoolers | BabyBus 24 dk 
I almost quit YouTube.... 24 dk 
George LOVES Dancing to Squashpuff Shake! 🕺🎶 Peppa Pig Tales Episodes | 20 Minutes 22 dk 
AI News: Claude Opus 4.8, Insane Omni Use-Case, and A Dog Translator? 23 dk 
Should Kids Still Go To College? (Answering All Your Questions) 48 dk 
The fastest way to board a plane, according to mathematics - Rachel Yang 6 dk Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request