Ďalšie
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 min 
Aether & Iron - Announcement Trailer | PS5 & PS4 Games 2 min 
You Can Still be Prescribed Leeches | Fascinating Horror Shorts 1 min 
Mount Wilshire: The Volcano That Almost Destroyed LA | Fascinating Horror 11 min 
History's Worst Elevator Accident: Vaal Reefs | Fascinating Horror 10 min 
The Basement: Mitch Horowitz | Gandhi, Reagan, and the Occultists History Erased 173 min 
AI News: OpenAI Just Put the Brakes on AI 33 min 
What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts 1 min 
A peacock's feathers in all their glory 🦚 💙 #Shorts #Animals #Wildlife 1 min 
Disney's Animatronics: A Living History 106 min 
FARR 3 min 
This Cheese is Rotting, Maggot-Infested, Illegal and... Delicious? | Fascinating Horror Shorts 1 min 
DJI Pocket 4 vs Pocket 4P | Everything You Need to Know 16 min 
STRAIGHT PIPES 2 min 
The Truth About the "Whoop Killer" 18 min 
It Rained Shredded Meat From The Sky | Fascinating Horror Shorts 1 min 
Jakey - Pine Barrens (Official Music Video) 5 min 
INERTIA 2 min 
The Childhood Game Collection - Scott The Woz 138 min 
Sources: Iranians came within hundreds of meters of downed U.S. officer #shorts 1 min 
My Thoughts on Wolverine 22 min 
How Many Countries Can I Visit in 7 Days? 43 min 
Від чого втік генеральний прокурор 35 min 
OVERGROWTH — Dead City | Post Apocalyptic Action Thriller | 2026 Full Movie | English | 4K 62 min 
Solo in the Florida Tourists Never See 44 min 
Sunday on 60 Minutes: Patrick Clancy 1 min 
Archaeologists Found an Ancient Treasure Worth Millions in Belize 95 min 
Mr Bean Turns Teddy Into a Baby! 🧸 #mrbean #newmrbean2026 1 min 
The #1 Most Dangerous Thing for Your Skin 2 min 
Consumed by the Apocalypse 27 min 
JUMANJI: Open World (2026) Will It Be Game Over? 11 min 
Ads in Video Games 20 min 
Meta's new model wants "deep access" to your personal life... 6 min 
Minecraft Was Missing One Brilliant Idea 7 min 
AI Agents vs Business Rules: Which Should Make Decisions? 11 min 
I get excited about &. 24 min 
Code Quality in the Age of AI: Why Great Code Isn't Enough 14 min 
The New Rules of YouTube (2027) 66 min 
These people walk towards mining disasters. 22 min 
Is there a Priest Hole in Your House? | Fascinating Horror Shorts 1 min 
The Publishers Who Built Google Are Now Suing It #shorts 2 min 
DefunctTV: The History of Where in the World is Carmen Sandiego? 29 min 
Josh Johnson: The Comedian Taking Over YouTube 92 min 
1955 vs 2025, who actually had it better? 25 min 
The Dark Truth of the Panama Canal 41 min 
Should Kids Still Go To College? (Answering All Your Questions) 48 min 
George's QUIET Day 🔇 Day in the Life 📆 BRAND NEW Peppa Pig Tales Episodes 22 min 
Peppa Pig Plays CHEESE HOLE IN THE WALL!🧀 BRAND NEW Peppa Pig Tales Full Episodes | 35 Mins 36 min 
Making REAL Fallout Power Armor (Part 1/6) 23 min 
Peppa TRANSFORMS Old Rusty Bike #PeppaPig #Shorts 1 min 
This Glove Punches For You! (COLD GAS ROCKET FIST) 20 min Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request