पुढील
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 मिनिटे 
What Was Pokemon Shock? | Fascinating Horror Shorts 1 मिनिटे 
What is a "Body Farm"? | Fascinating Horror Shorts 1 मिनिटे 
Blessing your feed with these vibrant birds 🩷 💛 💚 #Shorts #Animals #Wildlife 1 मिनिटे 
Breathtaking Ocean Wildlife In 4K | BBC Earth 136 मिनिटे 
How Switzerland Engineered the Perfect Country 44 मिनिटे 
Why Brutality is the Key to Making the Ultimate Wolverine Game 15 मिनिटे ![Attempting to sneak into Britain's biggest theme park [after rescuing a lamb on an epic marathon]](https://adm.6-9.space/storage/films/posters/yt_attempting-to-sneak-into-britains-biggest-theme-park-after-rescuing-a-lamb-on-an-epic-marathon_1789704329.jpg)
Attempting to sneak into Britain's biggest theme park [after rescuing a lamb on an epic marathon] 48 मिनिटे 
Tuesday's Children helps kids who lost a parent in 9/11 attacks | 60 Minutes Archive 14 मिनिटे 
Rome, Italy 🇮🇹 Ultimate Walking Tour – Colosseum, Pantheon & St. Peter's | 4K 60fps 538 मिनिटे 
ASH 5 मिनिटे 
Glass & Silver 4 मिनिटे 
The Giant Rotting Pink Bunny in the Middle of Nowhere | Fascinating Horror Shorts 1 मिनिटे 
Grandfather 2 मिनिटे 
This Football Could End the World | Fascinating Horror Shorts 1 मिनिटे 
Google Pixel 11 Hands on - The Phone Crisis Begins. 14 मिनिटे 
DRAWN OUT LIKE AN ACHE 5 मिनिटे 
History's Worst Elevator Accident: Vaal Reefs | Fascinating Horror 10 मिनिटे 
Jakey - Pine Barrens (Official Music Video) 5 मिनिटे 
I Pranked America's Most Racist Man 35 मिनिटे 
He paid pardon brokers $600,000. He never got a pardon #shorts 2 मिनिटे 
How The Fukushima Nuclear Plant Melted Down | Fascinating Horror 15 मिनिटे 
My Thoughts on Wolverine 22 मिनिटे 
SUBWAY PRANK👩🏽🪑 Rahe her acrobatics 1-10😂 1 मिनिटे 
Annual Christmas mission 2024 with Welsh Greg: "Encircling Aldridge" 38 मिनिटे 
This Planet Went Through the Death of Its Star - And Survived! 22 मिनिटे 
Disgusting Freak Should Be Arrested 12 मिनिटे 
Shouting at Stars: A History of Interstellar Messages 148 मिनिटे 
Hollyland Lark A2: Best Budget Mic of 2026? 11 मिनिटे 
DJI Pocket 4 vs Pocket 4P | Everything You Need to Know 16 मिनिटे 
What Would Linus Save? 1 मिनिटे 
How Developers Secure AI-Generated Code: 5 Security Best Practices 12 मिनिटे 
Newly declassified videos show rescue of downed Air Force officers 2 days apart 4 मिनिटे 
The Future of Trivia Gaming #electronics #trivia #experience #funny 2 मिनिटे 
How to Use YouTube Studio in 2026! (Complete Guide) 19 मिनिटे 
AI Can Write Your Draft But Not This #shorts 1 मिनिटे 
How GPUs Accelerate Data & Analytics with AI 6 मिनिटे 
We need to talk about the Hank Green situation 53 मिनिटे 
How the YouTube Algorithm Actually Works 1 मिनिटे 
I was not prepared for a mannequin that can bleed. 29 मिनिटे 
What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 मिनिटे 
Crypto Beyond Dark Web Myths 1 मिनिटे 
The Difference Between TikTok and YouTube Algorithms 1 मिनिटे 
Back to School | Good Habits for Kids | Educational | Sheriff Labrador | Kids Cartoon | BabyBus 66 मिनिटे 
1 CLOVE in Your Coffee Every Morning (Here's What Happens) 8 मिनिटे 
AI News: Claude Opus 4.8, Insane Omni Use-Case, and A Dog Translator? 23 मिनिटे 
Rain Rain Go Away | Family Song for Kids | Nursery Rhymes & Kids Songs | BabyBus 19 मिनिटे 
Claude Code Just Changed CapCut Forever! 30 मिनिटे 
Peppa Makes Perfume 🌸 #shorts #peppapig 1 मिनिटे 
Learn About Emotions and Feelings | Back to School | Kids Songs | BabyBus 23 मिनिटे 
Help George FIND his hearing aid! 🦻 #PeppaPig #Shorts 1 मिनिटे Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request