Susunod
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 min 
Defunctland: The History of Disneyland's Adventure Thru Inner Space 36 min 
The World's Most Ignored War Explained 33 min 
Investment firm devastated by 9/11 14 min 
The Story of Bill Stephens | Fascinating Horror Shorts 1 min 
They Left 6,000 Sheep on an Empty Island - Then This Happened 10 min 
Defunctland: The History of the Worst SeaWorld Ride, Submarine Quest 22 min 
Disney Channel's Theme: A History Mystery 92 min 
Extremely Rare Jaguar Filmed On Camera Trap | Expedition Guyana | BBC Earth 3 min 
Two Hours Of Extraordinary Wildlife Scenes | BBC Earth 128 min 
Hijack 6 min 
$10,000 Power Washer vs Fruit 1 min 
I Tested Smartphones from Every Country 25 min 
Google Pixel 11/Pro Review: Poker Face 13 min 
Gamer Products - Scott The Woz 7 min 
Is there a Priest Hole in Your House? | Fascinating Horror Shorts 1 min 
LAST TO LEAVE THE SCHOOL 91 min 
Wii U: Birth of a Death (Part I) - Scott The Woz 109 min 
Can Frogs Power a Lightbulb? | Fascinating Horror Shorts 1 min 
10 EXTINCT Animals Scientists Are Trying to Bring Back to Life in 2027 97 min 
Life in New Mexico’s Most Isolated Towns 51 min ![RATCHET AND CLANK TOOLS OF DESTRUCTION Gameplay Walkthrough FULL GAME [4K 60FPS PS5] - No Commentary](https://adm.6-9.space/storage/films/posters/yt_ratchet-and-clank-tools-of-destruction-gameplay-walkthrough-full-game-4k-60fps-ps5-no-commentary_1789426817.jpg)
RATCHET AND CLANK TOOLS OF DESTRUCTION Gameplay Walkthrough FULL GAME [4K 60FPS PS5] - No Commentary 352 min 
Too Stubborn To Die: Vesna Vulović | Fascinating Horror Shorts 1 min 
People Are Very Mad at Sony for This 13 min 
Jump or Burn: The Luxor Balloon Crash | Fascinating Horror 12 min 
I PRANKED The News 13 min 
The Story Of Shriya Shah-Klorfine | Fascinating Horror 13 min 
Abandoned - Disney World's Discovery Island 39 min 
Defunctland: The Awful Wiggles Dark Ride 40 min 
What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 min 
5 open source tools that replaced my $320/mo AI stack... 6 min 
There’s NO Excuse Not To Try Linux! 18 min 
IBM’s mainframe chip collab, NVIDIA’s Poolside deal & Ox Alpha’s reveal 31 min 
Alita Battle Angel 2 #shorts #alita #alitabattleangel2 #alita2 1 min 
I Promise you this is NOT Stupid 10 min 
$69 on eBay. And it's a legitimate camera. 🤯 1 min 
This 100-year-old ride must never change again. 17 min 
Distracted By The Scenery? The 1986 Grand Canyon Crash | Fascinating Horror 11 min 
"I feel like I've just destroyed evidence!" 30 min 
Why the Biggest YouTube Family Just Went to Netflix: Jordan Matter 39 min 
Why 3 Out of 4 Marketers Are Burned Out #shorts 2 min 
Rethinking the ROI of cybersecurity 1 min 
The Training Exercise That Killed 700 Troops | Fascinating Horror 12 min 
The Force is strong with this build. The instructions are not #tbt #hacksmith #makeitreal #starwars 2 min 
Don't Put It in Your Mouth | Baby Care & Home Safety | Kids Songs | BabyBus 21 min 
Baby Evie's PLAY House! #PeppaPig #Shorts 1 min 
We're building a REAL LIFE BATMOBILE | EP.1 32 min 
AI News: The AI World is REALLY Scared Right Now 36 min 
We've kept this project secret for months! 19 min 
Going to School | Good Morning Song | Preschool Learning Song | BabyBus 20 min 
AI News: Microsoft Finally Reveals Their Plan! 31 min Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request