Měsíční účast
za měsícOpakující se místo v mém obsahu. Odběratelé vstupují do fronty — nebo náhodného losu, když je odběratelů více než slotů — a objevují se v samotném videu, v titulkách nebo v popisu.
za měsíc
Cena na vyžádání
Další
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 min 
The Basement: Jeremy Corbell | Betrayal, Surveillance, and the Secret Higher Than Nuclear Weapons 240 min 
Abandoned - Stitch's Great Escape 25 min 
What toys have kids played with throughout history? 6 min 
Lisbon, Portugal 🇵🇹 | Summer 2026 | 4K HDR Walking Tour 185 min 
The Hunt for Xesh 34 min 
Archaeologists Found an Ancient Treasure Worth Millions in Belize 95 min 
Why USA 1.0 failed 33 min 
DefunctTV: The History of Where in the World is Carmen Sandiego? 29 min 
Dark Secrets Hidden in America’s Most Isolated Islands (nobody comes here) 39 min 
SEGA SUNSET 4 min 
"he's crazy" - We Found a Man Living Alone in the Amazon (39 years isolated) 43 min 
How Apple AirPods Work 19 min 
"He's not human" - The Most Isolated Man in the World 35 min 
144 Hours Stranded in the World's Most Unknown Country with No Phone 47 min 
Zero Gravity Is Weirder Than You Think (Bonus Episode) 12 min 
Digging A SECRET GARAGE Part 4 Digging Done! 26 min 
Earth to Mars in 10 Days 27 min 
Pilot 3 min 
The hinge for 1/4Ton DOOR 1 min ![A stroll around my hometown, Aldridge (and the stories that shaped my youth) [PART 1]](https://adm.6-9.space/storage/films/posters/yt_a-stroll-around-my-hometown-aldridge-and-the-stories-that-shaped-my-youth-part-1_1789704139.jpg)
A stroll around my hometown, Aldridge (and the stories that shaped my youth) [PART 1] 40 min 
This Football Could End the World | Fascinating Horror Shorts 1 min 
Will Smith Surprising My Egyptian Dad! 3 min 
Neighbours reaction #secretgarage 2 min 
The Wild Story of the Teton Dam Failure 20 min 
Lindsey Clancy and the surprisingly simple solution to helping moms with postpartum depression 2 min 
4 ways to tell a great story 6 min 
I Promise you this is NOT Stupid 10 min 
A wake-up call for the Democratic establishment | America, Actually 48 min 
Meet the slow loris, the only venomous primate in existence - Stephanie A. Poindexter 6 min 
I cannot believe Jodrell Bank let me do this 24 min 
Five things you need to know for the 2026 midterms | America, Actually 31 min 
Gridlocked with deloreans #backtothefutureday 1 min 
RECAP: First Punic War 3 min 
I Built a Fake Home Theater in the Tech House… 18 min 
How Did Tuberculosis Get So Bad? #science #scishow #tuberculosis #health 1 min 
Germ Theory Is Older Than You Think 1 min 
Become a patron of TED-Ed! #shorts 1 min 
Earth's Crust and Mantle Explained: Crash Course Geology #3 11 min 
What is Juneteenth, and why is it important? #shorts #juneteenth 1 min 
The Hidden Engineering of Runways 19 min 
Why do nipples become erect? 2 min 
The Los Angeles Aqueduct is Wild 23 min 
Blake Scholl: How 50 People Built a Supersonic Jet 51 min 
Peppa's FUTURISTIC Mirror #PeppaPig #Shorts 1 min 
UV printing on a Smith Blade? @Morpho.Global #uvprinting #engineering 2 min 
What happens when we coat a pingpong ball with metal? #tbt #hacksmith #makeitreal 2 min 
Tales VS Toys: Valentine's Spy Mission 💗 #PeppaPig #Shorts #toys #toyplay 1 min 
How To Survive Being Eaten 10 min 
Some of the STRANGEST borders I've visited 18 min 
Scientists Can't Agree On The First Ancient City 26 min Attention in transformers, step-by-step | Deep Learning Chapter 6
2024 27 min
Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Pracujte s tímto tvůrcem
Balíčky publikované tvůrcem tohoto videa.
Tento tvůrce si ještě nenastavil své sazby. Odešlete žádost a my ji předáme — cena je dohodnuta před jakýmkoli účtováním.
Garantované umístění — nové video
jednorázověGarantované objevení se po dobu nejméně 10 sekund v mém dalším videu. Cena závisí na tom, kam se vložka v průběhu času umístí.
- První 1–3 minuty
- Střed videa
- Konec videa
Cena na vyžádání
- První 1–3 minuty
- Střed videa
- Konec videa
Garantované umístění — Short
jednorázověGarantované objevení se po dobu nejméně 10 sekund v Shortu sestříhaném z jednoho z mých stávajících videí.
jednorázově
Cena na vyžádání