Щомісячна участь
на місяцьРегулярне місце в моєму контенті. Підписники потрапляють у чергу — або у випадковий розіграш, коли підписників більше, ніж слотів, — і з'являються в самому відео, у титрах або в описі.
на місяць
Ціна за запитом
Далі
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 хв 
Abandoned - Jungleland Zoo Florida 20 хв 
Love language, bird edition 🪶 #Shorts #Animals 1 хв 
Godzilla x Kong: Supernova #shorts #godzilla #godzillaxkong #godzillaxkongsupernova 1 хв 
Warcraft III Reforged: Forsaken Kingdom Reveal Trailer | BlizzCon 2026 2 хв 
New StarCraft Gameplay Details & a Promised Release Date 9 хв 
The Story Behind "The Day The Music Died" | Fascinating Horror 12 хв 
The Story Of Shriya Shah-Klorfine | Fascinating Horror 13 хв 
Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive 38 хв 
Two Hours Of Extraordinary Wildlife Scenes | BBC Earth 128 хв 
The Bath Curse Tablets | Fascinating Horror Shorts 1 хв 
I Tested YouTubers' Favourite Products 30 хв 
How to Plan Winning YouTube Videos (Step-by-Step) 13 хв 
LORN - ALT.VEL.PTCH 3 хв 
The Luna Ultra Just Got Better! (Big Firmware Update!) 9 хв 
A Deadly Mistake When On Safari | Fascinating Horror 11 хв 
Super Mario 64 DS | The Best Worst Version - Scott The Woz 43 хв 
The Annual Release - Scott The Woz 17 хв 
Furnace 4 хв 
Don't Deep Fry Your Turkey | Fascinating Horror Shorts 1 хв 
Mr Rizz IRL 1 хв 
He Forgot The Most Important Thing | Fascinating Horror Shorts 1 хв 
The RFK Jr. Saga | A Campaign of Chaos and Conspiracy 82 хв 
The Europe-Africa Tunnel Could Become History's Biggest Mistake 53 хв 
This Planet Went Through the Death of Its Star - And Survived! 22 хв 
Anthropic reveals hardware specs and Claude updates, OpenAI talks security, and Runway's new model 35 хв 
Save or Poison 😈☠️ Who win?👻🏆 1 хв 
This Fence Completely Humiliates Mr Bean 😂 #mrbean #newmrbean2026 1 хв 
I'm so glad this hidden monorail broke down. 28 хв 
How Developers Secure AI-Generated Code: 5 Security Best Practices 12 хв 
The Newspaper | Mr Bean Animated | Season 2 Episode 13 | Full Episode | Mr Bean 11 хв 
Bond 26 (2027) Henry Cavill & Margot Robbie 9 хв 
Mr Bean Finally Wins... But This Boy Has Other Ideas 🪙 | Mr Bean Live Action | Funny Clips | Mr Bean 43 хв 
Miles Morales (2027) Caleb McLaughlin & Tom Holland 10 хв 
AI Employees, Explained in 12 Minutes (For Business Owners, Not Coders) 13 хв 
Why won’t AI agents just follow the rules? 36 хв 
We need to talk about the Hank Green situation 53 хв 
Fixing Tom Brady’s YouTube Channel 1 хв 
How well do you ACTUALLY know business? 1 хв 
How to Film Cinematic Vlogs By Yourself! (with the Luna Ultra) 13 хв 
My burned down car. 13 хв 
The "Ride The Ducks" Disaster | Fascinating Horror 14 хв 
📆 Consistency is the Real Growth Hack 1 хв 
AI News: An INSANE Week… Here’s What Matters 28 хв 
Peppa and George Play with WALKIE TALKIES 🛜 Peppa Pig Full Episodes | 1 Hour of Kids Cartoons 63 хв 
GLM-5.2: The Complete Guide to the Best Open-Source Model 29 хв 
Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO 1 хв 
Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥 12 хв 
Desert Island Adventure 🏝️ #shorts #peppapig 1 хв 
Lucky Dip Prizes 🎁 #shorts #peppapig 1 хв 
Help George FIND his hearing aid! 🦻 #PeppaPig #Shorts 1 хв Attention in transformers, step-by-step | Deep Learning Chapter 6
2024 27 хв
Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Працюйте з цим творцем
Пакети, опубліковані творцем цього відео.
Цей творець ще не встановив свої тарифи. Надішліть запит, і ми передамо його — ціна узгоджується до будь-яких списань.
Гарантоване розміщення — нове відео
разовоГарантована поява щонайменше 10 секунд у моєму наступному відео. Ціна залежить від того, куди у часі потрапляє вставка.
- Перші 1–3 хвилини
- Середина відео
- Кінець відео
Ціна за запитом
- Перші 1–3 хвилини
- Середина відео
- Кінець відео
Гарантоване розміщення — Short
разовоГарантована поява щонайменше 10 секунд у Short, нарізаному з одного з моїх існуючих відео.
разово
Ціна за запитом