ถัดไป
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 นาที 
Steve Backshall Dives Into Crocodile Territory | Expedition Guyana | BBC Earth 3 นาที 
Brokers are offering felons a path to Trump pardons — at a steep price with no guarantees 14 นาที 
AI News: OpenAI Just Put the Brakes on AI 33 นาที 
Extraordinary Bear Moments | BBC Earth 22 นาที 
Inside a harrowing escape from the World Trade Center on 9/11 | 60 Minutes Archive 8 นาที 
Play History: The Games That Made Erika Ishii 3 นาที 
Bankrupt - Hollywood Video 17 นาที 
A sneak peek of Sir David Attenborough working on the narration for the upcoming BLUE PLANET III. 1 นาที 
DefunctTV: The History of Buzz Lightyear of Star Command 25 นาที 
Pilot 3 นาที 
I tested every new Apple Product! 15 นาที 
I Said Yes to Every Email for a Month! (Again) 31 นาที 
I tested Dream Tech with my Biggest Fans! 15 นาที 
I bought the most CURSED TECH on the internet ft. KSI 25 นาที 
REQUIEM 4 นาที 
Affordable YouTube Gear that is Totally Worth It 2026 24 นาที 
The Deadly 36c/97f British Heatwave of 1976 | Fascinating Horror 12 นาที 
How I wasted $52,000 in my Dream Smart Home 20 นาที 
The Japanese Tsunami That Killed 20,000 People | Fascinating Horror 12 นาที 
Milkoi - LAST TIME | Glitch Hop | NCS - Copyright Free Music 3 นาที 
Mount Wilshire: The Volcano That Almost Destroyed LA | Fascinating Horror 11 นาที 
Distracted By The Scenery? The 1986 Grand Canyon Crash | Fascinating Horror 11 นาที 
Sec. Hegseth’s initial reaction to the U.S. fighter jet being shot down: “S***” #shorts 1 นาที 
Sources: Iranians came within hundreds of meters of downed U.S. officer #shorts 1 นาที 
Brunch with me 🤤🌸🍓🥞🥐🥖🌿 1 นาที 
This 3 day solo winter hike may well have changed my life... 70 นาที 
BAT-GARAGE Tour + BAT-SIGNAL Restoration (MEMBERS EXCLUSIVE) 12 นาที 
Abandoned - Nara Dreamland 17 นาที 
Plasma Speaker DIY (AM Demodulator) 11 นาที 
Steam Frame Review - This Changes Everything 24 นาที 
The Most Interesting Displays In The World! 16 นาที 
Newly declassified videos show rescue of downed Air Force officers 2 days apart 4 นาที 
Google DeepMind CEO Loves Hard Questions 🙂 1 นาที 
Mr Bean's Hotel Holiday Goes VERY Wrong! 🏨 | Mr Bean Live Action | Full Episodes | Mr Bean 75 นาที 
Defunctland: The History of the Worst SeaWorld Ride, Submarine Quest 22 นาที 
DJI Pocket 4 vs 3 1 นาที 
How Do We Write Backwards?! 🤯 1 นาที 
How TV’s are Changing YouTube 1 นาที 
Smart AI routing explained 1 นาที 
YouTube Just Removed the Dislike Button 1 นาที 
I got hit in the teeth at England's oldest ritual 16 นาที 
This Led To The Sterile Cockpit Rule: Eastern Airlines 212 | Fascinating Horror 12 นาที 
The Dark Truth of the Panama Canal 41 นาที 
Using a Schlieren Lens to Visualize Air Flow! (Members Update #47) 8 นาที 
Escape From the Zoo #PeppaPig #Shorts 1 นาที 
wHeRE's tHe PowEr ArmOR? 😵💫🤖 #fallout #engineering #videogames 1 นาที 
But how do AI images and videos actually work? | Guest video by Welch Labs 38 นาที 
Cruise Party | Safety Rules for Kids | Good Habits | Sheriff Labrador | Kids Cartoon | BabyBus 29 นาที 
The Force is strong with this build. The instructions are not #tbt #hacksmith #makeitreal #starwars 2 นาที 
Peppa Pig Tales 2026 🫣 Peppa Plays CAMOUFLAGE HIDE AND SEEK! 👀 BRAND NEW Peppa Pig Episodes 31 นาที Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request