Kitas
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 min 
Breathtaking Ocean Wildlife In 4K | BBC Earth 136 min 
Cancelled - Paramount Park Spain 14 min 
Cyclops (2027) Kit Connor & Samara Weaving 9 min 
Disney's Living Characters: A Broken Promise 259 min 
It Rained Shredded Meat From The Sky | Fascinating Horror Shorts 1 min 
The Secret Behaviours of Animal Packs | BBC Earth 
Prophecy of the Popes | Saint Malachy's Countdown 42 min 
Nature's silent predator at work 🦉 #Shorts #Animals #Wildlife 1 min 
The World's Most Ignored War Explained 33 min 
The Golden Age of Mobile Gaming - Scott The Woz 60 min 
LORN - UPSIDE DOWN COPS 4 min 
LORN - ALT.VEL.PTCH 3 min 
The Deadly 36c/97f British Heatwave of 1976 | Fascinating Horror 12 min 
The Awful Origins of "Sweet FA" | Fascinating Horror Shorts 1 min 
History's Worst Elevator Accident: Vaal Reefs | Fascinating Horror 10 min 
Until There Is No End 5 min 
Samsung Z Fold/Flip 8 Hands on - Fold ULTRA?? 17 min 
Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition) 47 min 
Scary Cat in the Hat Trend Causing Panic 10 min 
The Europe-Africa Tunnel Could Become History's Biggest Mistake 53 min 
Horrible Coward Has Been Identified 18 min 
Disgusting Freak Should Be Arrested 12 min 
Blinded By A Rollercoaster: The Problem With Dragon Challenge | Fascinating Horror 10 min 
The #1 Best Vitamin for Arthritis 1 min 
Pardon brokers defend their business #shorts 1 min 
They Call It A "Drowning Machine" | Fascinating Horror Shorts 1 min 
1000 feet of wireless range on a mic this small 🤯 1 min 
LORN - PAWO 3 min 
There’s something wrong with Hallmark’s youtube channel 19 min 
BETA SQUAD ROAD TRIP: USA EDITION 112 min 
Bashenga: The First Black Panther (2027) John Boyega & Tyrese Gibson 9 min 
AI Agents vs Business Rules: Which Should Make Decisions? 11 min 
DJI Pocket 4P vs Insta360 Luna Ultra: Which Is Actually Better? 21 min 
Insta360 Mic Pro is built for creators 1 min 
I Tested 21 Vlogging Cameras in 2026! (so you don't have to) 32 min 
This mic sounds like it costs way more 🎙️ 1 min 
Are XTRA and DJI secretly affiliated? 🤫 1 min 
Psychedelics, mind control, radiation-eating: The secret superpowers of fungi - Max G. Levy 7 min 
The Publishers Who Built Google Are Now Suing It #shorts 2 min 
I got hit in the teeth at England's oldest ritual 16 min 
How IShowSpeed Went from Bedroom Streamer to Global Star 2 min 
The Internet Era Nobody Asked For 42 min 
Your Brain Peaked at Birth 2 min 
Don't Put It in Your Mouth | Baby Care & Home Safety | Kids Songs | BabyBus 21 min 
Escape From the Zoo #PeppaPig #Shorts 1 min 
The Missing Piece of Fallout Power Armor | Power Armor (Part 8/6) 34 min 
The coolest desktop CNC machine I've seen 🔥 #cnc #3Ddesign #engineering 1 min 
DOUGHNUT FACTORY #PeppaPig #Shorts 1 min 
I Built a FREE App That Runs Your Entire Business 28 min 
Boat Picnic 🧺 #shorts #peppapig 1 min Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request