Neste
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 min 
What Was Pokemon Shock? | Fascinating Horror Shorts 1 min 
What is a "Body Farm"? | Fascinating Horror Shorts 1 min 
Blessing your feed with these vibrant birds 🩷 💛 💚 #Shorts #Animals #Wildlife 1 min 
Breathtaking Ocean Wildlife In 4K | BBC Earth 136 min 
How Switzerland Engineered the Perfect Country 44 min 
Why Brutality is the Key to Making the Ultimate Wolverine Game 15 min ![Attempting to sneak into Britain's biggest theme park [after rescuing a lamb on an epic marathon]](https://adm.6-9.space/storage/films/posters/yt_attempting-to-sneak-into-britains-biggest-theme-park-after-rescuing-a-lamb-on-an-epic-marathon_1789704329.jpg)
Attempting to sneak into Britain's biggest theme park [after rescuing a lamb on an epic marathon] 48 min 
Tuesday's Children helps kids who lost a parent in 9/11 attacks | 60 Minutes Archive 14 min 
Rome, Italy 🇮🇹 Ultimate Walking Tour – Colosseum, Pantheon & St. Peter's | 4K 60fps 538 min 
ASH 5 min 
Glass & Silver 4 min 
The Giant Rotting Pink Bunny in the Middle of Nowhere | Fascinating Horror Shorts 1 min 
Grandfather 2 min 
This Football Could End the World | Fascinating Horror Shorts 1 min 
Google Pixel 11 Hands on - The Phone Crisis Begins. 14 min 
DRAWN OUT LIKE AN ACHE 5 min 
History's Worst Elevator Accident: Vaal Reefs | Fascinating Horror 10 min 
Jakey - Pine Barrens (Official Music Video) 5 min 
I Pranked America's Most Racist Man 35 min 
He paid pardon brokers $600,000. He never got a pardon #shorts 2 min 
How The Fukushima Nuclear Plant Melted Down | Fascinating Horror 15 min 
My Thoughts on Wolverine 22 min 
SUBWAY PRANK👩🏽🪑 Rahe her acrobatics 1-10😂 1 min 
Annual Christmas mission 2024 with Welsh Greg: "Encircling Aldridge" 38 min 
This Planet Went Through the Death of Its Star - And Survived! 22 min 
Disgusting Freak Should Be Arrested 12 min 
Shouting at Stars: A History of Interstellar Messages 148 min 
Hollyland Lark A2: Best Budget Mic of 2026? 11 min 
DJI Pocket 4 vs Pocket 4P | Everything You Need to Know 16 min 
What Would Linus Save? 1 min 
How Developers Secure AI-Generated Code: 5 Security Best Practices 12 min 
Newly declassified videos show rescue of downed Air Force officers 2 days apart 4 min 
The Future of Trivia Gaming #electronics #trivia #experience #funny 2 min 
How to Use YouTube Studio in 2026! (Complete Guide) 19 min 
AI Can Write Your Draft But Not This #shorts 1 min 
How GPUs Accelerate Data & Analytics with AI 6 min 
We need to talk about the Hank Green situation 53 min 
How the YouTube Algorithm Actually Works 1 min 
I was not prepared for a mannequin that can bleed. 29 min 
What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 min 
Crypto Beyond Dark Web Myths 1 min 
The Difference Between TikTok and YouTube Algorithms 1 min 
Back to School | Good Habits for Kids | Educational | Sheriff Labrador | Kids Cartoon | BabyBus 66 min 
1 CLOVE in Your Coffee Every Morning (Here's What Happens) 8 min 
AI News: Claude Opus 4.8, Insane Omni Use-Case, and A Dog Translator? 23 min 
Rain Rain Go Away | Family Song for Kids | Nursery Rhymes & Kids Songs | BabyBus 19 min 
Claude Code Just Changed CapCut Forever! 30 min 
Peppa Makes Perfume 🌸 #shorts #peppapig 1 min 
Learn About Emotions and Feelings | Back to School | Kids Songs | BabyBus 23 min 
Help George FIND his hearing aid! 🦻 #PeppaPig #Shorts 1 min Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Pakker publisert av skaperen bak denne videoen.
Denne skaperen har ikke satt prisene sine ennå. Send en forespørsel, og vi videreformidler den — prisen avtales før noe belastes.
En tilbakevendende plass i innholdet mitt. Abonnenter går inn i en kø — eller en tilfeldig trekning når det er flere abonnenter enn plasser — og vises i selve videoen, i krediteringene eller i beskrivelsen.
per måned
Pris på forespørsel
En garantert opptreden på minst 10 sekunder i min neste video. Prisen avhenger av hvor i spilletiden innslaget havner.
Pris på forespørsel
En garantert opptreden på minst 10 sekunder i en Short klippet fra en av mine eksisterende videoer.
engangsbeløp
Pris på forespørsel