À suivre
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 min 
£1 Billion Treasure Found in Scotland - After 400 Years 11 min 
The 28 pages of 9/11 intelligence that were in a secret vault | 60 Minutes Archive 15 min 
The Mysterious Swiss Lake Monster | Fascinating Horror Shorts 1 min 
Inside a harrowing escape from the World Trade Center on 9/11 | 60 Minutes Archive 8 min 
Love language, bird edition 🪶 #Shorts #Animals 1 min 
Is there a Priest Hole in Your House? | Fascinating Horror Shorts 1 min 
Evidence could change our understanding of 9/11 attacks 25 years ago | 60 Minutes Archive 14 min 
Journey to EPCOT Center: A Symphonic History 70 min 
Cancelled - American Heartland Theme Park 20 min 
Live Service Games - Scott The Woz 29 min 
Rain 3 min 
Luna Pro 4K Vertical Video Is a HUGE Upgrade! 1 min 
LORN - THERE AIN'T NOTHING IT'S JUST PAIN AND THEN YER GONE 2 min 
Best Cameras for YouTube Under $500 16 min 
Mount Wilshire: The Volcano That Almost Destroyed LA | Fascinating Horror 11 min 
How to Get Sharp, Professional Video From Any Camera 10 min 
The Golden Age of Mobile Gaming - Scott The Woz 60 min 
Wii U: Finale of a Failure (Part III) - Scott The Woz 193 min 
The Childhood Game Collection - Scott The Woz 138 min 
Disney's FastPass: A Complicated History 103 min 
The first message from the U.S. Air Force aviator stranded in Iran #shorts 2 min 
I Opened A 5 Star Restaurant On A London Bus 14 min 
Glitch Cat, prodBigMike - once more | Complextro | NCS vs Monstercat - Copyright Free Music 5 min 
Inside America’s Most Shocking Wealth Divide - Fairfield County 65 min 
Antique Steam Tractor Kills Five | Fascinating Horror 11 min 
Marvel Zombies (2027) Chris Hemsworth & Scarlett Johansson 9 min 
Hollyland Lark A2: Best Budget Mic of 2026? 11 min 
Lorn - Acid Rain (Official Music Video) 3 min 
Stop editing manually, do this instead 1 min 
Abandoned - Fort Rapids Indoor Water Park 19 min 
Rubble records a dance video with Ryder! 1 min 
This photo, hidden for 80 years, exposed an affair and a potential sibling. Can I find them?! 35 min 
"How to Go Viral" Videos are Scams 12 min 
There’s NO Excuse Not To Try Linux! 18 min 
Is patch management dead?👀 2 min 
The Most Expensive Ad of All Time 2 min 
A Deadly Mistake When On Safari | Fascinating Horror 11 min 
Insta360 X6: The Vlogging Camera I Didn't Expect! 16 min 
Why AI Security Matters🔒 1 min 
This Mars rover's cool. But have you seen its wheels? 23 min 
The Japanese Tsunami That Killed 20,000 People | Fascinating Horror 12 min 
How Johnny Harris Knows an Idea is Great 1 min 
Pizza in Italy 🍕 #shorts #peppapig 1 min 
When the Sky Turns Dark | Fun Muddy Adventure | Funny Family Song for Kids | BabyBus 24 min 
Superhero Hide-and-Seek | Superhero Song | Learn Colors | Nursery Rhymes & Kids Songs | BabyBus 37 min 
Peppa Pig Learns How to Make DONUTS! 🍩 Food Factory | BRAND NEW Peppa Pig Tales Episodes | 35 Mins 36 min 
AI News: An INSANE Week… Here’s What Matters 28 min 
BE SLOW, GET SHOCKED!!! (feat. @Kouman ) 19 min 
Let's Make Healthy Ice Cream | Ice Cream Scooping | Learn Fruits | Kids Songs | BabyBus 41 min 
Roles for the Circus 🎪 #shorts #peppapig 1 min Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Forfaits publiés par le créateur de cette vidéo.
Ce créateur n’a pas encore défini ses tarifs. Envoyez une demande et nous la transmettrons — le prix est convenu avant tout prélèvement.
Une place récurrente dans mon contenu. Les abonnés entrent dans une file d’attente — ou dans un tirage aléatoire quand il y a plus d’abonnés que d’emplacements — et apparaissent dans la vidéo elle-même, dans les crédits ou dans la description.
par mois
Prix sur demande
Une apparition garantie d’au moins 10 secondes dans ma prochaine vidéo. Le prix dépend de l’endroit où l’insertion tombe dans le déroulé.
Prix sur demande
Une apparition garantie d’au moins 10 secondes dans un Short extrait d’une de mes vidéos existantes.
unique
Prix sur demande