Næste
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 min 
The Age of Laser Warfare Has Begun 24 min 
Reptiles | 60 Minutes Full Episodes 52 min 
How The Space Shuttle Worked | Full Documentary 78 min 
Jony Ive Shows The Real Process Behind the Ferrari Luce 46 min 
Sixty Hours Trapped Underwater | Fascinating Horror Shorts 1 min 
Why Groceries Are SO Expensive Now 27 min 
What's safe to eat now? 8 min 
Why isn't Congress doing more to protect America's food safety? 2 min 
Preparing for 9/11 trials inside Guantanamo | 60 Minutes Archive 14 min 
555-5555 3 min 
Why avalanches are most deadly when they stop - Simon Trautman 6 min 
Sea Wall 10 min 
Exploring Japan's Remote Border with Russia (no one comes here) 26 min 
NO SAFETY ON A BODY 2 min 
Я загрузил ИИ в Скайрим... и вот чот вышло 🤣 23 min 
iPhone 18 Pro Review - My Last iPhone? 14 min 
2049 4 min 
Заперт с Монстром 🤣 | Murky Divers 17 min 
Amazing LEGO Tea Bag Machine 1 min 
How a Super El Niño affects the global climate 7 min 
Sec. Hegseth’s initial reaction to the U.S. fighter jet being shot down: “S***” #shorts 1 min 
Jump or Burn: The Luxor Balloon Crash | Fascinating Horror 12 min 
The Jagermeister Pool of Death | Fascinating Horror Shorts 1 min 
Are Beavers Actually Good at Dams? 20 min 
The Story of Bill Stephens | Fascinating Horror Shorts 1 min 
Dealing with water in the Secret Garage 1 min 
Geothermal Energy is Changing | Quaise Energy Documentary 22 min 
The new midlife crisis 2 min 
Why America’s Tank Failed in Ukraine 23 min 
Is There A Shortcut To Treating Tuberculosis? #science #scishow #tuberculosis #health 1 min 
Why NASA Is Sending This Truck To The Moon 24 min 
How Big Pork takes money from small farmers — then uses it to lobby against them 2 min 
YouTuber Merch Tier List 1 min 
Solar Farms in Space - Reflect Orbital 32 min 
Crash Course Geology Preview 3 min 
This is NUTS 1 min 
Why do gay people sound like that? 6 min 
The incredible engineering of Venice - Stephanie H. Smith 7 min 
How old is the Earth?: Crash Course Geology #17 12 min 
How Red Bull Built Its Empire 17 min 
Okinawa vs the US Military: The Decades-Long Feud 19 min 
What do you think? 2 min 
BAT-GARAGE Tour + BAT-SIGNAL Restoration (MEMBERS EXCLUSIVE) 12 min 
GPT-6 Astra Is Finally Here (And It’s REALLY Good) 20 min 
Nobody talks about this part of India (the 7 sisters) 21 min 
Why We Can’t Find a Legal Limit for Weed 11 min 
What could this project be? 👀🥬 (Members' Update #46) 4 min 
Jumpstart by Phone 14 min 
What happens when we coat a pingpong ball with metal? #tbt #hacksmith #makeitreal 2 min 
Peppa TRANSFORMS Old Rusty Bike #PeppaPig #Shorts 1 min Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Pakker offentliggjort af skaberen bag denne video.
Denne skaber har ikke sat sine priser endnu. Send en anmodning, og vi videresender den — prisen aftales, før noget opkræves.
En tilbagevendende plads i mit indhold. Abonnenter går i en kø — eller en tilfældig lodtrækning, når der er flere abonnenter end pladser — og optræder i selve videoen, i krediteringerne eller i beskrivelsen.
pr. måned
Pris på forespørgsel
En garanteret optræden på mindst 10 sekunder i min næste video. Prisen afhænger af, hvor i spilletiden indsættelsen lander.
Pris på forespørgsel
En garanteret optræden på mindst 10 sekunder i en Short klippet fra en af mine eksisterende videoer.
engangsbeløb
Pris på forespørgsel