Следващо
Attention in transformers, step-by-step | Deep Learning Chapter 6 27 мин 
The weird history of the internet... 9 мин 
Susan Kare: Designing Icons & Graphics For the Original Mac 52 мин 
The most expensive software bug in history... 6 мин 
Why This Robot Kills Weeds With Lasers 15 мин 
Why USA 1.0 failed 33 мин 
What’s really happening in the ocean’s “dark zones” 32 мин 
Killed By A View Of Mount Fuji: BOAC Flight 911 | Fascinating Horror 11 мин 
Sixty Hours Trapped Underwater | Fascinating Horror Shorts 1 мин 
Rome, Italy 🇮🇹 Ultimate Walking Tour – Colosseum, Pantheon & St. Peter's | 4K 60fps 538 мин 
What are tariffs, and how do they work? 6 мин 
The Craziest Experiment Humans Have Ever Built 18 мин 
The tragedy of Cassandra, the princess who predicted the fall of Troy - Iseult Gillespie 5 мин 
What height does your phone become DEADLY? 1 мин 
Google Pixel 11 Hands on - The Phone Crisis Begins. 14 мин 
The Bizarre Bases of Antenna Towers 19 мин 
The Grid That Doubles the Strength of the Ground 19 мин 
Can a magnet DESTROY your smartphone? 1 мин 
Glass & Silver 4 мин 
COMPILATION: Fascinating Horror Shorts 31 - 60 | Fascinating Horror 27 мин 
Blinded By A Rollercoaster: The Problem With Dragon Challenge | Fascinating Horror 10 мин 
Lifting the covers of the #secretgarage 2 мин 
Digging A SECRET GARAGE Part 4 Digging Done! 26 мин 
How Earthquake Bearings Work 19 мин 
How Airlines Decide Which Plane to Use 22 мин 
I Pranked America's Most Racist Man 35 мин 
How I Scammed MrBeast For $100,000 38 мин 
Humanity’s Real Plan to Stop This Asteroid (Feat. Mark Rober) 22 мин 
The Most Interesting Displays In The World! 16 мин 
The Steam Machine Killer 2 мин 
How a crucial battleground candidate is rethinking AI safety 2 мин 
LORN - PAWO 3 мин 
Sex-Triggered Asthma?! #science #scishow #asthma #romance 1 мин 
The magical forest realm hiding at the bottom of the ocean - Luka Seamus Wright and Salomé Buglass 6 мин 
How We Built the ISS - Part 2 29 мин 
Why America’s Tank Failed in Ukraine 23 мин 
Why American Houses Are So Flimsy 15 мин 
We've Been At It 2 мин 
What is Juneteenth, and why is it important? #shorts #juneteenth 1 мин 
Why It's So Hard to Make Artificial Cork 9 мин 
The Surprisingly Large Carbon Footprint of Rice #science #scishow #rice #climatechange 1 мин 
Why the Ikea Business Model Wins 19 мин 
Everything you need to know about BIRD FLU 8 мин 
I Built a FREE App That Runs Your Entire Business 28 мин 
SciShow is heading into the field TOMORROW with the all new Field Trips mini series. 1 мин 
4 Things We Can Learn From Explosions 12 мин 
I read every major CS paper of the last 100 years... 11 мин 
1 CLOVE in Your Coffee Every Morning (Here's What Happens) 8 мин 
WINDY Camping! 🍃🏕️ #PeppaPig #Shorts #summer #LEGODUPLO 1 мин 
MARBLE Run! #PeppaPig #Shorts 1 мин 
Is Beni the cutest camera robot you've ever seen? 🥺 The answer is yes! #robot #engineering #camera 1 мин Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support The first pass for the translated subtitles here is machine-generated and, therefore, notably imperfect. To contribute edits or fixes, visit https://www.criblate.com Звуковая дорожка на русском языке: Влад Бурмистров. ------------------ Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html Site with exercises related to ML programming and GPTs https://www.gptandchill.ai/codingproblems History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf ------------------ Timestamps: 0:00 - Recap on embeddings 1:39 - Motivating examples 4:29 - The attention pattern 11:08 - Masking 12:42 - Context size 13:10 - Values 15:44 - Counting parameters 18:21 - Cross-attention 19:19 - Multiple heads 22:16 - The output matrix 23:19 - Going deeper 24:54 - Ending ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request