Berikutnya
Transformers, the tech behind LLMs | Deep Learning Chapter 5 28 min 
Why Groceries Are SO Expensive Now 27 min 
Why Every Millimeter Matters In These World Cup Gloves 10 min 
The Urgent Race to Save Turkey's 1,500-Year-Old Building 20 min 
How a Super El Niño affects the global climate 7 min 
The Second Punic War - OverSimplified (Part 3) 50 min 
The Largest Biological Attack in US History | Fascinating Horror 11 min 
The Wildest Take-Off of My Life 30 min 
The Basement: Mitch Horowitz | Gandhi, Reagan, and the Occultists History Erased 173 min 
The Insane Engineering of the F-14 Tomcat 30 min 
You Can Still be Prescribed Leeches | Fascinating Horror Shorts 1 min 
I Thought this would be Safe! 17 min 
What Went Wrong With California High Speed Rail 22 min 
Tesla Stock Situation is Crazy 1 min 
Is there a Priest Hole in Your House? | Fascinating Horror Shorts 1 min 
I'm Actually Short 1 min 
It’s never too late to follow your dreams ❤️ 1 min 
The Lost Divers They Refused To Rescue: The Paria Accident | Fascinating Horror 12 min 
My Thoughts on Wolverine 22 min 
The Cartels Running Up Transatlantic Airfares 22 min 
Spreading Poop Everywhere Situation is Crazy 12 min 
Tech Russian Roulette with True or False Questions! 1 min 
Meet SAM… Meta’s latest AI model 1 min 
We need to talk about the Hank Green situation 53 min 
Massive Battery Budget Price… 10 min 
This TECH Knife is Insane! 2 min 
Every Color of The New Samsung Galaxy Z Fold 8 Ultra, Fold 8 & Flip 8 24 min 
Samsung S26 Ultra Review - Breaking Point. 17 min 
Can a PS5 cook an egg? 1 min 
Scientists Are Turning Your Organs Young Again 1 min 
Create more powerful weapons than ever before with the addition of X-Tech! #starfield 1 min 
We've Been At It 2 min 
How Do Minerals Form?: Crash Course Geology #5 10 min 
The Rock Episode: Crash Course Geology #6 9 min 
One Piece of News From Every Country in the World (Pt 2) 38 min 
It's way different than you think 6 min 
Stopping the Unstoppable 16 min 
What’s your best guess? #shorts 1 min 
How has technology influenced literature?: Crash Course Latin American Literature #11 11 min 
Sawing a Dam in Half (on Purpose) 21 min 
The Weird Reason Tornadoes Are Clumping Together #science #scishow #stem #shorts 1 min 
Superhero Hide-and-Seek | Superhero Song | Learn Colors | Nursery Rhymes & Kids Songs | BabyBus 37 min 
Why avalanches are most deadly when they stop - Simon Trautman 6 min 
MURAL #PeppaPig #Shorts 1 min 
Anyone Can Make Amazing Games Now (Easy) 29 min 
Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO 1 min 
4 Things We Can Learn From Explosions 12 min 
Becoming a CYBORG with TWO ROBOT ARMS! 28 min 
BAT-GARAGE Tour + BAT-SIGNAL Restoration (MEMBERS EXCLUSIVE) 12 min 
Power loader picked the perfect place to break down 👌 #PrincessAuto #powerloader #engineering 1 min 
The deadly drug everyone is taking 10 min Breaking down how Large Language Models work, visualizing how data flows through. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support --- Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf Звуковая дорожка на русском языке: Влад Бурмистров. --- Timestamps 0:00 - Predict, sample, repeat 3:03 - Inside a transformer 6:36 - Chapter layout 7:20 - The premise of Deep Learning 12:27 - Word embeddings 18:25 - Embeddings beyond words 20:22 - Unembedding 22:22 - Softmax with temperature 26:03 - Up next
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request