下一段
But what is cross-entropy? | Compression is Intelligence Part 2 34 分钟 
✨️варианты досуга✨️ 1 分钟 
《凡人修仙传》第191话花絮：谷双蒲竟是慕兰人？【加入会员专享最新集】 5 分钟 
PLANET 9 — Chapter Five: Welcome Home | Sci-Fi Short Film 3 分钟 
S.W.A.T. - High Stakes Casino Robbery (S3E11) | Movieclips 5 分钟 
【本季完结】《百日成王》第25话：现在我要夺回失去的一切！【奇幻 | 战斗 | 搞笑 | Made By Bilibili】 12 分钟 
《百日成王》第23话：龙傲 15 分钟 
【重制版】《凡人修仙传》第190话：慕兰之战14 20 分钟 
《牧神记》第100话花絮：坏了，这下解释不清了！【加入会员享最新集】 4 分钟 
JUMANJI: Open World (2026) Will It Be Game Over? 11 分钟 
Someone Lived This 4 分钟 
Голливудский Бой 🤯 | Battlefield 6 12 分钟 
“The Biggest Android Update Ever” 13 分钟 
Bluey Phone Review 5 分钟 
Horror Games - Scott The Woz 31 分钟 
Jakey - Pine Barrens (Official Music Video) 5 分钟 
The Wild Story of the Teton Dam Failure 20 分钟 
The tragedy of Cassandra, the princess who predicted the fall of Troy - Iseult Gillespie 5 分钟 
THROUGH THE FIRE 6 分钟 
Those Ancient Giant Fungi Weren’t Fungi After All 15 分钟 
What is a "Body Farm"? | Fascinating Horror Shorts 1 分钟 
This Might Actually Work 1 分钟 
Distracted By The Scenery? The 1986 Grand Canyon Crash | Fascinating Horror 11 分钟 
The New Moist Cr1TiKaL 2 分钟 
Worst Movie of the Year Just Dropped 23 分钟 
Rescued U.S. Air Force officer’s first call home #shorts 1 分钟 
Would You Ride an UNDERWATER Slide? | Fascinating Horror Shorts 1 分钟 
Geothermal Energy is Changing | Quaise Energy Documentary 22 分钟 
This mic sounds like it costs way more 🎙️ 1 分钟 
How the Boeing 787 Works | Full Documentary 66 分钟 
How We Built The ISS 37 分钟 
How to Use YouTube Studio in 2026! (Complete Guide) 19 分钟 
Sony Picture Profiles Explained: Get Better Colors In Camera! 8 分钟 
How AI Is Changing Code Reviews & Software Development 15 分钟 
Abandoned - Disney World's Discovery Island 39 分钟 
Peer Review and the Quest for Truth: Crash Course Scientific Thinking #4 11 分钟 
How Water Shapes the Land: Crash Course Geology #9 10 分钟 
What your ball size says about you 8 分钟 
Why NASA Is Racing Back To The Moon 11 分钟 
Why is everyone suddenly neurodivergent? 8 分钟 
Why do some British trains still rely on old levers? 26 分钟 
The Physics Behind the Thumb Trick 18 分钟 
I was not prepared for a mannequin that can bleed. 29 分钟 
Valek's Vampires Massacre a Monastery | John Carpenter's Vampires 8 分钟 
Jackass: Best and Last (2026) 4K - Escape Room From Hell (Part 2) (9/10) | Movieclips 4 分钟 
Giant Anaconda Ambushes the Expedition | Anacondas: The Hunt for the Blood Orchid 4 分钟 
Inside the Deep South’s Poorest Region 66 分钟 
Challengers (2024) 4K - The Hottest Woman I've Ever Seen (1/10) | Movieclips 3 分钟 
Old Florida - The Last Outlaws of the Everglades 79 分钟 
Students Battle Underground Beasts | Slaughterhouse Rulez | Best Scenes 10 分钟 
Life in New Mexico’s Most Isolated Towns 51 分钟 Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days: https://www.khanacademy.org/math/multivariable-calculus/applications-of-multivariable-derivatives/lagrange-multipliers-and-constrained-optimization/v/constrained-optimization-introduction Manim animations by Aaron Gostein and Grant Sanderson NanoGPT animation by Clayton Rabideau 3d black-box model by Paul Dancstep Chess game and Lagrange Multiplier scenes by Nishad Deulkar Music by Vince Rubinetti Timestamps 0:00 - Language trees and zipping 3:02 - Recap optimal codes 5:20 - Defining cross-entropy 8:26 - Intuition and examples 12:59 - Application to language trees 14:55 - Pre-training LLMs 20:38 - What makes this loss function best? 26:13 - Distillation 30:12 - 3b1b Talent 31:35 - KL Divergence ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim Music by Vincent Rubinetti. https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Bluesky: https://bsky.app/profile/3blue1brown.com Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request