اگلا
But what is cross-entropy? | Compression is Intelligence Part 2 34 منٹ 
JUMANJI: Open World (2026) Will It Be Game Over? 11 منٹ 
Vampire Hunters Meet Their Match | John Carpenter's Vampires | Best Scenes 10 منٹ 
Weeds - Esteban Wants to Spank Nancy (S4E6) | Movieclips 4 منٹ 
Days of Thunder (1990) 4K - The Daytona 500 Race! (10/10) | Movieclips 9 منٹ 
Jackie Chan Takes On the Fake Priest Assassin | Snake in the Eagle's Shadow 4 منٹ 
Star Wars Just Announced Its Next Era #shorts #starwars #starfighter #mandalorianandgrogu 1 منٹ 
Marvel Zombies (2027) Chris Hemsworth & Scarlett Johansson 9 منٹ 
【天官赐福动画】胸口碎大石📣【Made by Bilibili】 1 منٹ 
American Fiction (2023) 4K - "We's Lives in Da Ghetto" Book (1/12) | Movieclips 2 منٹ 
Android 17 Is the Biggest Upgrade in Years 18 منٹ 
The Ohio State Penitentiary Fire | Fascinating Horror 12 منٹ 
They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror 11 منٹ 
Pilot 3 منٹ 
DJI Pocket 4 vs Pocket 4P | Everything You Need to Know 16 منٹ 
Is there a Priest Hole in Your House? | Fascinating Horror Shorts 1 منٹ 
SUICIDE NOTE 4 منٹ 
iPhone Duo Hands On! 2 منٹ 
WWDC 2026 - Siri AI Impressions! 15 منٹ 
I'll Always Remember You 13 منٹ 
Inside Old Maine With a Sixth-Generation Lobsterman 43 منٹ 
Luna Pro 4K Vertical Video Is a HUGE Upgrade! 1 منٹ 
Finally Addressing Assassin's Creed Shadows Questions 1 منٹ ![A stroll around my hometown, Aldridge (and the stories that shaped my youth) [PART 1]](https://adm.6-9.space/storage/films/posters/yt_a-stroll-around-my-hometown-aldridge-and-the-stories-that-shaped-my-youth-part-1_1789704139.jpg)
A stroll around my hometown, Aldridge (and the stories that shaped my youth) [PART 1] 40 منٹ 
The Ground Under the Himalayas Is Falling Apart 18 منٹ 
Scientists Just Found Non-Human DNA in Our Bodies 11 منٹ 
Anthropic reveals hardware specs and Claude updates, OpenAI talks security, and Runway's new model 35 منٹ 
The mist that keeps the Tyne Tunnels safe 22 منٹ 
Peppa Pig Learns about the TOOTH FAIRY! 🧚🦷 | Losing a Tooth! | Peppa Pig Official Full Episodes 45 منٹ 
I tested Dream Tech with my Biggest Fans! 15 منٹ 
Sony FX3 vs FX30: Can You Tell the Difference? 14 منٹ 
I Tested 47 Sony Cameras – These Are My Favorite! 18 منٹ 
U.S. Air Force officer shot down in Iran says it's a "modern-day miracle" he survived | 60 Minutes 14 منٹ 
I took a long walk on a dangerous beach. 27 منٹ 
Mr Bean Gets CHASED by a DINOSAUR! 🦖 | Mr Bean Animated Season 2 | Funny Clips | Mr Bean 24 منٹ 
Affordable YouTube Gear that is Totally Worth It 2026 24 منٹ 
How the YouTube Algorithm Actually Works 1 منٹ 
The Friend Group That Saved Golf 26 منٹ 
Sixty Hours Trapped Underwater | Fascinating Horror Shorts 1 منٹ 
How to Turn Trash into Art 1 منٹ 
How do you keep 8,995 codebreakers secret? 27 منٹ 
Dude Perfect's $100M Business, Mapped 13 منٹ 
Defunctland: The History of Disneyland's Adventure Thru Inner Space 36 منٹ 
Practical Magic (1998) - Gillian & Sally Kill Jimmy (2/11) | Movieclips 2 منٹ 
SECOND SISTER TRILLA All Scenes - STAR WARS ZERO COMPANY 4K 60FPS Ultra HD 9 منٹ 
THE FLAMINGO DANCE | Official Surreal AI Music Video 5 منٹ 
Jackass: Best and Last (2026) 4K - Tattooing While Electrocuted (2/10) | Movieclips 4 منٹ 
S.W.A.T. - Street Quit SWAT (S3E11) | Movieclips 2 منٹ 
Old Florida - The Last Outlaws of the Everglades 79 منٹ 
The Real Gear I Use in My YouTube Studio! (Complete Tour) 12 منٹ 
The Golden Voyage of Sinbad (1973) - Epic Kali Statue Fight! (7/10) | Movieclips 4 منٹ Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days: https://www.khanacademy.org/math/multivariable-calculus/applications-of-multivariable-derivatives/lagrange-multipliers-and-constrained-optimization/v/constrained-optimization-introduction Manim animations by Aaron Gostein and Grant Sanderson NanoGPT animation by Clayton Rabideau 3d black-box model by Paul Dancstep Chess game and Lagrange Multiplier scenes by Nishad Deulkar Music by Vince Rubinetti Timestamps 0:00 - Language trees and zipping 3:02 - Recap optimal codes 5:20 - Defining cross-entropy 8:26 - Intuition and examples 12:59 - Application to language trees 14:55 - Pre-training LLMs 20:38 - What makes this loss function best? 26:13 - Distillation 30:12 - 3b1b Talent 31:35 - KL Divergence ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim Music by Vincent Rubinetti. https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Bluesky: https://bsky.app/profile/3blue1brown.com Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request