Επόμενο
But what is cross-entropy? | Compression is Intelligence Part 2 34 λεπ 
《百日成王》第21话：快醒醒！救救大家！【奇幻 | 战斗 | 搞笑 | Made By Bilibili】 11 λεπ 
《牧神记》第99话花絮：小两口感情也是越来越好了【加入会员享最新集】 5 λεπ 
The Prisoner of Bogan 32 λεπ 
Midnight Sons #shorts #midnightsons #blade #ghostrider 1 λεπ 
честный обзор на Евросоюз, НАТО и Шенген. 2 λεπ 
外敌未除内患先至，谷双蒲借机生事#凡人修仙传 #国漫 #shorts #donghua #madebybilibili【加入会员专享最新集】 2 λεπ 
延康群英集结打团中 #牧神记 #国漫 #shorts #donghua #madebybilibili 【加入会员专享最新集】 1 λεπ 
《胶囊计划：英雄》第9话：不可控核聚变【热血 | 科幻 | 武侠 | Made By Bilibili】 26 λεπ 
OVERGROWTH — Dead City | Post Apocalyptic Action Thriller | 2026 Full Movie | English | 4K 62 λεπ 
$10,000 Power Washer! 1 λεπ 
Apple Intelligence scares me 1 λεπ 
The Hidden Tech Behind an NBA Broadcast! 12 λεπ 
Sony FX3 vs FX30: Can You Tell the Difference? 14 λεπ 
Sea Wall 10 λεπ 
I AM A DAGGER 2 λεπ 
Distracted By The Scenery? The 1986 Grand Canyon Crash | Fascinating Horror 11 λεπ 
iPhone 18 Pro/Duo Impressions: Mogged 18 λεπ 
I bought the most CURSED TECH on the internet ft. KSI 25 λεπ 
Inside the massive U.S. operation to rescue downed officer in Iran #shorts 2 λεπ 
The Strangest Operating System in History | Fascinating Horror Shorts 1 λεπ 
Embarrassing Behavior 15 λεπ ![Can we cross Manchester city centre using its forgotten Victorian tunnels? [PART 2]](https://adm.6-9.space/storage/films/posters/yt_can-we-cross-manchester-city-centre-using-its-forgotten-victorian-tunnels-part-2_1789704303.jpg)
Can we cross Manchester city centre using its forgotten Victorian tunnels? [PART 2] 40 λεπ 
Law professor calls the new pardon system “anarchy” #shorts 1 λεπ 
Dating Girls In Front Of Their Dads 14 λεπ 
He's Back Again 9 λεπ 
Scientists Just Found Non-Human DNA in Our Bodies 11 λεπ 
Milkoi - LAST TIME | Glitch Hop | NCS - Copyright Free Music 3 λεπ 
BETA SQUAD $10,000 CHALLENGE 26 λεπ 
Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes 44 λεπ 
My Take on The New Apple 12 λεπ 
Unhinged Lady Ran for Senate and Got Arrested for Wild Behavior 21 λεπ 
Surviving In The Wilderness For 24 Hours 101 λεπ 
Marvel Zombies (2027) Chris Hemsworth & Scarlett Johansson 9 λεπ 
Hidden Camera Investigations | 60 Minutes Full Episodes 73 λεπ 
❤️ Find Your Intersection with Content 1 λεπ 
Defunctland: The Abandoning of Celebration City 49 λεπ 
I get excited about &. 24 λεπ 
9 YouTube Rules No One Talks About 14 λεπ 
Luna Pro 4K Vertical Video Is a HUGE Upgrade! 1 λεπ 
Why OpenAI is calling for a ‘cyber defense surge.’ Plus: Find Evil! winners and TeamPCP losers 30 λεπ 
Defunctland: The Awful Wiggles Dark Ride 40 λεπ 
The Giant Rotting Pink Bunny in the Middle of Nowhere | Fascinating Horror Shorts 1 λεπ 
Nature's Incredible ROTATING MOTOR (It’s Electric!) - Smarter Every Day 300 30 λεπ 
Practical Magic (1998) - Sally Finds Her Perfect Man (7/11) | Movieclips 3 λεπ 
Heath Ledger’s Epic Final Joust | A Knight’s Tale 9 λεπ 
Control Resonant - Meet The Cast: Development Diary | PS5 Games 9 λεπ 
The Ending That Changed Everything | Stand By Me 10 λεπ 
Days of Thunder (1990) 4K - The Daytona 500 Race! (10/10) | Movieclips 9 λεπ 
Weeds - The Gangsters Catch Celia (S4E4) | Movieclips 2 λεπ 
Jackass: Best and Last (2026) 4K - Escape Room From Hell (Part 1) (8/10) | Movieclips 4 λεπ Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days: https://www.khanacademy.org/math/multivariable-calculus/applications-of-multivariable-derivatives/lagrange-multipliers-and-constrained-optimization/v/constrained-optimization-introduction Manim animations by Aaron Gostein and Grant Sanderson NanoGPT animation by Clayton Rabideau 3d black-box model by Paul Dancstep Chess game and Lagrange Multiplier scenes by Nishad Deulkar Music by Vince Rubinetti Timestamps 0:00 - Language trees and zipping 3:02 - Recap optimal codes 5:20 - Defining cross-entropy 8:26 - Intuition and examples 12:59 - Application to language trees 14:55 - Pre-training LLMs 20:38 - What makes this loss function best? 26:13 - Distillation 30:12 - 3b1b Talent 31:35 - KL Divergence ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim Music by Vincent Rubinetti. https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Bluesky: https://bsky.app/profile/3blue1brown.com Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request