ቀጣይ
But what is cross-entropy? | Compression is Intelligence Part 2 34 ደቂቃ 
《百日成王》第21话：快醒醒！救救大家！【奇幻 | 战斗 | 搞笑 | Made By Bilibili】 11 ደቂቃ 
《牧神记》第99话花絮：小两口感情也是越来越好了【加入会员享最新集】 5 ደቂቃ 
The Prisoner of Bogan 32 ደቂቃ 
Midnight Sons #shorts #midnightsons #blade #ghostrider 1 ደቂቃ 
честный обзор на Евросоюз, НАТО и Шенген. 2 ደቂቃ 
外敌未除内患先至，谷双蒲借机生事#凡人修仙传 #国漫 #shorts #donghua #madebybilibili【加入会员专享最新集】 2 ደቂቃ 
延康群英集结打团中 #牧神记 #国漫 #shorts #donghua #madebybilibili 【加入会员专享最新集】 1 ደቂቃ 
《胶囊计划：英雄》第9话：不可控核聚变【热血 | 科幻 | 武侠 | Made By Bilibili】 26 ደቂቃ 
OVERGROWTH — Dead City | Post Apocalyptic Action Thriller | 2026 Full Movie | English | 4K 62 ደቂቃ 
$10,000 Power Washer! 1 ደቂቃ 
Apple Intelligence scares me 1 ደቂቃ 
The Hidden Tech Behind an NBA Broadcast! 12 ደቂቃ 
Sony FX3 vs FX30: Can You Tell the Difference? 14 ደቂቃ 
Sea Wall 10 ደቂቃ 
I AM A DAGGER 2 ደቂቃ 
Distracted By The Scenery? The 1986 Grand Canyon Crash | Fascinating Horror 11 ደቂቃ 
iPhone 18 Pro/Duo Impressions: Mogged 18 ደቂቃ 
I bought the most CURSED TECH on the internet ft. KSI 25 ደቂቃ 
Inside the massive U.S. operation to rescue downed officer in Iran #shorts 2 ደቂቃ 
The Strangest Operating System in History | Fascinating Horror Shorts 1 ደቂቃ 
Embarrassing Behavior 15 ደቂቃ ![Can we cross Manchester city centre using its forgotten Victorian tunnels? [PART 2]](https://adm.6-9.space/storage/films/posters/yt_can-we-cross-manchester-city-centre-using-its-forgotten-victorian-tunnels-part-2_1789704303.jpg)
Can we cross Manchester city centre using its forgotten Victorian tunnels? [PART 2] 40 ደቂቃ 
Law professor calls the new pardon system “anarchy” #shorts 1 ደቂቃ 
Dating Girls In Front Of Their Dads 14 ደቂቃ 
He's Back Again 9 ደቂቃ 
Scientists Just Found Non-Human DNA in Our Bodies 11 ደቂቃ 
Milkoi - LAST TIME | Glitch Hop | NCS - Copyright Free Music 3 ደቂቃ 
BETA SQUAD $10,000 CHALLENGE 26 ደቂቃ 
Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes 44 ደቂቃ 
My Take on The New Apple 12 ደቂቃ 
Unhinged Lady Ran for Senate and Got Arrested for Wild Behavior 21 ደቂቃ 
Surviving In The Wilderness For 24 Hours 101 ደቂቃ 
Marvel Zombies (2027) Chris Hemsworth & Scarlett Johansson 9 ደቂቃ 
Hidden Camera Investigations | 60 Minutes Full Episodes 73 ደቂቃ 
❤️ Find Your Intersection with Content 1 ደቂቃ 
Defunctland: The Abandoning of Celebration City 49 ደቂቃ 
I get excited about &. 24 ደቂቃ 
9 YouTube Rules No One Talks About 14 ደቂቃ 
Luna Pro 4K Vertical Video Is a HUGE Upgrade! 1 ደቂቃ 
Why OpenAI is calling for a ‘cyber defense surge.’ Plus: Find Evil! winners and TeamPCP losers 30 ደቂቃ 
Defunctland: The Awful Wiggles Dark Ride 40 ደቂቃ 
The Giant Rotting Pink Bunny in the Middle of Nowhere | Fascinating Horror Shorts 1 ደቂቃ 
Nature's Incredible ROTATING MOTOR (It’s Electric!) - Smarter Every Day 300 30 ደቂቃ 
Practical Magic (1998) - Sally Finds Her Perfect Man (7/11) | Movieclips 3 ደቂቃ 
Heath Ledger’s Epic Final Joust | A Knight’s Tale 9 ደቂቃ 
Control Resonant - Meet The Cast: Development Diary | PS5 Games 9 ደቂቃ 
The Ending That Changed Everything | Stand By Me 10 ደቂቃ 
Days of Thunder (1990) 4K - The Daytona 500 Race! (10/10) | Movieclips 9 ደቂቃ 
Weeds - The Gangsters Catch Celia (S4E4) | Movieclips 2 ደቂቃ 
Jackass: Best and Last (2026) 4K - Escape Room From Hell (Part 1) (8/10) | Movieclips 4 ደቂቃ Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days: https://www.khanacademy.org/math/multivariable-calculus/applications-of-multivariable-derivatives/lagrange-multipliers-and-constrained-optimization/v/constrained-optimization-introduction Manim animations by Aaron Gostein and Grant Sanderson NanoGPT animation by Clayton Rabideau 3d black-box model by Paul Dancstep Chess game and Lagrange Multiplier scenes by Nishad Deulkar Music by Vince Rubinetti Timestamps 0:00 - Language trees and zipping 3:02 - Recap optimal codes 5:20 - Defining cross-entropy 8:26 - Intuition and examples 12:59 - Application to language trees 14:55 - Pre-training LLMs 20:38 - What makes this loss function best? 26:13 - Distillation 30:12 - 3b1b Talent 31:35 - KL Divergence ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim Music by Vincent Rubinetti. https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Bluesky: https://bsky.app/profile/3blue1brown.com Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request