Susunod
But what is cross-entropy? | Compression is Intelligence Part 2 34 min 
Wonder Woman Is Finally Returning #shorts #wonderwoman #wonderwoman3 #dc 1 min 
与秦牧再度擦肩时，世间已无班公措！#牧神记 #国漫 #shorts #donghua #madebybilibili 【加入会员专享最新集】 1 min 
Have a Bootleg Gaming Christmas! - Scott The Woz 30 min 
Peppa Pig WINS the DUCK RACE for Baby EVIE! 🦆🏆 | BRAND NEW Peppa Pig Full Episodes | 4 Hours 243 min 
秦牧斩杀灵玉夏！#牧神记 #国漫 #shorts #donghua #madebybilibili 【加入会员专享最新集】 1 min 
《万古至尊：李云霄传》第19话：真火异动【热血 | 玄幻 | 战斗 | Made By Bilibili】 12 min 
Minions & Monsters (2026) 4K - HILARIOUS! Minions vs. Irene (10/11) | Movieclips 4 min 
李缨宁竟然结丹了？她会以何种方式与韩立相认？#凡人修仙传 #国漫 #shorts #donghua #madebybilibili【加入会员专享最新集】 1 min 
✨️приключения в мире капитализма✨️ 1 min 
Mount Wilshire: The Volcano That Almost Destroyed LA | Fascinating Horror 11 min 
Samsung Z Fold 8 (Wide) Impressions: Better Than I Thought! 10 min 
MSDOS 5 min 
Cherry Moon 4 min 
NOT TODAY 3 min 
LEFT SIDE 3 min 
Google Pixel 11/Pro Review: Poker Face 13 min 
The Honor Robot Phone is absolutely insane. 15 min 
Grandfather 2 min 
The Story Of The Black Tom Explosion | Fascinating Horror 11 min 
Law professor calls the new pardon system “anarchy” #shorts 1 min 
Worst Movie of the Year Just Dropped 23 min 
Why Have Orcas Turned Violent? | Fascinating Horror Shorts 1 min 
The #1 Most Dangerous Thing for Your Skin 2 min 
The Horrifying "Dementor" Wasp | Fascinating Horror Shorts 1 min 
Don't Deep Fry Your Turkey | Fascinating Horror Shorts 1 min 
Sunday on 60 Minutes: Patrick Clancy 1 min 
DJI Pocket 4 vs Pocket 4P | Everything You Need to Know 16 min 
AI Simplified: 6 Concepts You Need to Know About Modern AI 9 min 
LAST TO LEAVE THE FOOTBALL PITCH 63 min 
How to Get Sharp, Professional Video From Any Camera 10 min 
We can't invent a robot better than these ferrets 22 min 
Stop editing manually, do this instead 1 min 
The mist that keeps the Tyne Tunnels safe 22 min 
Anthropic reveals hardware specs and Claude updates, OpenAI talks security, and Runway's new model 35 min 
DefunctTV: The History of the Big Comfy Couch 27 min 
Is AI lying to us?👀 1 min 
Casey Neistat: The Death of "Art" on YouTube 41 min 
The Rust Movie Set Accident | Fascinating Horror 14 min 
How Johnny Harris Knows an Idea is Great 1 min 
We need to talk about the Hank Green situation 53 min 
The Genius Behind Bryan Johnson 1 min 
Defenders Must Adapt Fast💨 1 min 
Inside America’s Fastest-Shrinking City 65 min 
Billy Cole’s Horrifying Final Stand | Fright Night 3 min 
Heath Ledger’s Tournament Training | A Knight’s Tale 4 min 
Inside Wealthy Arkansas 71 min 
This Final Boss Took Everything I Had... ONIMUSHA WAY OF THE SWORD ENDING 106 min 
Three Islands, Three Different Worlds on Georgia’s Coast 46 min 
The Cave (2005) - C'MON, MOTHERF***ER!!! (11/12) | Movieclips 3 min 
American Fiction (2023) 4K - Monk Writes Stereotypical Schlock (3/12) | Movieclips 4 min Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days: https://www.khanacademy.org/math/multivariable-calculus/applications-of-multivariable-derivatives/lagrange-multipliers-and-constrained-optimization/v/constrained-optimization-introduction Manim animations by Aaron Gostein and Grant Sanderson NanoGPT animation by Clayton Rabideau 3d black-box model by Paul Dancstep Chess game and Lagrange Multiplier scenes by Nishad Deulkar Music by Vince Rubinetti Timestamps 0:00 - Language trees and zipping 3:02 - Recap optimal codes 5:20 - Defining cross-entropy 8:26 - Intuition and examples 12:59 - Application to language trees 14:55 - Pre-training LLMs 20:38 - What makes this loss function best? 26:13 - Distillation 30:12 - 3b1b Talent 31:35 - KL Divergence ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim Music by Vincent Rubinetti. https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Bluesky: https://bsky.app/profile/3blue1brown.com Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request