⚪ NEOTLIX.SPACE — Setiap kreator adalah sutradara. Setiap penggemar adalah bintang masa depan! ⚪ Siapa pun Bisa Bintang di Video Apa Pun ⚪ Sewakan Wajah Anda ⚪ Monetisasi Video Anda ⚪ Ubah Pengikut Anda Menjadi Royalti ⚪ Lihat Cara Kerjanya ⚪

Berikutnya

But what is cross-entropy? | Compression is Intelligence Part 2 But what is cross-entropy? | Compression is Intelligence Part 2 34 min 《牧神记》第100话花絮:秦牧与大尊先后突破六合境界!【加入会员享最新集】 《牧神记》第100话花絮:秦牧与大尊先后突破六合境界!【加入会员享最新集】 5 min ну книжка ШКЯ ну и что? ну книжка ШКЯ ну и что? 1 min JUMANJI: Open World (2026) Will It Be Game Over? JUMANJI: Open World (2026) Will It Be Game Over? 11 min Gennady - Release Date Trailer | PS5 & PS4 Games Gennady - Release Date Trailer | PS5 & PS4 Games 2 min 【重制版】《凡人修仙传》第190话:慕兰之战14 【重制版】《凡人修仙传》第190话:慕兰之战14 20 min This 20-Foot Monster Was Seen Just Once - What Was It? This 20-Foot Monster Was Seen Just Once - What Was It? 23 min American Fiction (2023) 4K - The "Real" Hollywood Ending (12/12) | Movieclips American Fiction (2023) 4K - The "Real" Hollywood Ending (12/12) | Movieclips 4 min 天圣教教主秦牧亲自前来,陛下还不跪迎?#牧神记 #国漫 #shorts #donghua #madebybilibili 【加入会员专享最新集】 天圣教教主秦牧亲自前来,陛下还不跪迎?#牧神记 #国漫 #shorts #donghua #madebybilibili 【加入会员专享最新集】 1 min 新人物登场,vein死而复生?#时光代理人 #LinkClick #shorts #MadeByBilibili【加入会员专享最新集】 新人物登场,vein死而复生?#时光代理人 #LinkClick #shorts #MadeByBilibili【加入会员专享最新集】 1 min iPhone Duo/18 Pro Hands On - I wasn’t ready iPhone Duo/18 Pro Hands On - I wasn’t ready 17 min The Best Car I've Ever Driven: McLaren W1 The Best Car I've Ever Driven: McLaren W1 17 min How Tech Companies Lie to You. How Tech Companies Lie to You. 25 min iPhone 18 Pro/Duo Impressions: Mogged iPhone 18 Pro/Duo Impressions: Mogged 18 min So This is Peak Smartphone So This is Peak Smartphone 14 min iPhone Duo Hands On! iPhone Duo Hands On! 2 min Google Pixel 11/Pro Review: Poker Face Google Pixel 11/Pro Review: Poker Face 13 min What's the Use What's the Use 3 min FARR FARR 3 min A stroll around my hometown, Aldridge (and the stories that shaped my youth) [PART 1] A stroll around my hometown, Aldridge (and the stories that shaped my youth) [PART 1] 40 min Fit Through The Hole: Beta Squad vs YouTube Allstars Fit Through The Hole: Beta Squad vs YouTube Allstars 37 min What Was Pokemon Shock? | Fascinating Horror Shorts What Was Pokemon Shock? | Fascinating Horror Shorts 1 min EXTREME HIDE & SEEK IN FOOTBALL STADIUM EXTREME HIDE & SEEK IN FOOTBALL STADIUM 46 min Why won’t AI agents just follow the rules? Why won’t AI agents just follow the rules? 36 min Fastest Scam Ever Fastest Scam Ever 10 min Who Said The First Bad Word On The Moon? Who Said The First Bad Word On The Moon? 3 min The Unsolved Mystery of The Oakville Blobs | Fascinating Horror Shorts The Unsolved Mystery of The Oakville Blobs | Fascinating Horror Shorts 1 min These Are Some Wild Bodycams These Are Some Wild Bodycams 12 min There’s something wrong with Hallmark’s youtube channel There’s something wrong with Hallmark’s youtube channel 19 min This photo, hidden for 80 years, exposed an affair and a potential sibling. Can I find them?! This photo, hidden for 80 years, exposed an affair and a potential sibling. Can I find them?! 35 min There’s NO Excuse Not To Try Linux! There’s NO Excuse Not To Try Linux! 18 min DeepSeek Just Made AI Memory 4x Smaller! DeepSeek Just Made AI Memory 4x Smaller! 6 min BETA SQUAD GUESS THE JOB BETA SQUAD GUESS THE JOB 30 min Google Is Killing the Internet Entrepreneur's Dream Google Is Killing the Internet Entrepreneur's Dream 11 min What Is Digital Sovereignty? AI, Data & Control Explained What Is Digital Sovereignty? AI, Data & Control Explained 10 min AI Agents Are Becoming the Attack Surface🤖 AI Agents Are Becoming the Attack Surface🤖 1 min Defunctland: The History of Disneyland's Adventure Thru Inner Space Defunctland: The History of Disneyland's Adventure Thru Inner Space 36 min The Friend Group That Saved Golf The Friend Group That Saved Golf 26 min If I get this wrong, 50,000 people will hear it. If I get this wrong, 50,000 people will hear it. 24 min Defunctland: The American Idol Theme Park Experience Defunctland: The American Idol Theme Park Experience 68 min Is AI lying to us?👀 Is AI lying to us?👀 1 min The Bath Curse Tablets | Fascinating Horror Shorts The Bath Curse Tablets | Fascinating Horror Shorts 1 min The Publishers Who Built Google Are Now Suing It #shorts The Publishers Who Built Google Are Now Suing It #shorts 2 min Jerry Dandrige's Final Vampire Showdown | Fright Night Jerry Dandrige's Final Vampire Showdown | Fright Night 10 min Challengers (2024) 4K - INTENSE Tiebreaker Match (10/10) | Movieclips Challengers (2024) 4K - INTENSE Tiebreaker Match (10/10) | Movieclips 4 min How Do We Write Backwards?! 🤯 How Do We Write Backwards?! 🤯 1 min Days of Thunder (1990) 4K - The Daytona 500 Race! (10/10) | Movieclips Days of Thunder (1990) 4K - The Daytona 500 Race! (10/10) | Movieclips 9 min Minions & Monsters (2026) 4K - The Minions Can't Act?! (4/11) | Movieclips Minions & Monsters (2026) 4K - The Minions Can't Act?! (4/11) | Movieclips 3 min S.W.A.T. - African Warlord Taxi Driver (S3E10) | Movieclips S.W.A.T. - African Warlord Taxi Driver (S3E10) | Movieclips 5 min Better Call Saul - Gus Confronts Mike (S4E4) | Movieclips Better Call Saul - Gus Confronts Mike (S4E4) | Movieclips 2 min The Deadliest Anaconda Attacks | Best Scenes | Anacondas: The Hunt for the Blood Orchid The Deadliest Anaconda Attacks | Best Scenes | Anacondas: The Hunt for the Blood Orchid 11 min

But what is cross-entropy? | Compression is Intelligence Part 2

2026 34 min

Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days: https://www.khanacademy.org/math/multivariable-calculus/applications-of-multivariable-derivatives/lagrange-multipliers-and-constrained-optimization/v/constrained-optimization-introduction Manim animations by Aaron Gostein and Grant Sanderson NanoGPT animation by Clayton Rabideau 3d black-box model by Paul Dancstep Chess game and Lagrange Multiplier scenes by Nishad Deulkar Music by Vince Rubinetti Timestamps 0:00 - Language trees and zipping 3:02 - Recap optimal codes 5:20 - Defining cross-entropy 8:26 - Intuition and examples 12:59 - Application to language trees 14:55 - Pre-training LLMs 20:38 - What makes this loss function best? 26:13 - Distillation 30:12 - 3b1b Talent 31:35 - KL Divergence ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim Music by Vincent Rubinetti. https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Bluesky: https://bsky.app/profile/3blue1brown.com Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com

Work with this creator

Packages published by the creator behind this video.

All packages

This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.

Monthly participation

per month

A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.

Price on request

Sign in to request

Guaranteed placement — new video

one-off

A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.

Price on request

  • First 1–3 minutes
  • Middle of the video
  • End of the video
Sign in to request

Guaranteed placement — Short

one-off

A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.

Price on request

Sign in to request

Lebih seperti ini

《牧神记》第100话花絮:秦牧与大尊先后突破六合境界!【加入会员享最新集】

《牧神记》第100话花絮:秦牧与大尊先后突破六合境界!【加入会员享最新集】

Made By Bilibili - Chinese Donghua Animation · Animation

ну книжка ШКЯ ну и что?

ну книжка ШКЯ ну и что?

Eva Morozova · Animation

JUMANJI: Open World (2026) Will It Be Game Over?

JUMANJI: Open World (2026) Will It Be Game Over?

Film Royalty · Adventure · Animation · Trailer · video · tips

Gennady - Release Date Trailer | PS5 & PS4 Games

Gennady - Release Date Trailer | PS5 & PS4 Games

PlayStation · Adventure · Animation · PlayStation · Games · Trailer · Gaming · video

【重制版】《凡人修仙传》第190话:慕兰之战14

【重制版】《凡人修仙传》第190话:慕兰之战14

Made By Bilibili - Chinese Donghua Animation · Animation

This 20-Foot Monster Was Seen Just Once - What Was It?

This 20-Foot Monster Was Seen Just Once - What Was It?

BRIGHT SIDE · Animation · Action · Documentary · Mystery · Music · Other · testing · arms · video · science

American Fiction (2023) 4K - The "Real" Hollywood Ending (12/12) | Movieclips

American Fiction (2023) 4K - The "Real" Hollywood Ending (12/12) | Movieclips

Movieclips · Animation · Comedy · Trailers · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films

天圣教教主秦牧亲自前来,陛下还不跪迎?#牧神记 #国漫 #shorts #donghua #madebybilibili 【加入会员专享最新集】

天圣教教主秦牧亲自前来,陛下还不跪迎?#牧神记 #国漫 #shorts #donghua #madebybilibili 【加入会员专享最新集】

Made By Bilibili - Chinese Donghua Animation · Animation

新人物登场,vein死而复生?#时光代理人 #LinkClick #shorts #MadeByBilibili【加入会员专享最新集】

新人物登场,vein死而复生?#时光代理人 #LinkClick #shorts #MadeByBilibili【加入会员专享最新集】

Made By Bilibili - Chinese Donghua Animation · Animation · Trailer

iPhone Duo/18 Pro Hands On - I wasn’t ready

iPhone Duo/18 Pro Hands On - I wasn’t ready

Mrwhosetheboss · Music · Tech · technology · science

The Best Car I've Ever Driven: McLaren W1

The Best Car I've Ever Driven: McLaren W1

Marques Brownlee · Music · drive · car · technology · science

How Tech Companies Lie to You.

How Tech Companies Lie to You.

Mrwhosetheboss · Music · Tech · technology · science

iPhone 18 Pro/Duo Impressions: Mogged

iPhone 18 Pro/Duo Impressions: Mogged

Marques Brownlee · Music · Tech · technology · science

So This is Peak Smartphone

So This is Peak Smartphone

Marques Brownlee · Music · technology · science

iPhone Duo Hands On!

iPhone Duo Hands On!

Mrwhosetheboss · Music · Tech · technology · science

Google Pixel 11/Pro Review: Poker Face

Google Pixel 11/Pro Review: Poker Face

Marques Brownlee · Music · cars · technology · science

What's the Use

What's the Use

LORN · Music

FARR

FARR

LORN · Music

A stroll around my hometown, Aldridge (and the stories that shaped my youth) [PART 1]

A stroll around my hometown, Aldridge (and the stories that shaped my youth) [PART 1]

GeoWizard · Other · village · video · stories

Fit Through The Hole: Beta Squad vs YouTube Allstars

Fit Through The Hole: Beta Squad vs YouTube Allstars

Beta Squad · Other

What Was Pokemon Shock? | Fascinating Horror Shorts

What Was Pokemon Shock? | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · japan · education · true stories · stories

EXTREME HIDE & SEEK IN FOOTBALL STADIUM

EXTREME HIDE & SEEK IN FOOTBALL STADIUM

Beta Squad · Other

Why won’t AI agents just follow the rules?

Why won’t AI agents just follow the rules?

IBM Technology · Other · Updates · video · reports · tools · security · education

Fastest Scam Ever

Fastest Scam Ever

penguinz0 · Other

Who Said The First Bad Word On The Moon?

Who Said The First Bad Word On The Moon?

Vsauce · Other

The Unsolved Mystery of The Oakville Blobs | Fascinating Horror Shorts

The Unsolved Mystery of The Oakville Blobs | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · nature · city · science · education · true stories · stories

These Are Some Wild Bodycams

These Are Some Wild Bodycams

penguinz0 · video

There’s something wrong with Hallmark’s youtube channel

There’s something wrong with Hallmark’s youtube channel

Jenny Nicholson · Animation · video

This photo, hidden for 80 years, exposed an affair and a potential sibling. Can I find them?!

This photo, hidden for 80 years, exposed an affair and a potential sibling. Can I find them?!

GeoWizard · Adventure · War · Family · Updates · mom · video

There’s NO Excuse Not To Try Linux!

There’s NO Excuse Not To Try Linux!

Linus Tech Tips · Gaming · video · technology · science

DeepSeek Just Made AI Memory 4x Smaller!

DeepSeek Just Made AI Memory 4x Smaller!

Two Minute Papers · video · technology · science

BETA SQUAD GUESS THE JOB

BETA SQUAD GUESS THE JOB

Chunkz · Comedy · Family · Games · cooking · video

Google Is Killing the Internet Entrepreneur's Dream

Google Is Killing the Internet Entrepreneur's Dream

Neil Patel · video · education

What Is Digital Sovereignty? AI, Data & Control Explained

What Is Digital Sovereignty? AI, Data & Control Explained

IBM Technology · Updates · video · technology · education

AI Agents Are Becoming the Attack Surface🤖

AI Agents Are Becoming the Attack Surface🤖

IBM Technology · education

Defunctland: The History of Disneyland's Adventure Thru Inner Space

Defunctland: The History of Disneyland's Adventure Thru Inner Space

Defunctland · Adventure · History · Tours · education

The Friend Group That Saved Golf

The Friend Group That Saved Golf

Colin and Samir · survival · education

If I get this wrong, 50,000 people will hear it.

If I get this wrong, 50,000 people will hear it.

Tom Scott · photography · education

Defunctland: The American Idol Theme Park Experience

Defunctland: The American Idol Theme Park Experience

Defunctland · Documentary · History · video · education

Is AI lying to us?👀

Is AI lying to us?👀

IBM Technology · education

The Bath Curse Tablets | Fascinating Horror Shorts

The Bath Curse Tablets | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · creative · city · education · true stories · stories

The Publishers Who Built Google Are Now Suing It #shorts

The Publishers Who Built Google Are Now Suing It #shorts

Neil Patel · History · education

Jerry Dandrige's Final Vampire Showdown | Fright Night

Jerry Dandrige's Final Vampire Showdown | Fright Night

FilmIsNow Epic Scenes · Animation · Horror · moments · movie clips · scenes

Challengers (2024) 4K - INTENSE Tiebreaker Match (10/10) | Movieclips

Challengers (2024) 4K - INTENSE Tiebreaker Match (10/10) | Movieclips

Movieclips · Animation · Drama · Romance · Sport · Trailers · nature · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films

How Do We Write Backwards?! 🤯

How Do We Write Backwards?! 🤯

IBM Technology · Action · video · education · scenes

Days of Thunder (1990) 4K - The Daytona 500 Race! (10/10) | Movieclips

Days of Thunder (1990) 4K - The Daytona 500 Race! (10/10) | Movieclips

Movieclips · Animation · Romance · Trailers · moments · car · MOVIECLIPS · movie clips · scenes · lines · favorite films

Minions & Monsters (2026) 4K - The Minions Can't Act?! (4/11) | Movieclips

Minions & Monsters (2026) 4K - The Minions Can't Act?! (4/11) | Movieclips

Movieclips · Animation · Comedy · Trailers · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films · kids

S.W.A.T. - African Warlord Taxi Driver (S3E10) | Movieclips

S.W.A.T. - African Warlord Taxi Driver (S3E10) | Movieclips

Movieclips · Animation · Action · Trailers · street · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films · driver

Better Call Saul - Gus Confronts Mike (S4E4) | Movieclips

Better Call Saul - Gus Confronts Mike (S4E4) | Movieclips

Movieclips · Animation · Drama · Trailers · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films

The Deadliest Anaconda Attacks | Best Scenes | Anacondas: The Hunt for the Blood Orchid

The Deadliest Anaconda Attacks | Best Scenes | Anacondas: The Hunt for the Blood Orchid

FilmIsNow Epic Scenes · Animation · Horror · moments · survival · MOVIECLIPS · movie clips · scenes