⚪ NEOTLIX.SPACE — ¡Cada creador es un director. Cada fan es una futura estrella! ⚪ Cualquiera puede protagonizar cualquier video ⚪ Alquila tu rostro ⚪ Monetiza tus videos ⚪ Convierte tus seguidores en regalías ⚪ Descubre cómo funciona ⚪

Siguiente

But what is cross-entropy? | Compression is Intelligence Part 2 But what is cross-entropy? | Compression is Intelligence Part 2 34 min Only 1 in 100 People Can Solve These 45 Riddles Only 1 in 100 People Can Solve These 45 Riddles 88 min 天哭现身黄龙山大战,诡异功法秒杀元婴修士卜云鹤 #凡人修仙传 #国漫 #shorts #donghua #madebybilibili【加入会员专享最新集】 天哭现身黄龙山大战,诡异功法秒杀元婴修士卜云鹤 #凡人修仙传 #国漫 #shorts #donghua #madebybilibili【加入会员专享最新集】 1 min What’s your best guess? #shorts What’s your best guess? #shorts 1 min S.W.A.T. - Street Quit SWAT (S3E11) | Movieclips S.W.A.T. - Street Quit SWAT (S3E11) | Movieclips 2 min 《胶囊计划:英雄》第9话:不可控核聚变【热血 | 科幻 | 武侠 | Made By Bilibili】 《胶囊计划:英雄》第9话:不可控核聚变【热血 | 科幻 | 武侠 | Made By Bilibili】 26 min Better Call Saul - Jimmy Sells Phones And Gets Mugged (S4E5) | Movieclips Better Call Saul - Jimmy Sells Phones And Gets Mugged (S4E5) | Movieclips 4 min The dark origins of Disney fairy tales - Claudia Schwabe The dark origins of Disney fairy tales - Claudia Schwabe 6 min Scientists Just Found Non-Human DNA in Our Bodies Scientists Just Found Non-Human DNA in Our Bodies 11 min Why American Houses Are So Flimsy Why American Houses Are So Flimsy 15 min 13 most EXPENSIVE Tech Fails of all time 13 most EXPENSIVE Tech Fails of all time 24 min 555-5555 555-5555 3 min Samsung S26 Ultra Hands on - What's ACTUALLY New? Samsung S26 Ultra Hands on - What's ACTUALLY New? 15 min Why your best ideas usually start as bad ones | Think Like A Musician Why your best ideas usually start as bad ones | Think Like A Musician 5 min Glass is glass Glass is glass 5 min The Hidden Engineering Behind the Falkirk Wheel The Hidden Engineering Behind the Falkirk Wheel 16 min Samsung Z Fold/Flip 8 Hands on - Fold ULTRA?? Samsung Z Fold/Flip 8 Hands on - Fold ULTRA?? 17 min Zero Gravity Is Weirder Than You Think (Bonus Episode) Zero Gravity Is Weirder Than You Think (Bonus Episode) 12 min Are Beavers Actually Good at Dams? Are Beavers Actually Good at Dams? 20 min The Largest Biological Attack in US History | Fascinating Horror The Largest Biological Attack in US History | Fascinating Horror 11 min IF James Bond lived in a 3 bedroom house IF James Bond lived in a 3 bedroom house 1 min "Nobody Leaves Without Paying" - The Ycuá Bolaños Fire | Fascinating Horror "Nobody Leaves Without Paying" - The Ycuá Bolaños Fire | Fascinating Horror 12 min Stripe buys OpenRouter, Ramp’s AI Index & IBM’s OpenAI deal Stripe buys OpenRouter, Ramp’s AI Index & IBM’s OpenAI deal 36 min Hidden camera reveals a marketplace for pardons #shorts Hidden camera reveals a marketplace for pardons #shorts 2 min Why Have Orcas Turned Violent? | Fascinating Horror Shorts Why Have Orcas Turned Violent? | Fascinating Horror Shorts 1 min Disney's FastPass: A Complicated History Disney's FastPass: A Complicated History 103 min How a crucial battleground candidate is rethinking AI safety How a crucial battleground candidate is rethinking AI safety 2 min Why NASA Is Sending This Truck To The Moon Why NASA Is Sending This Truck To The Moon 24 min Neutron stars gave you jewelry. #shorts #science #SciShow Neutron stars gave you jewelry. #shorts #science #SciShow 1 min I Tested NASA's New Space Suit (Ft. Axiom Space) I Tested NASA's New Space Suit (Ft. Axiom Space) 26 min So You Want to Build a Tunnel... So You Want to Build a Tunnel... 21 min The illusion of the ‘self’ | The Gray Area The illusion of the ‘self’ | The Gray Area 43 min The incredible engineering of Venice - Stephanie H. Smith The incredible engineering of Venice - Stephanie H. Smith 7 min The Massive Machine Hidden in the Deep Ocean The Massive Machine Hidden in the Deep Ocean 16 min I Wrote a NEW Sci-Fi with Project Hail Mary Author Andy Weir I Wrote a NEW Sci-Fi with Project Hail Mary Author Andy Weir 60 min What your language says about you What your language says about you 8 min The Hidden Engineering of Runways The Hidden Engineering of Runways 19 min Why People Thought "Aliens" Made These Rocks Why People Thought "Aliens" Made These Rocks 12 min This Spillway Failed On Purpose This Spillway Failed On Purpose 20 min We’ve all been there We’ve all been there 2 min Name That Infrastructure (Ep. 13) #shorts Name That Infrastructure (Ep. 13) #shorts 1 min Does this new data represent you? 🤡 #stats #happiness #science Does this new data represent you? 🤡 #stats #happiness #science 2 min Edgar Allan Poe's story of the Red Death - Iseult Gillespie Edgar Allan Poe's story of the Red Death - Iseult Gillespie 8 min Dolly Parton’s Best Scenes | Steel Magnolias Dolly Parton’s Best Scenes | Steel Magnolias 11 min American Fiction (2023) 4K - "We's Lives in Da Ghetto" Book (1/12) | Movieclips American Fiction (2023) 4K - "We's Lives in Da Ghetto" Book (1/12) | Movieclips 2 min S.W.A.T. - Street Goes Undercover (S3E11) | Movieclips S.W.A.T. - Street Goes Undercover (S3E11) | Movieclips 3 min Minions & Monsters (2026) 4K - Jaws vs. Minions (7/11) | Movieclips Minions & Monsters (2026) 4K - Jaws vs. Minions (7/11) | Movieclips 2 min The Cave (2005) - Cersei Lannister's Kiss of Death (12/12) | Movieclips The Cave (2005) - Cersei Lannister's Kiss of Death (12/12) | Movieclips 2 min George Clooney Gambles for His Life | Money Monster George Clooney Gambles for His Life | Money Monster 5 min Alien Monster Town - NOCTARI 5 Trailer. Dark Sci-fi fantasy action episode film, Vampire monsters Alien Monster Town - NOCTARI 5 Trailer. Dark Sci-fi fantasy action episode film, Vampire monsters 1 min Solo Deep in the Ozarks Solo Deep in the Ozarks 77 min

But what is cross-entropy? | Compression is Intelligence Part 2

2026 34 min

Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days: https://www.khanacademy.org/math/multivariable-calculus/applications-of-multivariable-derivatives/lagrange-multipliers-and-constrained-optimization/v/constrained-optimization-introduction Manim animations by Aaron Gostein and Grant Sanderson NanoGPT animation by Clayton Rabideau 3d black-box model by Paul Dancstep Chess game and Lagrange Multiplier scenes by Nishad Deulkar Music by Vince Rubinetti Timestamps 0:00 - Language trees and zipping 3:02 - Recap optimal codes 5:20 - Defining cross-entropy 8:26 - Intuition and examples 12:59 - Application to language trees 14:55 - Pre-training LLMs 20:38 - What makes this loss function best? 26:13 - Distillation 30:12 - 3b1b Talent 31:35 - KL Divergence ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim Music by Vincent Rubinetti. https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Bluesky: https://bsky.app/profile/3blue1brown.com Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com

Trabaja con este creador

Paquetes publicados por el creador de este video.

Todos los paquetes

Este creador aún no ha fijado sus tarifas. Envía una solicitud y se la pasaremos — el precio se acuerda antes de cobrar nada.

Participación mensual

al mes

Un puesto recurrente en mi contenido. Los suscriptores entran en una cola — o en un sorteo aleatorio cuando hay más suscriptores que espacios — y aparecen en el propio video, en los créditos o en la descripción.

Precio a consultar

Inicia sesión para solicitar

Colocación garantizada — nuevo video

único

Una aparición garantizada de al menos 10 segundos en mi próximo video. El precio depende de dónde caiga la inserción en el tiempo de reproducción.

Precio a consultar

  • Primeros 1–3 minutos
  • Medio del video
  • Final del video
Inicia sesión para solicitar

Colocación garantizada — Short

único

Una aparición garantizada de al menos 10 segundos dentro de un Short extraído de uno de mis videos existentes.

Precio a consultar

Inicia sesión para solicitar

Más como este

Only 1 in 100 People Can Solve These 45 Riddles

Only 1 in 100 People Can Solve These 45 Riddles

BRIGHT SIDE · Animation · Action · Mystery · Music · Other · Games · video · riddles

天哭现身黄龙山大战,诡异功法秒杀元婴修士卜云鹤 #凡人修仙传 #国漫 #shorts #donghua #madebybilibili【加入会员专享最新集】

天哭现身黄龙山大战,诡异功法秒杀元婴修士卜云鹤 #凡人修仙传 #国漫 #shorts #donghua #madebybilibili【加入会员专享最新集】

Made By Bilibili - Chinese Donghua Animation · Animation · Trailer · Official Trailer

What’s your best guess? #shorts

What’s your best guess? #shorts

TED-Ed · Animation · education

S.W.A.T. - Street Quit SWAT (S3E11) | Movieclips

S.W.A.T. - Street Quit SWAT (S3E11) | Movieclips

Movieclips · Animation · Action · Trailers · street · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films

《胶囊计划:英雄》第9话:不可控核聚变【热血 | 科幻 | 武侠 | Made By Bilibili】

《胶囊计划:英雄》第9话:不可控核聚变【热血 | 科幻 | 武侠 | Made By Bilibili】

Made By Bilibili - Chinese Donghua Animation · Animation

Better Call Saul - Jimmy Sells Phones And Gets Mugged (S4E5) | Movieclips

Better Call Saul - Jimmy Sells Phones And Gets Mugged (S4E5) | Movieclips

Movieclips · Animation · Drama · Trailers · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films

The dark origins of Disney fairy tales - Claudia Schwabe

The dark origins of Disney fairy tales - Claudia Schwabe

TED-Ed · Animation · History · Music · video · education · stories · Learning

Scientists Just Found Non-Human DNA in Our Bodies

Scientists Just Found Non-Human DNA in Our Bodies

BRIGHT SIDE · Animation · Action · Documentary · Mystery · Music · Other · video · science

Why American Houses Are So Flimsy

Why American Houses Are So Flimsy

Wendover Productions · Animation · Other · education

13 most EXPENSIVE Tech Fails of all time

13 most EXPENSIVE Tech Fails of all time

Mrwhosetheboss · Music · Tech · video · technology · science · gadgets

555-5555

555-5555

LORN · Music

Samsung S26 Ultra Hands on - What's ACTUALLY New?

Samsung S26 Ultra Hands on - What's ACTUALLY New?

Mrwhosetheboss · Music · Tech · technology · science

Why your best ideas usually start as bad ones | Think Like A Musician

Why your best ideas usually start as bad ones | Think Like A Musician

TED-Ed · Animation · Music · creative · video · education · Songs · Learning

Glass is glass

Glass is glass

Marques Brownlee · Music · Tech · technology · science

The Hidden Engineering Behind the Falkirk Wheel

The Hidden Engineering Behind the Falkirk Wheel

Practical Engineering · Music · Other · Updates · creative · practical · video · education

Samsung Z Fold/Flip 8 Hands on - Fold ULTRA??

Samsung Z Fold/Flip 8 Hands on - Fold ULTRA??

Mrwhosetheboss · Music · Tech · technology · science

Zero Gravity Is Weirder Than You Think (Bonus Episode)

Zero Gravity Is Weirder Than You Think (Bonus Episode)

Cleo Abram · Music · daily · Tech · video · technology · science

Are Beavers Actually Good at Dams?

Are Beavers Actually Good at Dams?

Practical Engineering · Music · Other · Updates · creative · practical · video · education

The Largest Biological Attack in US History | Fascinating Horror

The Largest Biological Attack in US History | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · city · Country · education · true stories · stories

IF James Bond lived in a 3 bedroom house

IF James Bond lived in a 3 bedroom house

colinfurze · Other

"Nobody Leaves Without Paying" - The Ycuá Bolaños Fire | Fascinating Horror

"Nobody Leaves Without Paying" - The Ycuá Bolaños Fire | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · Crime · History · Music · Other · daily · education · true stories · stories

Stripe buys OpenRouter, Ramp’s AI Index & IBM’s OpenAI deal

Stripe buys OpenRouter, Ramp’s AI Index & IBM’s OpenAI deal

IBM Technology · Other · Updates · video · tools · education

Hidden camera reveals a marketplace for pardons #shorts

Hidden camera reveals a marketplace for pardons #shorts

60 Minutes · Other

Why Have Orcas Turned Violent? | Fascinating Horror Shorts

Why Have Orcas Turned Violent? | Fascinating Horror Shorts

Fascinating Horror · Adventure · Horror · Documentary · Mystery · Family · History · Music · Other · nature · education · true stories · stories

Disney's FastPass: A Complicated History

Disney's FastPass: A Complicated History

Defunctland · History · Other · trip · Walk · Vlog · food · education · lines · tips

How a crucial battleground candidate is rethinking AI safety

How a crucial battleground candidate is rethinking AI safety

Vox · Other · driving · video · technology

Why NASA Is Sending This Truck To The Moon

Why NASA Is Sending This Truck To The Moon

Cleo Abram · Music · daily · drive · driving · testing · video · technology · truck

Neutron stars gave you jewelry. #shorts #science #SciShow

Neutron stars gave you jewelry. #shorts #science #SciShow

SciShow · video · science · education

I Tested NASA's New Space Suit (Ft. Axiom Space)

I Tested NASA's New Space Suit (Ft. Axiom Space)

Cleo Abram · Music · Other · daily · testing · Tech · video · technology · science · scenes · stories

So You Want to Build a Tunnel...

So You Want to Build a Tunnel...

Practical Engineering · Music · Other · Updates · creative · practical · video · education

The illusion of the ‘self’ | The Gray Area

The illusion of the ‘self’ | The Gray Area

Vox · Mystery · Other · moments · driving · video · science · stories · psychology

The incredible engineering of Venice - Stephanie H. Smith

The incredible engineering of Venice - Stephanie H. Smith

TED-Ed · Animation · History · Music · city · video · education · Learning

The Massive Machine Hidden in the Deep Ocean

The Massive Machine Hidden in the Deep Ocean

Cleo Abram · Music · nature · daily · video · technology · machines · science

I Wrote a NEW Sci-Fi with Project Hail Mary Author Andy Weir

I Wrote a NEW Sci-Fi with Project Hail Mary Author Andy Weir

Cleo Abram · Science Fiction · Music · Interviews · sci fi · Life · daily · Tech · video · technology · science · stories

What your language says about you

What your language says about you

AsapSCIENCE · science · education · psychology

The Hidden Engineering of Runways

The Hidden Engineering of Runways

Practical Engineering · Music · Other · Updates · creative · practical · video · education

Why People Thought "Aliens" Made These Rocks

Why People Thought "Aliens" Made These Rocks

SciShow · Documentary · Life · science · education · Learning

This Spillway Failed On Purpose

This Spillway Failed On Purpose

Practical Engineering · Music · Other · Updates · creative · practical · video · education

We’ve all been there

We’ve all been there

AsapSCIENCE · education

Name That Infrastructure (Ep. 13) #shorts

Name That Infrastructure (Ep. 13) #shorts

Practical Engineering · practical · testing · education

Does this new data represent you? 🤡 #stats #happiness #science

Does this new data represent you? 🤡 #stats #happiness #science

AsapSCIENCE · science · education

Edgar Allan Poe's story of the Red Death - Iseult Gillespie

Edgar Allan Poe's story of the Red Death - Iseult Gillespie

TED-Ed · Animation · Horror · Country · video · education · Learning

Dolly Parton’s Best Scenes | Steel Magnolias

Dolly Parton’s Best Scenes | Steel Magnolias

FilmIsNow Epic Scenes · Animation · Drama · Horror · moments · movie clips · scenes

American Fiction (2023) 4K - "We's Lives in Da Ghetto" Book (1/12) | Movieclips

American Fiction (2023) 4K - "We's Lives in Da Ghetto" Book (1/12) | Movieclips

Movieclips · Animation · Comedy · Trailers · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films

S.W.A.T. - Street Goes Undercover (S3E11) | Movieclips

S.W.A.T. - Street Goes Undercover (S3E11) | Movieclips

Movieclips · Animation · Action · Trailers · street · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films

Minions & Monsters (2026) 4K - Jaws vs. Minions (7/11) | Movieclips

Minions & Monsters (2026) 4K - Jaws vs. Minions (7/11) | Movieclips

Movieclips · Animation · Comedy · Trailers · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films · kids

The Cave (2005) - Cersei Lannister's Kiss of Death (12/12) | Movieclips

The Cave (2005) - Cersei Lannister's Kiss of Death (12/12) | Movieclips

Movieclips · Animation · Horror · Thriller · Trailers · moments · MOVIECLIPS · movie clips · scenes · lines · favorite films

George Clooney Gambles for His Life | Money Monster

George Clooney Gambles for His Life | Money Monster

FilmIsNow Epic Scenes · Animation · Horror · Thriller · street · Life · moments · movie clips · scenes

Alien Monster Town - NOCTARI 5 Trailer. Dark Sci-fi fantasy action episode film, Vampire monsters

Alien Monster Town - NOCTARI 5 Trailer. Dark Sci-fi fantasy action episode film, Vampire monsters

Black Eye Media AB · Animation · Fantasy · Action · Trailer · scenes

Solo Deep in the Ozarks

Solo Deep in the Ozarks

Peter Santenello · Adventure · Mystery · War · Family · Other · trip · Country · drive · car · video · India · scenes · tips