⚪ NEOTLIX.SPACE — Každý tvůrce je režisér. Každý fanoušek je budoucí hvězda! ⚪ Kdokoli se může objevit v jakémkoli videu ⚪ Pronajměte si svou tvář ⚪ Zpeněžte svá videa ⚪ Proměňte své sledující v honoráře ⚪ Podívejte se, jak to funguje ⚪

Další

How might LLMs store facts | Deep Learning Chapter 7 How might LLMs store facts | Deep Learning Chapter 7 23 min BURDENS BURDENS 3 min Game Prices - Scott The Woz Game Prices - Scott The Woz 34 min They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror 11 min 555-5555 555-5555 3 min How The Fukushima Nuclear Plant Melted Down | Fascinating Horror How The Fukushima Nuclear Plant Melted Down | Fascinating Horror 15 min The Prisoner of Bogan The Prisoner of Bogan 32 min The Strangest Operating System in History | Fascinating Horror Shorts The Strangest Operating System in History | Fascinating Horror Shorts 1 min REQUIEM REQUIEM 4 min I Tested Smartphones from Every Country I Tested Smartphones from Every Country 25 min We bought the most Extreme Gaming Tech! We bought the most Extreme Gaming Tech! 20 min Taken 4 (2027) Liam Neeson & Maggie Grace Taken 4 (2027) Liam Neeson & Maggie Grace 9 min Jakey - DRIVE OFF A BRIDGE (Official Video) Jakey - DRIVE OFF A BRIDGE (Official Video) 5 min Of course Abaddon hates #KPopDemonHunters. #HauntedHotel S2 returns Oct 9! #Netflix #Shorts Of course Abaddon hates #KPopDemonHunters. #HauntedHotel S2 returns Oct 9! #Netflix #Shorts 1 min Ghost Rider (2028) Ryan Gosling & Mahershala Ali Ghost Rider (2028) Ryan Gosling & Mahershala Ali 9 min I cannot believe Jodrell Bank let me do this I cannot believe Jodrell Bank let me do this 24 min Why Does AI Need Access to the Web? Why Does AI Need Access to the Web? 20 min Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes 44 min AI News: The AI World is REALLY Scared Right Now AI News: The AI World is REALLY Scared Right Now 36 min How to Start a Faceless YouTube Channel in 2026! How to Start a Faceless YouTube Channel in 2026! 18 min What Is the AI Security Trilemma? Smart, Fast, or Secure AI? What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 min DefunctTV: The History of the Big Comfy Couch DefunctTV: The History of the Big Comfy Couch 27 min How to Turn Trash into Art How to Turn Trash into Art 1 min The Ohio State Penitentiary Fire | Fascinating Horror The Ohio State Penitentiary Fire | Fascinating Horror 12 min Stop editing manually, do this instead Stop editing manually, do this instead 1 min Is there a Priest Hole in Your House? | Fascinating Horror Shorts Is there a Priest Hole in Your House? | Fascinating Horror Shorts 1 min What Is MLflow? Tracing AI Agents & LLM Workflows What Is MLflow? Tracing AI Agents & LLM Workflows 10 min How Do We Write Backwards?! 🤯 How Do We Write Backwards?! 🤯 1 min Stop Expecting AI Perfection ❌ Stop Expecting AI Perfection ❌ 1 min DefunctTV: The History of Under the Umbrella Tree DefunctTV: The History of Under the Umbrella Tree 26 min Casey Neistat: The Death of "Art" on YouTube Casey Neistat: The Death of "Art" on YouTube 41 min You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus 25 min Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO 1 min Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥 Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥 12 min DOUGHNUT FACTORY #PeppaPig #Shorts DOUGHNUT FACTORY #PeppaPig #Shorts 1 min This Glove Punches For You! (COLD GAS ROCKET FIST) This Glove Punches For You! (COLD GAS ROCKET FIST) 20 min 9 Free AI Skills That Feel Like Cheat Codes 9 Free AI Skills That Feel Like Cheat Codes 30 min I put jet engines on a SLED and broke a WORLD RECORD I put jet engines on a SLED and broke a WORLD RECORD 27 min Lessons From Training Composer At Cursor And Building Meta/Nvidia Compute Clusters | YC Paper Club Lessons From Training Composer At Cursor And Building Meta/Nvidia Compute Clusters | YC Paper Club 77 min Why USA 1.0 failed Why USA 1.0 failed 33 min The Only 19 Skills to Make Money in the AI Era The Only 19 Skills to Make Money in the AI Era 26 min Every iPhone Ever. SAME photo! Every iPhone Ever. SAME photo! 1 min Meet the Pets - Yvonne's Three Chickens Meet the Pets - Yvonne's Three Chickens 16 min LORN - PERFEKT DARK LORN - PERFEKT DARK 4 min Tears in the Rain Tears in the Rain 3 min I got hit in the teeth at England's oldest ritual I got hit in the teeth at England's oldest ritual 16 min How do you keep 8,995 codebreakers secret? How do you keep 8,995 codebreakers secret? 27 min Hijack Hijack 6 min Steam Machine Review Steam Machine Review 1 min This ZOOM is Insane! This ZOOM is Insane! 2 min THE SLOW BLADE THE SLOW BLADE 4 min

How might LLMs store facts | Deep Learning Chapter 7

2024 23 min

Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video's start: https://www.alignmentforum.org/posts/iGuwZTHWb6DFY3sKB/fact-finding-attempting-to-reverse-engineer-factual-recall Anthropic posts about superposition referenced near the end: https://transformer-circuits.pub/2022/toy_model/index.html https://transformer-circuits.pub/2023/monosemantic-features Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading list https://www.alignmentforum.org/posts/NfFST5Mio7BCAQHPA/an-extremely-opinionated-annotated-list-of-my-favourite Getting started in mechanistic interpretability https://www.neelnanda.io/mechanistic-interpretability/getting-started An interactive demo of sparse autoencoders (made by Neuronpedia) https://www.neuronpedia.org/gemma-scope#main Coding tutorials for mechanistic interpretability (made by ARENA) https://arena3-chapter1-transformer-interp.streamlit.app/ Звуковая дорожка на русском языке: Влад Бурмистров. Sections: 0:00 - Where facts in LLMs live 2:15 - Quick refresher on transformers 4:39 - Assumptions for our toy example 6:07 - Inside a multilayer perceptron 15:38 - Counting parameters 17:04 - Superposition 21:37 - Up next ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com

Země

Spojené státy

Pracujte s tímto tvůrcem

Balíčky publikované tvůrcem tohoto videa.

Všechny balíčky

Tento tvůrce si ještě nenastavil své sazby. Odešlete žádost a my ji předáme — cena je dohodnuta před jakýmkoli účtováním.

Měsíční účast

za měsíc

Opakující se místo v mém obsahu. Odběratelé vstupují do fronty — nebo náhodného losu, když je odběratelů více než slotů — a objevují se v samotném videu, v titulkách nebo v popisu.

Cena na vyžádání

Přihlaste se pro odeslání žádosti

Garantované umístění — nové video

jednorázově

Garantované objevení se po dobu nejméně 10 sekund v mém dalším videu. Cena závisí na tom, kam se vložka v průběhu času umístí.

Cena na vyžádání

  • První 1–3 minuty
  • Střed videa
  • Konec videa
Přihlaste se pro odeslání žádosti

Garantované umístění — Short

jednorázově

Garantované objevení se po dobu nejméně 10 sekund v Shortu sestříhaném z jednoho z mých stávajících videí.

Cena na vyžádání

Přihlaste se pro odeslání žádosti

Podobné

BURDENS

BURDENS

LORN · Music

Game Prices - Scott The Woz

Game Prices - Scott The Woz

Scott The Woz · Fantasy · Music · Gaming · city · Life · Country · village · food

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

555-5555

555-5555

LORN · Music

How The Fukushima Nuclear Plant Melted Down | Fascinating Horror

How The Fukushima Nuclear Plant Melted Down | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · CGI · japan · vintage · science · education · true stories · stories

The Prisoner of Bogan

The Prisoner of Bogan

Holocron Archives · Animation · Music · Cinematic · Life

The Strangest Operating System in History | Fascinating Horror Shorts

The Strangest Operating System in History | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · Tech · technology · education · true stories · stories

REQUIEM

REQUIEM

LORN · Music

I Tested Smartphones from Every Country

I Tested Smartphones from Every Country

Mrwhosetheboss · Music · Country · Tech · technology · science

We bought the most Extreme Gaming Tech!

We bought the most Extreme Gaming Tech!

Mrwhosetheboss · Music · PlayStation · Xbox · Gaming · nintendo · testing · Tech · technology · science

Taken 4 (2027) Liam Neeson & Maggie Grace

Taken 4 (2027) Liam Neeson & Maggie Grace

Film Royalty · Animation · Action · Thriller · Family · Updates · Trailer · video · tips

Jakey - DRIVE OFF A BRIDGE (Official Video)

Jakey - DRIVE OFF A BRIDGE (Official Video)

NakeyJakey · Comedy · drive · video

Of course Abaddon hates #KPopDemonHunters. #HauntedHotel S2 returns Oct 9! #Netflix #Shorts

Of course Abaddon hates #KPopDemonHunters. #HauntedHotel S2 returns Oct 9! #Netflix #Shorts

Netflix · Family · Games · video

Ghost Rider (2028) Ryan Gosling & Mahershala Ali

Ghost Rider (2028) Ryan Gosling & Mahershala Ali

Film Royalty · Animation · Cinematic · Trailer · video · tips

I cannot believe Jodrell Bank let me do this

I cannot believe Jodrell Bank let me do this

Tom Scott · photography · video · education

Why Does AI Need Access to the Web?

Why Does AI Need Access to the Web?

IBM Technology · Updates · video · education · Learning

Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes

Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes

60 Minutes · History · Interviews · video · reports

AI News: The AI World is REALLY Scared Right Now

AI News: The AI World is REALLY Scared Right Now

Matt Wolfe · Music · announcements · Trailer · daily · video · technology · tools · science · fitness · Learning

How to Start a Faceless YouTube Channel in 2026!

How to Start a Faceless YouTube Channel in 2026!

Think Media · Music · video · tools · education · tips

What Is the AI Security Trilemma? Smart, Fast, or Secure AI?

What Is the AI Security Trilemma? Smart, Fast, or Secure AI?

IBM Technology · Updates · video · security · education

DefunctTV: The History of the Big Comfy Couch

DefunctTV: The History of the Big Comfy Couch

Defunctland · History · education · kids

How to Turn Trash into Art

How to Turn Trash into Art

Colin and Samir · education

The Ohio State Penitentiary Fire | Fascinating Horror

The Ohio State Penitentiary Fire | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

Stop editing manually, do this instead

Stop editing manually, do this instead

Think Media · video · tools · education · tips

Is there a Priest Hole in Your House? | Fascinating Horror Shorts

Is there a Priest Hole in Your House? | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

What Is MLflow? Tracing AI Agents & LLM Workflows

What Is MLflow? Tracing AI Agents & LLM Workflows

IBM Technology · Updates · video · education

How Do We Write Backwards?! 🤯

How Do We Write Backwards?! 🤯

IBM Technology · Action · video · education · scenes

Stop Expecting AI Perfection ❌

Stop Expecting AI Perfection ❌

IBM Technology · education

DefunctTV: The History of Under the Umbrella Tree

DefunctTV: The History of Under the Umbrella Tree

Defunctland · History · education · kids

Casey Neistat: The Death of "Art" on YouTube

Casey Neistat: The Death of "Art" on YouTube

Colin and Samir · Vlog · video · education · stories

You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus

You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · Other · Life · Cartoon · cars · education · stories · tips · kid songs · Preschool Songs · Songs · Preschool · Cartoons · Learning · kids

Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO

Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO

Peppa Pig - Official Channel · Adventure · Animation · Musical · Music · Games · Life · cooking · Cartoon · moments · driving · cars · video · education · stories · Songs · Preschool · Learning · kids

Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥

Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥

ElectroBOOM · Other · video · technology · tools · science · Learning

DOUGHNUT FACTORY #PeppaPig #Shorts

DOUGHNUT FACTORY #PeppaPig #Shorts

Peppa Pig - Official Channel · Adventure · Animation · Musical · Music · Games · cooking · Cartoon · moments · driving · cars · video · education · stories · Songs · Preschool · Learning · kids

This Glove Punches For You! (COLD GAS ROCKET FIST)

This Glove Punches For You! (COLD GAS ROCKET FIST)

Hacksmith Industries · Animation · Action · Music · Life · japan · Tech · video · technology · tools · machines · science · Learning

9 Free AI Skills That Feel Like Cheat Codes

9 Free AI Skills That Feel Like Cheat Codes

Matt Wolfe · Animation · Other · video · technology · tools · science · tests · Learning

I put jet engines on a SLED and broke a WORLD RECORD

I put jet engines on a SLED and broke a WORLD RECORD

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

Lessons From Training Composer At Cursor And Building Meta/Nvidia Compute Clusters | YC Paper Club

Lessons From Training Composer At Cursor And Building Meta/Nvidia Compute Clusters | YC Paper Club

Y Combinator · NVIDIA · practical · technology · science · Learning

Why USA 1.0 failed

Why USA 1.0 failed

Johnny Harris · History · Music · Cinematic · Country · video · reports · education · stories · Learning

The Only 19 Skills to Make Money in the AI Era

The Only 19 Skills to Make Money in the AI Era

Dan Martell · education · Learning

Every iPhone Ever. SAME photo!

Every iPhone Ever. SAME photo!

Marques Brownlee · technology · science

Meet the Pets - Yvonne's Three Chickens

Meet the Pets - Yvonne's Three Chickens

Linus Tech Tips · technology · science

LORN - PERFEKT DARK

LORN - PERFEKT DARK

LORN · Music

Tears in the Rain

Tears in the Rain

Hans Zimmer · Music

I got hit in the teeth at England's oldest ritual

I got hit in the teeth at England's oldest ritual

Tom Scott · photography · village · video · education

How do you keep 8,995 codebreakers secret?

How do you keep 8,995 codebreakers secret?

Tom Scott · photography · education

Hijack

Hijack

Hans Zimmer · Music

Steam Machine Review

Steam Machine Review

Linus Tech Tips · technology · science

This ZOOM is Insane!

This ZOOM is Insane!

Marques Brownlee · technology · science

THE SLOW BLADE

THE SLOW BLADE

LORN · Music