⚪ NEOTLIX.SPACE — هر سازنده یک کارگردان است. هر طرفدار یک ستاره آینده! ⚪ هرکسی می‌تواند در هر ویدئویی بازی کند ⚪ چهره خود را اجاره دهید ⚪ از ویدئوهای خود درآمد کسب کنید ⚪ دنبال‌کنندگان خود را به حق امتیاز تبدیل کنید ⚪ ببینید چگونه کار می‌کند ⚪

بعدی

How might LLMs store facts | Deep Learning Chapter 7 How might LLMs store facts | Deep Learning Chapter 7 23 دقیقه BURDENS BURDENS 3 دقیقه Game Prices - Scott The Woz Game Prices - Scott The Woz 34 دقیقه They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror 11 دقیقه 555-5555 555-5555 3 دقیقه How The Fukushima Nuclear Plant Melted Down | Fascinating Horror How The Fukushima Nuclear Plant Melted Down | Fascinating Horror 15 دقیقه The Prisoner of Bogan The Prisoner of Bogan 32 دقیقه The Strangest Operating System in History | Fascinating Horror Shorts The Strangest Operating System in History | Fascinating Horror Shorts 1 دقیقه REQUIEM REQUIEM 4 دقیقه I Tested Smartphones from Every Country I Tested Smartphones from Every Country 25 دقیقه We bought the most Extreme Gaming Tech! We bought the most Extreme Gaming Tech! 20 دقیقه Taken 4 (2027) Liam Neeson & Maggie Grace Taken 4 (2027) Liam Neeson & Maggie Grace 9 دقیقه Jakey - DRIVE OFF A BRIDGE (Official Video) Jakey - DRIVE OFF A BRIDGE (Official Video) 5 دقیقه Of course Abaddon hates #KPopDemonHunters. #HauntedHotel S2 returns Oct 9! #Netflix #Shorts Of course Abaddon hates #KPopDemonHunters. #HauntedHotel S2 returns Oct 9! #Netflix #Shorts 1 دقیقه Ghost Rider (2028) Ryan Gosling & Mahershala Ali Ghost Rider (2028) Ryan Gosling & Mahershala Ali 9 دقیقه I cannot believe Jodrell Bank let me do this I cannot believe Jodrell Bank let me do this 24 دقیقه Why Does AI Need Access to the Web? Why Does AI Need Access to the Web? 20 دقیقه Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes 44 دقیقه AI News: The AI World is REALLY Scared Right Now AI News: The AI World is REALLY Scared Right Now 36 دقیقه How to Start a Faceless YouTube Channel in 2026! How to Start a Faceless YouTube Channel in 2026! 18 دقیقه What Is the AI Security Trilemma? Smart, Fast, or Secure AI? What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 دقیقه DefunctTV: The History of the Big Comfy Couch DefunctTV: The History of the Big Comfy Couch 27 دقیقه How to Turn Trash into Art How to Turn Trash into Art 1 دقیقه The Ohio State Penitentiary Fire | Fascinating Horror The Ohio State Penitentiary Fire | Fascinating Horror 12 دقیقه Stop editing manually, do this instead Stop editing manually, do this instead 1 دقیقه Is there a Priest Hole in Your House? | Fascinating Horror Shorts Is there a Priest Hole in Your House? | Fascinating Horror Shorts 1 دقیقه What Is MLflow? Tracing AI Agents & LLM Workflows What Is MLflow? Tracing AI Agents & LLM Workflows 10 دقیقه How Do We Write Backwards?! 🤯 How Do We Write Backwards?! 🤯 1 دقیقه Stop Expecting AI Perfection ❌ Stop Expecting AI Perfection ❌ 1 دقیقه DefunctTV: The History of Under the Umbrella Tree DefunctTV: The History of Under the Umbrella Tree 26 دقیقه Casey Neistat: The Death of "Art" on YouTube Casey Neistat: The Death of "Art" on YouTube 41 دقیقه You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus 25 دقیقه Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO 1 دقیقه Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥 Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥 12 دقیقه DOUGHNUT FACTORY #PeppaPig #Shorts DOUGHNUT FACTORY #PeppaPig #Shorts 1 دقیقه This Glove Punches For You! (COLD GAS ROCKET FIST) This Glove Punches For You! (COLD GAS ROCKET FIST) 20 دقیقه 9 Free AI Skills That Feel Like Cheat Codes 9 Free AI Skills That Feel Like Cheat Codes 30 دقیقه I put jet engines on a SLED and broke a WORLD RECORD I put jet engines on a SLED and broke a WORLD RECORD 27 دقیقه Lessons From Training Composer At Cursor And Building Meta/Nvidia Compute Clusters | YC Paper Club Lessons From Training Composer At Cursor And Building Meta/Nvidia Compute Clusters | YC Paper Club 77 دقیقه Why USA 1.0 failed Why USA 1.0 failed 33 دقیقه The Only 19 Skills to Make Money in the AI Era The Only 19 Skills to Make Money in the AI Era 26 دقیقه Every iPhone Ever. SAME photo! Every iPhone Ever. SAME photo! 1 دقیقه Meet the Pets - Yvonne's Three Chickens Meet the Pets - Yvonne's Three Chickens 16 دقیقه LORN - PERFEKT DARK LORN - PERFEKT DARK 4 دقیقه Tears in the Rain Tears in the Rain 3 دقیقه I got hit in the teeth at England's oldest ritual I got hit in the teeth at England's oldest ritual 16 دقیقه How do you keep 8,995 codebreakers secret? How do you keep 8,995 codebreakers secret? 27 دقیقه Hijack Hijack 6 دقیقه Steam Machine Review Steam Machine Review 1 دقیقه This ZOOM is Insane! This ZOOM is Insane! 2 دقیقه THE SLOW BLADE THE SLOW BLADE 4 دقیقه

How might LLMs store facts | Deep Learning Chapter 7

2024 23 دقیقه

Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video's start: https://www.alignmentforum.org/posts/iGuwZTHWb6DFY3sKB/fact-finding-attempting-to-reverse-engineer-factual-recall Anthropic posts about superposition referenced near the end: https://transformer-circuits.pub/2022/toy_model/index.html https://transformer-circuits.pub/2023/monosemantic-features Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading list https://www.alignmentforum.org/posts/NfFST5Mio7BCAQHPA/an-extremely-opinionated-annotated-list-of-my-favourite Getting started in mechanistic interpretability https://www.neelnanda.io/mechanistic-interpretability/getting-started An interactive demo of sparse autoencoders (made by Neuronpedia) https://www.neuronpedia.org/gemma-scope#main Coding tutorials for mechanistic interpretability (made by ARENA) https://arena3-chapter1-transformer-interp.streamlit.app/ Звуковая дорожка на русском языке: Влад Бурмистров. Sections: 0:00 - Where facts in LLMs live 2:15 - Quick refresher on transformers 4:39 - Assumptions for our toy example 6:07 - Inside a multilayer perceptron 15:38 - Counting parameters 17:04 - Superposition 21:37 - Up next ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com

کشور

ایالات متحده

Work with this creator

Packages published by the creator behind this video.

All packages

This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.

Monthly participation

per month

A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.

Price on request

Sign in to request

Guaranteed placement — new video

one-off

A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.

Price on request

  • First 1–3 minutes
  • Middle of the video
  • End of the video
Sign in to request

Guaranteed placement — Short

one-off

A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.

Price on request

Sign in to request

مشابه این

BURDENS

BURDENS

LORN · Music

Game Prices - Scott The Woz

Game Prices - Scott The Woz

Scott The Woz · Fantasy · Music · Gaming · city · Life · Country · village · food

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

555-5555

555-5555

LORN · Music

How The Fukushima Nuclear Plant Melted Down | Fascinating Horror

How The Fukushima Nuclear Plant Melted Down | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · CGI · japan · vintage · science · education · true stories · stories

The Prisoner of Bogan

The Prisoner of Bogan

Holocron Archives · Animation · Music · Cinematic · Life

The Strangest Operating System in History | Fascinating Horror Shorts

The Strangest Operating System in History | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · Tech · technology · education · true stories · stories

REQUIEM

REQUIEM

LORN · Music

I Tested Smartphones from Every Country

I Tested Smartphones from Every Country

Mrwhosetheboss · Music · Country · Tech · technology · science

We bought the most Extreme Gaming Tech!

We bought the most Extreme Gaming Tech!

Mrwhosetheboss · Music · PlayStation · Xbox · Gaming · nintendo · testing · Tech · technology · science

Taken 4 (2027) Liam Neeson & Maggie Grace

Taken 4 (2027) Liam Neeson & Maggie Grace

Film Royalty · Animation · Action · Thriller · Family · Updates · Trailer · video · tips

Jakey - DRIVE OFF A BRIDGE (Official Video)

Jakey - DRIVE OFF A BRIDGE (Official Video)

NakeyJakey · Comedy · drive · video

Of course Abaddon hates #KPopDemonHunters. #HauntedHotel S2 returns Oct 9! #Netflix #Shorts

Of course Abaddon hates #KPopDemonHunters. #HauntedHotel S2 returns Oct 9! #Netflix #Shorts

Netflix · Family · Games · video

Ghost Rider (2028) Ryan Gosling & Mahershala Ali

Ghost Rider (2028) Ryan Gosling & Mahershala Ali

Film Royalty · Animation · Cinematic · Trailer · video · tips

I cannot believe Jodrell Bank let me do this

I cannot believe Jodrell Bank let me do this

Tom Scott · photography · video · education

Why Does AI Need Access to the Web?

Why Does AI Need Access to the Web?

IBM Technology · Updates · video · education · Learning

Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes

Shot Down Over Iran, The Pardon Economy, Battering Ram | 60 Minutes Full Episodes

60 Minutes · History · Interviews · video · reports

AI News: The AI World is REALLY Scared Right Now

AI News: The AI World is REALLY Scared Right Now

Matt Wolfe · Music · announcements · Trailer · daily · video · technology · tools · science · fitness · Learning

How to Start a Faceless YouTube Channel in 2026!

How to Start a Faceless YouTube Channel in 2026!

Think Media · Music · video · tools · education · tips

What Is the AI Security Trilemma? Smart, Fast, or Secure AI?

What Is the AI Security Trilemma? Smart, Fast, or Secure AI?

IBM Technology · Updates · video · security · education

DefunctTV: The History of the Big Comfy Couch

DefunctTV: The History of the Big Comfy Couch

Defunctland · History · education · kids

How to Turn Trash into Art

How to Turn Trash into Art

Colin and Samir · education

The Ohio State Penitentiary Fire | Fascinating Horror

The Ohio State Penitentiary Fire | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

Stop editing manually, do this instead

Stop editing manually, do this instead

Think Media · video · tools · education · tips

Is there a Priest Hole in Your House? | Fascinating Horror Shorts

Is there a Priest Hole in Your House? | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

What Is MLflow? Tracing AI Agents & LLM Workflows

What Is MLflow? Tracing AI Agents & LLM Workflows

IBM Technology · Updates · video · education

How Do We Write Backwards?! 🤯

How Do We Write Backwards?! 🤯

IBM Technology · Action · video · education · scenes

Stop Expecting AI Perfection ❌

Stop Expecting AI Perfection ❌

IBM Technology · education

DefunctTV: The History of Under the Umbrella Tree

DefunctTV: The History of Under the Umbrella Tree

Defunctland · History · education · kids

Casey Neistat: The Death of "Art" on YouTube

Casey Neistat: The Death of "Art" on YouTube

Colin and Samir · Vlog · video · education · stories

You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus

You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · Other · Life · Cartoon · cars · education · stories · tips · kid songs · Preschool Songs · Songs · Preschool · Cartoons · Learning · kids

Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO

Peppa learns how to make a YUMMY Smoothie! 🥤 #PeppaPigTales #Shorts #LEGODUPLO

Peppa Pig - Official Channel · Adventure · Animation · Musical · Music · Games · Life · cooking · Cartoon · moments · driving · cars · video · education · stories · Songs · Preschool · Learning · kids

Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥

Plasma Globe is a ⚡Shocking⚡🔥Fire Hazard🔥

ElectroBOOM · Other · video · technology · tools · science · Learning

DOUGHNUT FACTORY #PeppaPig #Shorts

DOUGHNUT FACTORY #PeppaPig #Shorts

Peppa Pig - Official Channel · Adventure · Animation · Musical · Music · Games · cooking · Cartoon · moments · driving · cars · video · education · stories · Songs · Preschool · Learning · kids

This Glove Punches For You! (COLD GAS ROCKET FIST)

This Glove Punches For You! (COLD GAS ROCKET FIST)

Hacksmith Industries · Animation · Action · Music · Life · japan · Tech · video · technology · tools · machines · science · Learning

9 Free AI Skills That Feel Like Cheat Codes

9 Free AI Skills That Feel Like Cheat Codes

Matt Wolfe · Animation · Other · video · technology · tools · science · tests · Learning

I put jet engines on a SLED and broke a WORLD RECORD

I put jet engines on a SLED and broke a WORLD RECORD

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

Lessons From Training Composer At Cursor And Building Meta/Nvidia Compute Clusters | YC Paper Club

Lessons From Training Composer At Cursor And Building Meta/Nvidia Compute Clusters | YC Paper Club

Y Combinator · NVIDIA · practical · technology · science · Learning

Why USA 1.0 failed

Why USA 1.0 failed

Johnny Harris · History · Music · Cinematic · Country · video · reports · education · stories · Learning

The Only 19 Skills to Make Money in the AI Era

The Only 19 Skills to Make Money in the AI Era

Dan Martell · education · Learning

Every iPhone Ever. SAME photo!

Every iPhone Ever. SAME photo!

Marques Brownlee · technology · science

Meet the Pets - Yvonne's Three Chickens

Meet the Pets - Yvonne's Three Chickens

Linus Tech Tips · technology · science

LORN - PERFEKT DARK

LORN - PERFEKT DARK

LORN · Music

Tears in the Rain

Tears in the Rain

Hans Zimmer · Music

I got hit in the teeth at England's oldest ritual

I got hit in the teeth at England's oldest ritual

Tom Scott · photography · village · video · education

How do you keep 8,995 codebreakers secret?

How do you keep 8,995 codebreakers secret?

Tom Scott · photography · education

Hijack

Hijack

Hans Zimmer · Music

Steam Machine Review

Steam Machine Review

Linus Tech Tips · technology · science

This ZOOM is Insane!

This ZOOM is Insane!

Marques Brownlee · technology · science

THE SLOW BLADE

THE SLOW BLADE

LORN · Music