⚪ NEOTLIX.SPACE — Każdy twórca jest reżyserem. Każdy fan jest przyszłą gwiazdą! ⚪ Każdy może wystąpić w każdym wideo ⚪ Wynajmij swoją twarz ⚪ Zarabiaj na swoich wideo ⚪ Zamień swoich obserwujących w tantiemy ⚪ Zobacz, jak to działa ⚪

Następny

How might LLMs store facts | Deep Learning Chapter 7 How might LLMs store facts | Deep Learning Chapter 7 23 min Best 4K Multicam Setup for Live Events! (Full Gear Breakdown) Best 4K Multicam Setup for Live Events! (Full Gear Breakdown) 12 min I tested phones that shouldn’t EXIST I tested phones that shouldn’t EXIST 23 min The Giant Rotting Pink Bunny in the Middle of Nowhere | Fascinating Horror Shorts The Giant Rotting Pink Bunny in the Middle of Nowhere | Fascinating Horror Shorts 1 min What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts 1 min They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror 11 min That's Why We Believe That's Why We Believe 4 min This Poodle Killed Three People | Fascinating Horror Shorts This Poodle Killed Three People | Fascinating Horror Shorts 1 min I Tested 21 Vlogging Cameras in 2026! (so you don't have to) I Tested 21 Vlogging Cameras in 2026! (so you don't have to) 32 min Google Pixel 11/Pro/Fold Impressions: It Is What It Is Google Pixel 11/Pro/Fold Impressions: It Is What It Is 12 min The Story Behind "The Day The Music Died" | Fascinating Horror The Story Behind "The Day The Music Died" | Fascinating Horror 12 min What Is RAD? Why It Matters in the Age of AI Coding What Is RAD? Why It Matters in the Age of AI Coding 11 min I cannot believe Jodrell Bank let me do this I cannot believe Jodrell Bank let me do this 24 min How AI Coding Agents Understand Your Codebase & Developer Tools How AI Coding Agents Understand Your Codebase & Developer Tools 7 min DJI Pocket 4 vs Pocket 4P | Everything You Need to Know DJI Pocket 4 vs Pocket 4P | Everything You Need to Know 16 min Scientists Found A Better Language For AI Agents Scientists Found A Better Language For AI Agents 7 min Mr Bean Gets CHASED by a DINOSAUR! 🦖 | Mr Bean Animated Season 2 | Funny Clips | Mr Bean Mr Bean Gets CHASED by a DINOSAUR! 🦖 | Mr Bean Animated Season 2 | Funny Clips | Mr Bean 24 min BETA SQUAD $10,000 CHALLENGE BETA SQUAD $10,000 CHALLENGE 26 min BAT-GARAGE Tour + BAT-SIGNAL Restoration (MEMBERS EXCLUSIVE) BAT-GARAGE Tour + BAT-SIGNAL Restoration (MEMBERS EXCLUSIVE) 12 min Infrared Touchscreens #technology #electronic #experiment Infrared Touchscreens #technology #electronic #experiment 1 min The Handwich: Disney's Failed Sandwich of the Future The Handwich: Disney's Failed Sandwich of the Future 24 min A robot just swapped my electric car's battery A robot just swapped my electric car's battery 6 min Stop Expecting AI Perfection ❌ Stop Expecting AI Perfection ❌ 1 min What should security leaders do with AI? They don’t know. What should security leaders do with AI? They don’t know. 30 min Defunctland: The Bizarre Garfield Dark Ride Defunctland: The Bizarre Garfield Dark Ride 34 min I get excited about &. I get excited about &. 24 min The Story Of Shriya Shah-Klorfine | Fascinating Horror The Story Of Shriya Shah-Klorfine | Fascinating Horror 13 min 11 Marketing Rules Every YouTuber Needs to Know 11 Marketing Rules Every YouTuber Needs to Know 51 min A Deadly Mistake When On Safari | Fascinating Horror A Deadly Mistake When On Safari | Fascinating Horror 11 min I was not prepared for a mannequin that can bleed. I was not prepared for a mannequin that can bleed. 29 min After ten years, it's time to stop weekly videos. After ten years, it's time to stop weekly videos. 9 min Can You Fool A Self Driving Car? Can You Fool A Self Driving Car? 19 min WALKABOUT #PeppaPig #Shorts WALKABOUT #PeppaPig #Shorts 1 min Geography Now! KOSOVO Geography Now! KOSOVO 23 min TOMBSTONE vs ORBITRON (VIDEO #6/6) TOMBSTONE vs ORBITRON (VIDEO #6/6) 15 min Mummy Pig Goes Skiing 🎿 #shorts #peppapig Mummy Pig Goes Skiing 🎿 #shorts #peppapig 1 min Blake Scholl: How 50 People Built a Supersonic Jet Blake Scholl: How 50 People Built a Supersonic Jet 51 min Five Little Elephants Boo Boo Song | Animal Songs | Preschool Songs | BabyBus Five Little Elephants Boo Boo Song | Animal Songs | Preschool Songs | BabyBus 24 min Rate our gaming setup 🎮 #gta6 #gaming #desksetup Rate our gaming setup 🎮 #gta6 #gaming #desksetup 1 min Building Robotic Hands | Real Life Power Armor (Part 5/6) Building Robotic Hands | Real Life Power Armor (Part 5/6) 24 min What’s ACTUALLY Happening in North Korea What’s ACTUALLY Happening in North Korea 46 min Apple Lost the AI Race Apple Lost the AI Race 8 min The Truth About the Bezelless Concept Phone The Truth About the Bezelless Concept Phone 7 min MSDOS MSDOS 5 min What height does your phone become DEADLY? What height does your phone become DEADLY? 1 min Custom PC for DisguisedToast Custom PC for DisguisedToast 1 min We bought the most Extreme Gaming Tech! We bought the most Extreme Gaming Tech! 20 min The Wildest Camera Robot The Wildest Camera Robot 2 min LORN - SV_CHEATS 0 LORN - SV_CHEATS 0 4 min Apple's $599 laptop is surprising Apple's $599 laptop is surprising 1 min Why are people spending $1,000 for old iPods Why are people spending $1,000 for old iPods 16 min

How might LLMs store facts | Deep Learning Chapter 7

2024 23 min

Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video's start: https://www.alignmentforum.org/posts/iGuwZTHWb6DFY3sKB/fact-finding-attempting-to-reverse-engineer-factual-recall Anthropic posts about superposition referenced near the end: https://transformer-circuits.pub/2022/toy_model/index.html https://transformer-circuits.pub/2023/monosemantic-features Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading list https://www.alignmentforum.org/posts/NfFST5Mio7BCAQHPA/an-extremely-opinionated-annotated-list-of-my-favourite Getting started in mechanistic interpretability https://www.neelnanda.io/mechanistic-interpretability/getting-started An interactive demo of sparse autoencoders (made by Neuronpedia) https://www.neuronpedia.org/gemma-scope#main Coding tutorials for mechanistic interpretability (made by ARENA) https://arena3-chapter1-transformer-interp.streamlit.app/ Звуковая дорожка на русском языке: Влад Бурмистров. Sections: 0:00 - Where facts in LLMs live 2:15 - Quick refresher on transformers 4:39 - Assumptions for our toy example 6:07 - Inside a multilayer perceptron 15:38 - Counting parameters 17:04 - Superposition 21:37 - Up next ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com

Kraj

Stany Zjednoczone

Work with this creator

Packages published by the creator behind this video.

All packages

This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.

Monthly participation

per month

A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.

Price on request

Sign in to request

Guaranteed placement — new video

one-off

A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.

Price on request

  • First 1–3 minutes
  • Middle of the video
  • End of the video
Sign in to request

Guaranteed placement — Short

one-off

A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.

Price on request

Sign in to request

Podobne

Best 4K Multicam Setup for Live Events! (Full Gear Breakdown)

Best 4K Multicam Setup for Live Events! (Full Gear Breakdown)

Think Media · Music · Walk · Tech · video · fiber · education

I tested phones that shouldn’t EXIST

I tested phones that shouldn’t EXIST

Mrwhosetheboss · Music · Tech · technology · science · gadgets

The Giant Rotting Pink Bunny in the Middle of Nowhere | Fascinating Horror Shorts

The Giant Rotting Pink Bunny in the Middle of Nowhere | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts

What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

That's Why We Believe

That's Why We Believe

Hans Zimmer · Music

This Poodle Killed Three People | Fascinating Horror Shorts

This Poodle Killed Three People | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

I Tested 21 Vlogging Cameras in 2026! (so you don't have to)

I Tested 21 Vlogging Cameras in 2026! (so you don't have to)

Think Media · Action · Music · video · education

Google Pixel 11/Pro/Fold Impressions: It Is What It Is

Google Pixel 11/Pro/Fold Impressions: It Is What It Is

Marques Brownlee · Music · technology · science

The Story Behind "The Day The Music Died" | Fascinating Horror

The Story Behind "The Day The Music Died" | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

What Is RAD? Why It Matters in the Age of AI Coding

What Is RAD? Why It Matters in the Age of AI Coding

IBM Technology · Updates · video · education

I cannot believe Jodrell Bank let me do this

I cannot believe Jodrell Bank let me do this

Tom Scott · photography · video · education

How AI Coding Agents Understand Your Codebase & Developer Tools

How AI Coding Agents Understand Your Codebase & Developer Tools

IBM Technology · Updates · video · tools · education

DJI Pocket 4 vs Pocket 4P | Everything You Need to Know

DJI Pocket 4 vs Pocket 4P | Everything You Need to Know

Think Media · Music · Comparisons · Life · testing · video · education · Slow Motion · tests

Scientists Found A Better Language For AI Agents

Scientists Found A Better Language For AI Agents

Two Minute Papers · video · technology · science

Mr Bean Gets CHASED by a DINOSAUR! 🦖 | Mr Bean Animated Season 2 | Funny Clips | Mr Bean

Mr Bean Gets CHASED by a DINOSAUR! 🦖 | Mr Bean Animated Season 2 | Funny Clips | Mr Bean

Mr Bean · Comedy · Compilations · trip · photography · Life · countryside · video

BETA SQUAD $10,000 CHALLENGE

BETA SQUAD $10,000 CHALLENGE

Chunkz · Comedy · Family · cooking · video

BAT-GARAGE Tour + BAT-SIGNAL Restoration (MEMBERS EXCLUSIVE)

BAT-GARAGE Tour + BAT-SIGNAL Restoration (MEMBERS EXCLUSIVE)

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · restoration · Learning

Infrared Touchscreens #technology #electronic #experiment

Infrared Touchscreens #technology #electronic #experiment

ElectroBOOM · video · technology · science

The Handwich: Disney's Failed Sandwich of the Future

The Handwich: Disney's Failed Sandwich of the Future

Defunctland · History · cooking · recipes · video · food · education

A robot just swapped my electric car's battery

A robot just swapped my electric car's battery

Tom Scott · car · cars · education

Stop Expecting AI Perfection ❌

Stop Expecting AI Perfection ❌

IBM Technology · education

What should security leaders do with AI? They don’t know.

What should security leaders do with AI? They don’t know.

IBM Technology · Other · Updates · video · reports · tools · security · education

Defunctland: The Bizarre Garfield Dark Ride

Defunctland: The Bizarre Garfield Dark Ride

Defunctland · History · video · education

I get excited about &.

I get excited about &.

Tom Scott · photography · technology · education

The Story Of Shriya Shah-Klorfine | Fascinating Horror

The Story Of Shriya Shah-Klorfine | Fascinating Horror

Fascinating Horror · Adventure · Horror · Documentary · Mystery · History · Music · Other · Guides · education · true stories · stories

11 Marketing Rules Every YouTuber Needs to Know

11 Marketing Rules Every YouTuber Needs to Know

Colin and Samir · Documentary · creative · education

A Deadly Mistake When On Safari | Fascinating Horror

A Deadly Mistake When On Safari | Fascinating Horror

Fascinating Horror · Adventure · Horror · Documentary · Mystery · History · Music · Other · nature · Life · education · true stories · stories

I was not prepared for a mannequin that can bleed.

I was not prepared for a mannequin that can bleed.

Tom Scott · photography · education

After ten years, it's time to stop weekly videos.

After ten years, it's time to stop weekly videos.

Tom Scott · video · pilot · education

Can You Fool A Self Driving Car?

Can You Fool A Self Driving Car?

Mark Rober · Music · driving · car · testing · video · technology · science · Learning · kids

WALKABOUT #PeppaPig #Shorts

WALKABOUT #PeppaPig #Shorts

Peppa Pig - Official Channel · Adventure · Animation · Musical · Music · Games · cooking · Cartoon · moments · driving · cars · video · education · stories · Songs · Preschool · Learning · kids

Geography Now! KOSOVO

Geography Now! KOSOVO

Geography Now · Comedy · History · Other · Country · education · Learning

TOMBSTONE vs ORBITRON (VIDEO #6/6)

TOMBSTONE vs ORBITRON (VIDEO #6/6)

Hacksmith Industries · Action · Other · Updates · Tech · video · technology · tools · machines · science · Learning

Mummy Pig Goes Skiing 🎿 #shorts #peppapig

Mummy Pig Goes Skiing 🎿 #shorts #peppapig

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

Blake Scholl: How 50 People Built a Supersonic Jet

Blake Scholl: How 50 People Built a Supersonic Jet

Y Combinator · Life · technology · science · Learning

Five Little Elephants Boo Boo Song | Animal Songs | Preschool Songs | BabyBus

Five Little Elephants Boo Boo Song | Animal Songs | Preschool Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · Cartoon · cars · education · Preschool Songs · Songs · Preschool · Cartoons · Learning · kids

Rate our gaming setup 🎮 #gta6 #gaming #desksetup

Rate our gaming setup 🎮 #gta6 #gaming #desksetup

Hacksmith Industries · Action · Gaming · Tech · video · technology · tools · machines · science · Learning

Building Robotic Hands | Real Life Power Armor (Part 5/6)

Building Robotic Hands | Real Life Power Armor (Part 5/6)

Hacksmith Industries · Action · Music · Gaming · Life · kit · testing · Tech · video · technology · tools · machines · science · Learning

What’s ACTUALLY Happening in North Korea

What’s ACTUALLY Happening in North Korea

Johnny Harris · War · Music · Cinematic · Life · countryside · daily life · daily · military · video · reports · stories · Learning

Apple Lost the AI Race

Apple Lost the AI Race

Marques Brownlee · Music · technology · science

The Truth About the Bezelless Concept Phone

The Truth About the Bezelless Concept Phone

Marques Brownlee · Music · technology · science

MSDOS

MSDOS

LORN · Music

What height does your phone become DEADLY?

What height does your phone become DEADLY?

Mrwhosetheboss · Music · Tech · technology · science

Custom PC for DisguisedToast

Custom PC for DisguisedToast

Linus Tech Tips · technology · science

We bought the most Extreme Gaming Tech!

We bought the most Extreme Gaming Tech!

Mrwhosetheboss · Music · PlayStation · Xbox · Gaming · nintendo · testing · Tech · technology · science

The Wildest Camera Robot

The Wildest Camera Robot

Marques Brownlee · technology · science

LORN - SV_CHEATS 0

LORN - SV_CHEATS 0

LORN · Music

Apple's $599 laptop is surprising

Apple's $599 laptop is surprising

Mrwhosetheboss · technology · science

Why are people spending $1,000 for old iPods

Why are people spending $1,000 for old iPods

Linus Tech Tips · Music · Gaming · trip · kit · video · technology · science · tips · Songs