⚪ NEOTLIX.SPACE — Katrs veidotājs ir režisors. Katrs fans ir nākotnes zvaigzne! ⚪ Ikviens var spēlēt jebkurā video ⚪ Izīrējiet savu seju ⚪ Pelņiet no saviem video ⚪ Pārvērtiet savus sekotājus autoratlīdzībās ⚪ Uzziniet, kā tas darbojas ⚪

Nākamais

How might LLMs store facts | Deep Learning Chapter 7 How might LLMs store facts | Deep Learning Chapter 7 23 min Can Frogs Power a Lightbulb? | Fascinating Horror Shorts Can Frogs Power a Lightbulb? | Fascinating Horror Shorts 1 min TIMESINK TIMESINK 5 min I Made a Bet with Tesla I Made a Bet with Tesla 12 min I Transformed My Body in 90 days. I Transformed My Body in 90 days. 20 min Antique Steam Tractor Kills Five | Fascinating Horror Antique Steam Tractor Kills Five | Fascinating Horror 11 min A Developer's First Game - Scott The Woz A Developer's First Game - Scott The Woz 19 min HYS HYS 2 min None an Island None an Island 4 min MEMORY MANAGEMENT MEMORY MANAGEMENT 4 min The Best Car I've Ever Driven: McLaren W1 The Best Car I've Ever Driven: McLaren W1 17 min What Is the AI Security Trilemma? Smart, Fast, or Secure AI? What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 min I Tested 47 Sony Cameras – These Are My Favorite! I Tested 47 Sony Cameras – These Are My Favorite! 18 min DJI Pocket 4P: Finally, a Real Upgrade! DJI Pocket 4P: Finally, a Real Upgrade! 15 min LAST TO LEAVE THE ISLAND LAST TO LEAVE THE ISLAND 68 min What Is Digital Sovereignty? AI, Data & Control Explained What Is Digital Sovereignty? AI, Data & Control Explained 10 min Hidden Camera Investigations | 60 Minutes Full Episodes Hidden Camera Investigations | 60 Minutes Full Episodes 73 min Mr Bean Turns Teddy Into a Baby! 🧸 #mrbean #newmrbean2026 Mr Bean Turns Teddy Into a Baby! 🧸 #mrbean #newmrbean2026 1 min Ahsoka Season 2 (2027) Rosario Dawson & Lars Mikkelsen Ahsoka Season 2 (2027) Rosario Dawson & Lars Mikkelsen 9 min 13 most EXPENSIVE Tech Fails of all time 13 most EXPENSIVE Tech Fails of all time 24 min Ranking Every Countries Most Popular Dish Ranking Every Countries Most Popular Dish 21 min How we use @GoogleGemini to draft better YouTube intros #GooglePartner How we use @GoogleGemini to draft better YouTube intros #GooglePartner 3 min The Jagermeister Pool of Death | Fascinating Horror Shorts The Jagermeister Pool of Death | Fascinating Horror Shorts 1 min 10 harsh YouTube lessons we wish we knew at 21 10 harsh YouTube lessons we wish we knew at 21 16 min Claude Fable 5 is smarter💡 Claude Fable 5 is smarter💡 1 min AI Agents Are Becoming the Attack Surface🤖 AI Agents Are Becoming the Attack Surface🤖 1 min Thomas, a tank engine, is not Thomas the Tank Engine. Thomas, a tank engine, is not Thomas the Tank Engine. 18 min Defunctland: The American Idol Theme Park Experience Defunctland: The American Idol Theme Park Experience 68 min How These 1-Minute Movies Are Making Billions How These 1-Minute Movies Are Making Billions 46 min Which Pocket Camera is BEST for YOU? Which Pocket Camera is BEST for YOU? 1 min How do you keep 8,995 codebreakers secret? How do you keep 8,995 codebreakers secret? 27 min Colorful Donuts Vending Machine | Learn Colors for Children | Nursery Rhyme & Kids Songs | BabyBus Colorful Donuts Vending Machine | Learn Colors for Children | Nursery Rhyme & Kids Songs | BabyBus 41 min Using a Schlieren Lens to Visualize Air Flow! (Members Update #47) Using a Schlieren Lens to Visualize Air Flow! (Members Update #47) 8 min I almost quit YouTube.... I almost quit YouTube.... 24 min Tales VS Toys: Dollhouse DISASTER! 🏠 #PeppaPig #Shorts #toys #toyplay Tales VS Toys: Dollhouse DISASTER! 🏠 #PeppaPig #Shorts #toys #toyplay 1 min The Power Armor Legs Are Complete! ⚡| Real Life Power Armor (Part 7/6) The Power Armor Legs Are Complete! ⚡| Real Life Power Armor (Part 7/6) 27 min Peppa Pig Tales 2026 🪞 Peppa's FUTURISTIC Mirror 🕶️ Learning About Reflections! ✨ NEW Peppa Pig Peppa Pig Tales 2026 🪞 Peppa's FUTURISTIC Mirror 🕶️ Learning About Reflections! ✨ NEW Peppa Pig 31 min Mummy Pig Goes Skiing 🎿 #shorts #peppapig Mummy Pig Goes Skiing 🎿 #shorts #peppapig 1 min TURBANATOR 2: CANADA DAY 🇨🇦(Dark Humor) TURBANATOR 2: CANADA DAY 🇨🇦(Dark Humor) 5 min Why Everyone Is Freaking Out About Fable 5 (Mythos) Why Everyone Is Freaking Out About Fable 5 (Mythos) 21 min Nukes are way scarier than you think Nukes are way scarier than you think 48 min 3 Things We Got Wrong About The Steam Machine 3 Things We Got Wrong About The Steam Machine 1 min The Steam Machine Killer The Steam Machine Killer 2 min They can fly 200 miles with no fuel. Here's how. They can fly 200 miles with no fuel. Here's how. 28 min NOCLIP NOCLIP 3 min Swimming Against Man-Made Waves Swimming Against Man-Made Waves 1 min If you found candy with my name in it, here's why. If you found candy with my name in it, here's why. 18 min The HOTTEST Phone The HOTTEST Phone 1 min Pilot Pilot 3 min Her Eyes Were Green Her Eyes Were Green 7 min FORECAST FORECAST 4 min

How might LLMs store facts | Deep Learning Chapter 7

2024 23 min

Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video's start: https://www.alignmentforum.org/posts/iGuwZTHWb6DFY3sKB/fact-finding-attempting-to-reverse-engineer-factual-recall Anthropic posts about superposition referenced near the end: https://transformer-circuits.pub/2022/toy_model/index.html https://transformer-circuits.pub/2023/monosemantic-features Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading list https://www.alignmentforum.org/posts/NfFST5Mio7BCAQHPA/an-extremely-opinionated-annotated-list-of-my-favourite Getting started in mechanistic interpretability https://www.neelnanda.io/mechanistic-interpretability/getting-started An interactive demo of sparse autoencoders (made by Neuronpedia) https://www.neuronpedia.org/gemma-scope#main Coding tutorials for mechanistic interpretability (made by ARENA) https://arena3-chapter1-transformer-interp.streamlit.app/ Звуковая дорожка на русском языке: Влад Бурмистров. Sections: 0:00 - Where facts in LLMs live 2:15 - Quick refresher on transformers 4:39 - Assumptions for our toy example 6:07 - Inside a multilayer perceptron 15:38 - Counting parameters 17:04 - Superposition 21:37 - Up next ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com

Valsts

Amerikas Savienotās Valstis

Work with this creator

Packages published by the creator behind this video.

All packages

This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.

Monthly participation

per month

A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.

Price on request

Sign in to request

Guaranteed placement — new video

one-off

A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.

Price on request

  • First 1–3 minutes
  • Middle of the video
  • End of the video
Sign in to request

Guaranteed placement — Short

one-off

A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.

Price on request

Sign in to request

Līdzīgi

Can Frogs Power a Lightbulb? | Fascinating Horror Shorts

Can Frogs Power a Lightbulb? | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · science · education · true stories · stories

TIMESINK

TIMESINK

LORN · Music

I Made a Bet with Tesla

I Made a Bet with Tesla

Marques Brownlee · Music · technology · science

I Transformed My Body in 90 days.

I Transformed My Body in 90 days.

Mrwhosetheboss · Music · kit · Tech · technology · science · fitness

Antique Steam Tractor Kills Five | Fascinating Horror

Antique Steam Tractor Kills Five | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · city · Country · video · Australia · education · true stories · stories

A Developer's First Game - Scott The Woz

A Developer's First Game - Scott The Woz

Scott The Woz · Music · Gaming

HYS

HYS

LORN · Music

None an Island

None an Island

LORN · Music

MEMORY MANAGEMENT

MEMORY MANAGEMENT

LORN · Music

The Best Car I've Ever Driven: McLaren W1

The Best Car I've Ever Driven: McLaren W1

Marques Brownlee · Music · drive · car · technology · science

What Is the AI Security Trilemma? Smart, Fast, or Secure AI?

What Is the AI Security Trilemma? Smart, Fast, or Secure AI?

IBM Technology · Updates · video · security · education

I Tested 47 Sony Cameras – These Are My Favorite!

I Tested 47 Sony Cameras – These Are My Favorite!

Think Media · Music · testing · video · education

DJI Pocket 4P: Finally, a Real Upgrade!

DJI Pocket 4P: Finally, a Real Upgrade!

Think Media · Music · Walk · video · education · Slow Motion · tests

LAST TO LEAVE THE ISLAND

LAST TO LEAVE THE ISLAND

Beta Squad · video

What Is Digital Sovereignty? AI, Data & Control Explained

What Is Digital Sovereignty? AI, Data & Control Explained

IBM Technology · Updates · video · technology · education

Hidden Camera Investigations | 60 Minutes Full Episodes

Hidden Camera Investigations | 60 Minutes Full Episodes

60 Minutes · History · Interviews · video · reports · technology · science · stories

Mr Bean Turns Teddy Into a Baby! 🧸 #mrbean #newmrbean2026

Mr Bean Turns Teddy Into a Baby! 🧸 #mrbean #newmrbean2026

Mr Bean · Comedy · Compilations · Life · video

Ahsoka Season 2 (2027) Rosario Dawson & Lars Mikkelsen

Ahsoka Season 2 (2027) Rosario Dawson & Lars Mikkelsen

Film Royalty · Animation · Updates · Trailer · video · tips

13 most EXPENSIVE Tech Fails of all time

13 most EXPENSIVE Tech Fails of all time

Mrwhosetheboss · Music · Tech · video · technology · science · gadgets

Ranking Every Countries Most Popular Dish

Ranking Every Countries Most Popular Dish

Chunkz · Comedy · Family · cooking · video · food

How we use @GoogleGemini to draft better YouTube intros #GooglePartner

How we use @GoogleGemini to draft better YouTube intros #GooglePartner

Colin and Samir · education

The Jagermeister Pool of Death | Fascinating Horror Shorts

The Jagermeister Pool of Death | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · Australia · education · true stories · stories

10 harsh YouTube lessons we wish we knew at 21

10 harsh YouTube lessons we wish we knew at 21

Colin and Samir · video · education

Claude Fable 5 is smarter💡

Claude Fable 5 is smarter💡

IBM Technology · education

AI Agents Are Becoming the Attack Surface🤖

AI Agents Are Becoming the Attack Surface🤖

IBM Technology · education

Thomas, a tank engine, is not Thomas the Tank Engine.

Thomas, a tank engine, is not Thomas the Tank Engine.

Tom Scott · photography · video · education

Defunctland: The American Idol Theme Park Experience

Defunctland: The American Idol Theme Park Experience

Defunctland · Documentary · History · video · education

How These 1-Minute Movies Are Making Billions

How These 1-Minute Movies Are Making Billions

Colin and Samir · education

Which Pocket Camera is BEST for YOU?

Which Pocket Camera is BEST for YOU?

Think Media · education

How do you keep 8,995 codebreakers secret?

How do you keep 8,995 codebreakers secret?

Tom Scott · photography · education

Colorful Donuts Vending Machine | Learn Colors for Children | Nursery Rhyme & Kids Songs | BabyBus

Colorful Donuts Vending Machine | Learn Colors for Children | Nursery Rhyme & Kids Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · cooking · food · education · stories · Preschool Songs · Songs · Preschool · Cartoons · Learning · kids

Using a Schlieren Lens to Visualize Air Flow! (Members Update #47)

Using a Schlieren Lens to Visualize Air Flow! (Members Update #47)

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

I almost quit YouTube....

I almost quit YouTube....

NetworkChuck · japan · Tech · video · technology · security · science · Learning

Tales VS Toys: Dollhouse DISASTER! 🏠 #PeppaPig #Shorts #toys #toyplay

Tales VS Toys: Dollhouse DISASTER! 🏠 #PeppaPig #Shorts #toys #toyplay

Peppa Pig - Official Channel · Adventure · Animation · Musical · Music · Games · cooking · Cartoon · moments · driving · cars · video · education · stories · Songs · Preschool · Learning · kids

The Power Armor Legs Are Complete! ⚡| Real Life Power Armor (Part 7/6)

The Power Armor Legs Are Complete! ⚡| Real Life Power Armor (Part 7/6)

Hacksmith Industries · Action · Other · Life · Tech · video · technology · tools · machines · science · Learning

Peppa Pig Tales 2026 🪞 Peppa's FUTURISTIC Mirror 🕶️ Learning About Reflections! ✨ NEW Peppa Pig

Peppa Pig Tales 2026 🪞 Peppa's FUTURISTIC Mirror 🕶️ Learning About Reflections! ✨ NEW Peppa Pig

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Life · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

Mummy Pig Goes Skiing 🎿 #shorts #peppapig

Mummy Pig Goes Skiing 🎿 #shorts #peppapig

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

TURBANATOR 2: CANADA DAY 🇨🇦(Dark Humor)

TURBANATOR 2: CANADA DAY 🇨🇦(Dark Humor)

Wristaker · Comedy · War · Satire · Parody · Country · video · Learning

Why Everyone Is Freaking Out About Fable 5 (Mythos)

Why Everyone Is Freaking Out About Fable 5 (Mythos)

Matt Wolfe · Updates · testing · video · technology · tools · science · Learning

Nukes are way scarier than you think

Nukes are way scarier than you think

Johnny Harris · Music · Cinematic · arms · video · reports · weapons · India · stories · Learning

3 Things We Got Wrong About The Steam Machine

3 Things We Got Wrong About The Steam Machine

Linus Tech Tips · technology · science

The Steam Machine Killer

The Steam Machine Killer

Linus Tech Tips · video · technology · science

They can fly 200 miles with no fuel. Here's how.

They can fly 200 miles with no fuel. Here's how.

Tom Scott · photography · education

NOCLIP

NOCLIP

LORN · Music

Swimming Against Man-Made Waves

Swimming Against Man-Made Waves

Linus Tech Tips · technology · science

If you found candy with my name in it, here's why.

If you found candy with my name in it, here's why.

Tom Scott · photography · arms · education

The HOTTEST Phone

The HOTTEST Phone

Marques Brownlee · technology · science

Pilot

Pilot

Hans Zimmer · Music · pilot

Her Eyes Were Green

Her Eyes Were Green

Hans Zimmer · Music

FORECAST

FORECAST

LORN · Music