⚪ NEOTLIX.SPACE — Minden alkotó egy rendező. Minden rajongó egy jövőbeli sztár! ⚪ Bárki szerepelhet bármelyik videóban ⚪ Add bérbe az arcod ⚪ Hozz bevételt a videóidból ⚪ Változtasd a követőidet jogdíjjá ⚪ Nézd meg, hogyan működik ⚪

Következő

How might LLMs store facts | Deep Learning Chapter 7 How might LLMs store facts | Deep Learning Chapter 7 23 perc EMPTY GESTURE EMPTY GESTURE 2 perc Galaxy Z Fold 8 Review: Honeymoon's Over Galaxy Z Fold 8 Review: Honeymoon's Over 12 perc LORN - PAWO LORN - PAWO 3 perc Folding Folding 2 perc World's LARGEST headphones! World's LARGEST headphones! 1 perc Wii U: Finale of a Failure (Part III) - Scott The Woz Wii U: Finale of a Failure (Part III) - Scott The Woz 193 perc Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition) Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition) 47 perc ONE OF US ONE OF US 3 perc I Said Yes to Every Email for a Month! (Again) I Said Yes to Every Email for a Month! (Again) 31 perc Nintendo Switch: Six Years In - Scott The Woz Nintendo Switch: Six Years In - Scott The Woz 130 perc JUMANJI: Open World (2026) Will It Be Game Over? JUMANJI: Open World (2026) Will It Be Game Over? 11 perc The #1 Most Dangerous Habit in the World! The #1 Most Dangerous Habit in the World! 1 perc The Steam Machine Killer The Steam Machine Killer 2 perc The Best TINY Tech on the Internet! The Best TINY Tech on the Internet! 20 perc Every Bear Grylls Impression by GeoWIzard Every Bear Grylls Impression by GeoWIzard 3 perc Casey Neistat: The Death of "Art" on YouTube Casey Neistat: The Death of "Art" on YouTube 41 perc The Handwich: Disney's Failed Sandwich of the Future The Handwich: Disney's Failed Sandwich of the Future 24 perc Database Sharting Explained Database Sharting Explained 1 perc 🎬 The Complete Beginner’s Guide to Editing in Premiere Pro 🎬 The Complete Beginner’s Guide to Editing in Premiere Pro 2 perc YouTuber Merch Tier List YouTuber Merch Tier List 1 perc AI Won the Content War and Lost the Traffic #shorts AI Won the Content War and Lost the Traffic #shorts 1 perc Passenger Ferry Sinks While The Crew Parties - The MV Dona Paz | Fascinating Horror Passenger Ferry Sinks While The Crew Parties - The MV Dona Paz | Fascinating Horror 12 perc It Rained Shredded Meat From The Sky | Fascinating Horror Shorts It Rained Shredded Meat From The Sky | Fascinating Horror Shorts 1 perc This Football Could End the World | Fascinating Horror Shorts This Football Could End the World | Fascinating Horror Shorts 1 perc People are going to be angry about pylons. People are going to be angry about pylons. 8 perc The Small Difference Between Good and Bad Copywriting The Small Difference Between Good and Bad Copywriting 1 perc Kareem Addresses SubwayTakes Biggest Criticism Kareem Addresses SubwayTakes Biggest Criticism 1 perc The philosophy that led to TBPN's $100M+ Acquisition The philosophy that led to TBPN's $100M+ Acquisition 1 perc The Ohio State Penitentiary Fire | Fascinating Horror The Ohio State Penitentiary Fire | Fascinating Horror 12 perc Why do some British trains still rely on old levers? Why do some British trains still rely on old levers? 26 perc SOME OF THE STRANGEST BORDER ANOMALIES ON EARTH! SOME OF THE STRANGEST BORDER ANOMALIES ON EARTH! 18 perc Building Robotic Hands | Real Life Power Armor (Part 5/6) Building Robotic Hands | Real Life Power Armor (Part 5/6) 24 perc Desert Island Adventure 🏝️ #shorts #peppapig Desert Island Adventure 🏝️ #shorts #peppapig 1 perc AI News: Claude Opus 4.8, Insane Omni Use-Case, and A Dog Translator? AI News: Claude Opus 4.8, Insane Omni Use-Case, and A Dog Translator? 23 perc wHeRE's tHe PowEr ArmOR? 😵‍💫🤖 #fallout #engineering #videogames wHeRE's tHe PowEr ArmOR? 😵‍💫🤖 #fallout #engineering #videogames 1 perc Lost at Sea | Learn to Stay Brave | Safety Rules | Sheriff Labrador | Kids Cartoon | BabyBus Lost at Sea | Learn to Stay Brave | Safety Rules | Sheriff Labrador | Kids Cartoon | BabyBus 22 perc Rate our gaming setup 🎮 #gta6 #gaming #desksetup Rate our gaming setup 🎮 #gta6 #gaming #desksetup 1 perc Daddy Pig Drives on the Wrong Side in Italy 🚗 #shorts #peppapig Daddy Pig Drives on the Wrong Side in Italy 🚗 #shorts #peppapig 1 perc How To Become Dangerously Self-Educated (with AI) How To Become Dangerously Self-Educated (with AI) 21 perc Mummy Pig Goes Skiing 🎿 #shorts #peppapig Mummy Pig Goes Skiing 🎿 #shorts #peppapig 1 perc So This is Peak Smartphone So This is Peak Smartphone 14 perc Unfolding Unfolding 6 perc Automaton Automaton 4 perc POV: You locked in for 3 months POV: You locked in for 3 months 1 perc The Hunt for Xesh The Hunt for Xesh 34 perc World's HEAVIEST phone case! World's HEAVIEST phone case! 1 perc UNDEAD DOGS UNDEAD DOGS 1 perc LOSST LOSST 4 perc STUCK IN THE SYSTEM STUCK IN THE SYSTEM 5 perc How do you upgrade a lifelong Tech??? - AMD $5000 Ultimate Tech Upgrade How do you upgrade a lifelong Tech??? - AMD $5000 Ultimate Tech Upgrade 30 perc

How might LLMs store facts | Deep Learning Chapter 7

2024 23 perc

Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video's start: https://www.alignmentforum.org/posts/iGuwZTHWb6DFY3sKB/fact-finding-attempting-to-reverse-engineer-factual-recall Anthropic posts about superposition referenced near the end: https://transformer-circuits.pub/2022/toy_model/index.html https://transformer-circuits.pub/2023/monosemantic-features Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading list https://www.alignmentforum.org/posts/NfFST5Mio7BCAQHPA/an-extremely-opinionated-annotated-list-of-my-favourite Getting started in mechanistic interpretability https://www.neelnanda.io/mechanistic-interpretability/getting-started An interactive demo of sparse autoencoders (made by Neuronpedia) https://www.neuronpedia.org/gemma-scope#main Coding tutorials for mechanistic interpretability (made by ARENA) https://arena3-chapter1-transformer-interp.streamlit.app/ Звуковая дорожка на русском языке: Влад Бурмистров. Sections: 0:00 - Where facts in LLMs live 2:15 - Quick refresher on transformers 4:39 - Assumptions for our toy example 6:07 - Inside a multilayer perceptron 15:38 - Counting parameters 17:04 - Superposition 21:37 - Up next ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com

Ország

Egyesült Államok

Work with this creator

Packages published by the creator behind this video.

All packages

This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.

Monthly participation

per month

A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.

Price on request

Sign in to request

Guaranteed placement — new video

one-off

A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.

Price on request

  • First 1–3 minutes
  • Middle of the video
  • End of the video
Sign in to request

Guaranteed placement — Short

one-off

A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.

Price on request

Sign in to request

Hasonlók

EMPTY GESTURE

EMPTY GESTURE

LORN · Music

Galaxy Z Fold 8 Review: Honeymoon's Over

Galaxy Z Fold 8 Review: Honeymoon's Over

Marques Brownlee · Music · cars · testing · technology · science

LORN - PAWO

LORN - PAWO

LORN · Music · video

Folding

Folding

LORN · Music

World's LARGEST headphones!

World's LARGEST headphones!

Mrwhosetheboss · Music · Tech · technology · science · gadgets

Wii U: Finale of a Failure (Part III) - Scott The Woz

Wii U: Finale of a Failure (Part III) - Scott The Woz

Scott The Woz · Music · Gaming

Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition)

Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition)

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

ONE OF US

ONE OF US

LORN · Music

I Said Yes to Every Email for a Month! (Again)

I Said Yes to Every Email for a Month! (Again)

Marques Brownlee · Music · Gaming · Life · daily life · daily · Tech · video · technology · science

Nintendo Switch: Six Years In - Scott The Woz

Nintendo Switch: Six Years In - Scott The Woz

Scott The Woz · Music · Gaming · nintendo

JUMANJI: Open World (2026) Will It Be Game Over?

JUMANJI: Open World (2026) Will It Be Game Over?

Film Royalty · Adventure · Animation · Trailer · video · tips

The #1 Most Dangerous Habit in the World!

The #1 Most Dangerous Habit in the World!

Dr. Eric Berg DC · Other · recipes · video · education · tips

The Steam Machine Killer

The Steam Machine Killer

Linus Tech Tips · video · technology · science

The Best TINY Tech on the Internet!

The Best TINY Tech on the Internet!

Mrwhosetheboss · Music · Tech · video · technology · science

Every Bear Grylls Impression by GeoWIzard

Every Bear Grylls Impression by GeoWIzard

GeoWizard · Updates · video

Casey Neistat: The Death of "Art" on YouTube

Casey Neistat: The Death of "Art" on YouTube

Colin and Samir · Vlog · video · education · stories

The Handwich: Disney's Failed Sandwich of the Future

The Handwich: Disney's Failed Sandwich of the Future

Defunctland · History · cooking · recipes · video · food · education

Database Sharting Explained

Database Sharting Explained

Fireship · video · technology · science

🎬 The Complete Beginner’s Guide to Editing in Premiere Pro

🎬 The Complete Beginner’s Guide to Editing in Premiere Pro

Think Media · Music · Life · video · education

YouTuber Merch Tier List

YouTuber Merch Tier List

Linus Tech Tips · video · technology · science

AI Won the Content War and Lost the Traffic #shorts

AI Won the Content War and Lost the Traffic #shorts

Neil Patel · War · education

Passenger Ferry Sinks While The Crew Parties - The MV Dona Paz | Fascinating Horror

Passenger Ferry Sinks While The Crew Parties - The MV Dona Paz | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · Family · History · Music · Other · daily · education · lines · Philippines · true stories · stories

It Rained Shredded Meat From The Sky | Fascinating Horror Shorts

It Rained Shredded Meat From The Sky | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · nature · education · true stories · stories

This Football Could End the World | Fascinating Horror Shorts

This Football Could End the World | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · War · History · Music · Other · education · true stories · stories

People are going to be angry about pylons.

People are going to be angry about pylons.

Tom Scott · education

The Small Difference Between Good and Bad Copywriting

The Small Difference Between Good and Bad Copywriting

Colin and Samir · education

Kareem Addresses SubwayTakes Biggest Criticism

Kareem Addresses SubwayTakes Biggest Criticism

Colin and Samir · education

The philosophy that led to TBPN's $100M+ Acquisition

The philosophy that led to TBPN's $100M+ Acquisition

Colin and Samir · education

The Ohio State Penitentiary Fire | Fascinating Horror

The Ohio State Penitentiary Fire | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

Why do some British trains still rely on old levers?

Why do some British trains still rely on old levers?

Tom Scott · photography · video · education

SOME OF THE STRANGEST BORDER ANOMALIES ON EARTH!

SOME OF THE STRANGEST BORDER ANOMALIES ON EARTH!

Geography Now · Comedy · History · Other · Country · education · Learning

Building Robotic Hands | Real Life Power Armor (Part 5/6)

Building Robotic Hands | Real Life Power Armor (Part 5/6)

Hacksmith Industries · Action · Music · Gaming · Life · kit · testing · Tech · video · technology · tools · machines · science · Learning

Desert Island Adventure 🏝️ #shorts #peppapig

Desert Island Adventure 🏝️ #shorts #peppapig

Peppa Pig - Official Channel · Adventure · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

AI News: Claude Opus 4.8, Insane Omni Use-Case, and A Dog Translator?

AI News: Claude Opus 4.8, Insane Omni Use-Case, and A Dog Translator?

Matt Wolfe · Music · Updates · pov · Tech · video · technology · tools · science · Learning

wHeRE's tHe PowEr ArmOR? 😵‍💫🤖 #fallout #engineering #videogames

wHeRE's tHe PowEr ArmOR? 😵‍💫🤖 #fallout #engineering #videogames

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

Lost at Sea | Learn to Stay Brave | Safety Rules | Sheriff Labrador | Kids Cartoon | BabyBus

Lost at Sea | Learn to Stay Brave | Safety Rules | Sheriff Labrador | Kids Cartoon | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · Music · Life · cooking · Cartoon · car · cars · food · education · stories · tips · kid songs · Songs · Cartoons · Learning · kids

Rate our gaming setup 🎮 #gta6 #gaming #desksetup

Rate our gaming setup 🎮 #gta6 #gaming #desksetup

Hacksmith Industries · Action · Gaming · Tech · video · technology · tools · machines · science · Learning

Daddy Pig Drives on the Wrong Side in Italy 🚗 #shorts #peppapig

Daddy Pig Drives on the Wrong Side in Italy 🚗 #shorts #peppapig

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

How To Become Dangerously Self-Educated (with AI)

How To Become Dangerously Self-Educated (with AI)

Dan Martell · Action · Biography · Interviews · Life · daily · video · educate · education · Learning

Mummy Pig Goes Skiing 🎿 #shorts #peppapig

Mummy Pig Goes Skiing 🎿 #shorts #peppapig

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

So This is Peak Smartphone

So This is Peak Smartphone

Marques Brownlee · Music · technology · science

Unfolding

Unfolding

LORN · Music

Automaton

Automaton

LORN · Music

POV: You locked in for 3 months

POV: You locked in for 3 months

Mrwhosetheboss · pov · technology · science

The Hunt for Xesh

The Hunt for Xesh

Holocron Archives · Animation · History · Music · Cinematic

World's HEAVIEST phone case!

World's HEAVIEST phone case!

Mrwhosetheboss · technology · science

UNDEAD DOGS

UNDEAD DOGS

LORN · Music

LOSST

LOSST

LORN · Music

STUCK IN THE SYSTEM

STUCK IN THE SYSTEM

LORN · Music

How do you upgrade a lifelong Tech??? - AMD $5000 Ultimate Tech Upgrade

How do you upgrade a lifelong Tech??? - AMD $5000 Ultimate Tech Upgrade

Linus Tech Tips · Cyberpunk · Gaming · car · kit · Tech · technology · tools · science · tips