⚪ NEOTLIX.SPACE — Chaque créateur est un réalisateur. Chaque fan est une future star ! ⚪ Tout le monde peut jouer dans n’importe quelle vidéo ⚪ Louez votre visage ⚪ Monétisez vos vidéos ⚪ Transformez vos abonnés en redevances ⚪ Découvrez comment cela fonctionne ⚪

À suivre

How might LLMs store facts | Deep Learning Chapter 7 How might LLMs store facts | Deep Learning Chapter 7 23 min iPhone Duo Hands On! iPhone Duo Hands On! 2 min 13 most EXPENSIVE Tech Fails of all time 13 most EXPENSIVE Tech Fails of all time 24 min I bought the most CURSED TECH on the internet ft. KSI I bought the most CURSED TECH on the internet ft. KSI 25 min Toxic ABANDONED Shopping Mall - Exploration Toxic ABANDONED Shopping Mall - Exploration 14 min They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror 11 min The Prisoner of Bogan The Prisoner of Bogan 32 min SUICIDE NOTE SUICIDE NOTE 4 min The Lost Divers They Refused To Rescue: The Paria Accident | Fascinating Horror The Lost Divers They Refused To Rescue: The Paria Accident | Fascinating Horror 12 min Disney Channel's Theme: A History Mystery Disney Channel's Theme: A History Mystery 92 min Crashed By A Crocodile? The Filair Let-410 Crash | Fascinating Horror Crashed By A Crocodile? The Filair Let-410 Crash | Fascinating Horror 11 min Numb & Tingling Feet? How to Reverse Nerve Damage Numb & Tingling Feet? How to Reverse Nerve Damage 7 min OpenAI talks GPT-6 Astra and Millenium Prize, researchers create WeWorm exploit & IBM’s US Open app OpenAI talks GPT-6 Astra and Millenium Prize, researchers create WeWorm exploit & IBM’s US Open app 34 min Mr Bean Tries to SCARE Irma at the Cinema 🍿 | Mr Bean Live Action | Funny Clips | Mr Bean Mr Bean Tries to SCARE Irma at the Cinema 🍿 | Mr Bean Live Action | Funny Clips | Mr Bean 1 min The #1 Best Food to Reverse Fatty Liver The #1 Best Food to Reverse Fatty Liver 2 min Uh oh… AI-search engine for developers has emerged Uh oh… AI-search engine for developers has emerged 1 min What Is the AI Security Trilemma? Smart, Fast, or Secure AI? What Is the AI Security Trilemma? Smart, Fast, or Secure AI? 10 min BE SLOW, GET SHOCKED!!! (feat. @Kouman ) BE SLOW, GET SHOCKED!!! (feat. @Kouman ) 19 min SPIDER-MAN 5 #shorts #spiderman #spiderman5 #avengersdoomsday SPIDER-MAN 5 #shorts #spiderman #spiderman5 #avengersdoomsday 1 min John Rambo #shorts #johnrambo #noahcentineo #rambo John Rambo #shorts #johnrambo #noahcentineo #rambo 1 min The Road to 3 Million Views🚀 The Road to 3 Million Views🚀 1 min What Is MLflow? Tracing AI Agents & LLM Workflows What Is MLflow? Tracing AI Agents & LLM Workflows 10 min People are going to be angry about pylons. People are going to be angry about pylons. 8 min The Most Expensive Ad of All Time The Most Expensive Ad of All Time 2 min NVIDIA's Open Source Strategy🤖 NVIDIA's Open Source Strategy🤖 1 min ❤️ Find Your Intersection with Content ❤️ Find Your Intersection with Content 1 min I should not have liked the world’s first smart home. I should not have liked the world’s first smart home. 26 min AI Simplified: 6 Concepts You Need to Know About Modern AI AI Simplified: 6 Concepts You Need to Know About Modern AI 9 min How to Go Viral While Being Positive How to Go Viral While Being Positive 1 min THIS levels up your Pocket 4 THIS levels up your Pocket 4 1 min Why Your Videos Get No Views Why Your Videos Get No Views 1 min The Basement: Thomas Campbell | NASA Secrets, Binaural Beats, Simulation Theory The Basement: Thomas Campbell | NASA Secrets, Binaural Beats, Simulation Theory 251 min AI News: An INSANE Week… Here’s What Matters AI News: An INSANE Week… Here’s What Matters 28 min THE WAIT IS OVER, THE POWER ARMOR IS BACK! #fallout #powerarmor #engineering THE WAIT IS OVER, THE POWER ARMOR IS BACK! #fallout #powerarmor #engineering 1 min Boat Picnic 🧺 #shorts #peppapig Boat Picnic 🧺 #shorts #peppapig 1 min How the Mormon Church Made $293 Billion How the Mormon Church Made $293 Billion 71 min Making my bones UNBREAKABLE with real-life NANOTECH! Making my bones UNBREAKABLE with real-life NANOTECH! 43 min Why Everyone Is Freaking Out About Fable 5 (Mythos) Why Everyone Is Freaking Out About Fable 5 (Mythos) 21 min Becoming a CYBORG with TWO ROBOT ARMS! Becoming a CYBORG with TWO ROBOT ARMS! 28 min Should Kids Still Go To College? (Answering All Your Questions) Should Kids Still Go To College? (Answering All Your Questions) 48 min You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus 25 min Rain Rain 3 min The Gaming Market is Starting to Break. The Gaming Market is Starting to Break. 23 min Swimming Against Man-Made Waves Swimming Against Man-Made Waves 1 min Vestige I Vestige I 3 min Valve's Steam Frame is okay... but I love other things about it Valve's Steam Frame is okay... but I love other things about it 2 min Apple's $599 laptop is surprising Apple's $599 laptop is surprising 1 min Asking Linus the Important Questions, Clanker Attacks Me | Why is WAN Late Episode 26 Asking Linus the Important Questions, Clanker Attacks Me | Why is WAN Late Episode 26 24 min Why Fitbit Air Could Be Huge Why Fitbit Air Could Be Huge 1 min This 100-year-old ride must never change again. This 100-year-old ride must never change again. 17 min A robot just swapped my electric car's battery A robot just swapped my electric car's battery 6 min

How might LLMs store facts | Deep Learning Chapter 7

2024 23 min

Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video's start: https://www.alignmentforum.org/posts/iGuwZTHWb6DFY3sKB/fact-finding-attempting-to-reverse-engineer-factual-recall Anthropic posts about superposition referenced near the end: https://transformer-circuits.pub/2022/toy_model/index.html https://transformer-circuits.pub/2023/monosemantic-features Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading list https://www.alignmentforum.org/posts/NfFST5Mio7BCAQHPA/an-extremely-opinionated-annotated-list-of-my-favourite Getting started in mechanistic interpretability https://www.neelnanda.io/mechanistic-interpretability/getting-started An interactive demo of sparse autoencoders (made by Neuronpedia) https://www.neuronpedia.org/gemma-scope#main Coding tutorials for mechanistic interpretability (made by ARENA) https://arena3-chapter1-transformer-interp.streamlit.app/ Звуковая дорожка на русском языке: Влад Бурмистров. Sections: 0:00 - Where facts in LLMs live 2:15 - Quick refresher on transformers 4:39 - Assumptions for our toy example 6:07 - Inside a multilayer perceptron 15:38 - Counting parameters 17:04 - Superposition 21:37 - Up next ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here: https://3b1b.co/faq#manim https://github.com/3b1b/manim https://github.com/ManimCommunity/manim/ All code for specific videos is visible here: https://github.com/3b1b/videos/ The music is by Vincent Rubinetti. https://www.vincentrubinetti.com https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list: https://3blue1brown.substack.com Twitter: https://twitter.com/3blue1brown Instagram: https://www.instagram.com/3blue1brown Reddit: https://www.reddit.com/r/3blue1brown Facebook: https://www.facebook.com/3blue1brown Patreon: https://patreon.com/3blue1brown Website: https://www.3blue1brown.com

Travaillez avec ce créateur

Forfaits publiés par le créateur de cette vidéo.

Tous les forfaits

Ce créateur n’a pas encore défini ses tarifs. Envoyez une demande et nous la transmettrons — le prix est convenu avant tout prélèvement.

Participation mensuelle

par mois

Une place récurrente dans mon contenu. Les abonnés entrent dans une file d’attente — ou dans un tirage aléatoire quand il y a plus d’abonnés que d’emplacements — et apparaissent dans la vidéo elle-même, dans les crédits ou dans la description.

Prix sur demande

Connectez-vous pour demander

Placement garanti — nouvelle vidéo

unique

Une apparition garantie d’au moins 10 secondes dans ma prochaine vidéo. Le prix dépend de l’endroit où l’insertion tombe dans le déroulé.

Prix sur demande

  • Premières 1–3 minutes
  • Milieu de la vidéo
  • Fin de la vidéo
Connectez-vous pour demander

Placement garanti — Short

unique

Une apparition garantie d’au moins 10 secondes dans un Short extrait d’une de mes vidéos existantes.

Prix sur demande

Connectez-vous pour demander

Similaire

iPhone Duo Hands On!

iPhone Duo Hands On!

Mrwhosetheboss · Music · Tech · technology · science

13 most EXPENSIVE Tech Fails of all time

13 most EXPENSIVE Tech Fails of all time

Mrwhosetheboss · Music · Tech · video · technology · science · gadgets

I bought the most CURSED TECH on the internet ft. KSI

I bought the most CURSED TECH on the internet ft. KSI

Mrwhosetheboss · Family · Music · Gaming · testing · Tech · technology · science · driver · gadgets

Toxic ABANDONED Shopping Mall - Exploration

Toxic ABANDONED Shopping Mall - Exploration

Bright Sun Films · Documentary · History · Music

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

The Prisoner of Bogan

The Prisoner of Bogan

Holocron Archives · Animation · Music · Cinematic · Life

SUICIDE NOTE

SUICIDE NOTE

LORN · Music

The Lost Divers They Refused To Rescue: The Paria Accident | Fascinating Horror

The Lost Divers They Refused To Rescue: The Paria Accident | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

Disney Channel's Theme: A History Mystery

Disney Channel's Theme: A History Mystery

Defunctland · Mystery · History · Music · video · education

Crashed By A Crocodile? The Filair Let-410 Crash | Fascinating Horror

Crashed By A Crocodile? The Filair Let-410 Crash | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · pilot · airline · flying · education · true stories · stories

Numb & Tingling Feet? How to Reverse Nerve Damage

Numb & Tingling Feet? How to Reverse Nerve Damage

Dr. Eric Berg DC · Other · daily · video · science · education · tips · routine

OpenAI talks GPT-6 Astra and Millenium Prize, researchers create WeWorm exploit & IBM’s US Open app

OpenAI talks GPT-6 Astra and Millenium Prize, researchers create WeWorm exploit & IBM’s US Open app

IBM Technology · Action · Other · Updates · video · tools · security · science · education

Mr Bean Tries to SCARE Irma at the Cinema 🍿 | Mr Bean Live Action | Funny Clips | Mr Bean

Mr Bean Tries to SCARE Irma at the Cinema 🍿 | Mr Bean Live Action | Funny Clips | Mr Bean

Mr Bean · Comedy · Action · Compilations · Life · video

The #1 Best Food to Reverse Fatty Liver

The #1 Best Food to Reverse Fatty Liver

Dr. Eric Berg DC · Other · video · food · education · tips

Uh oh… AI-search engine for developers has emerged

Uh oh… AI-search engine for developers has emerged

Fireship · video · technology · science

What Is the AI Security Trilemma? Smart, Fast, or Secure AI?

What Is the AI Security Trilemma? Smart, Fast, or Secure AI?

IBM Technology · Updates · video · security · education

BE SLOW, GET SHOCKED!!! (feat. @Kouman )

BE SLOW, GET SHOCKED!!! (feat. @Kouman )

ElectroBOOM · Games · video · technology · tools · science · Learning

SPIDER-MAN 5 #shorts #spiderman #spiderman5 #avengersdoomsday

SPIDER-MAN 5 #shorts #spiderman #spiderman5 #avengersdoomsday

Film Royalty · Animation · Superhero · Other · Cinematic · Trailer · video · tips

John Rambo #shorts #johnrambo #noahcentineo #rambo

John Rambo #shorts #johnrambo #noahcentineo #rambo

Film Royalty · Animation · Action · War · Updates · Trailer · Trailers · military · survival · video · tips

The Road to 3 Million Views🚀

The Road to 3 Million Views🚀

IBM Technology · Tech · video · education · Learning

What Is MLflow? Tracing AI Agents & LLM Workflows

What Is MLflow? Tracing AI Agents & LLM Workflows

IBM Technology · Updates · video · education

People are going to be angry about pylons.

People are going to be angry about pylons.

Tom Scott · education

The Most Expensive Ad of All Time

The Most Expensive Ad of All Time

Colin and Samir · education

NVIDIA's Open Source Strategy🤖

NVIDIA's Open Source Strategy🤖

IBM Technology · NVIDIA · education

❤️ Find Your Intersection with Content

❤️ Find Your Intersection with Content

Think Media · education

I should not have liked the world’s first smart home.

I should not have liked the world’s first smart home.

Tom Scott · photography · education

AI Simplified: 6 Concepts You Need to Know About Modern AI

AI Simplified: 6 Concepts You Need to Know About Modern AI

IBM Technology · Updates · video · education

How to Go Viral While Being Positive

How to Go Viral While Being Positive

Colin and Samir · education

THIS levels up your Pocket 4

THIS levels up your Pocket 4

Think Media · moments · Traveling · tools · education

Why Your Videos Get No Views

Why Your Videos Get No Views

Colin and Samir · education

The Basement: Thomas Campbell | NASA Secrets, Binaural Beats, Simulation Theory

The Basement: Thomas Campbell | NASA Secrets, Binaural Beats, Simulation Theory

The Why Files · Family · Music · Life · technology · Learning

AI News: An INSANE Week… Here’s What Matters

AI News: An INSANE Week… Here’s What Matters

Matt Wolfe · Updates · Gaming · video · technology · tools · science · tests · Learning

THE WAIT IS OVER, THE POWER ARMOR IS BACK! #fallout #powerarmor #engineering

THE WAIT IS OVER, THE POWER ARMOR IS BACK! #fallout #powerarmor #engineering

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

Boat Picnic 🧺 #shorts #peppapig

Boat Picnic 🧺 #shorts #peppapig

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

How the Mormon Church Made $293 Billion

How the Mormon Church Made $293 Billion

Johnny Harris · Family · History · Music · Cinematic · video · reports · education · stories · Learning

Making my bones UNBREAKABLE with real-life NANOTECH!

Making my bones UNBREAKABLE with real-life NANOTECH!

Hacksmith Industries · Action · creative · Life · testing · Tech · video · technology · tools · machines · science · Learning

Why Everyone Is Freaking Out About Fable 5 (Mythos)

Why Everyone Is Freaking Out About Fable 5 (Mythos)

Matt Wolfe · Updates · testing · video · technology · tools · science · Learning

Becoming a CYBORG with TWO ROBOT ARMS!

Becoming a CYBORG with TWO ROBOT ARMS!

Hacksmith Industries · Action · Music · Trailer · cooking · testing · arms · Tech · video · technology · tools · machines · science · Learning

Should Kids Still Go To College? (Answering All Your Questions)

Should Kids Still Go To College? (Answering All Your Questions)

Matt Wolfe · Music · Games · video · technology · tools · science · scenes · Learning · kids

You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus

You're My Friend | Sharing is Caring | Friendship Song for Kids | Kids Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · Other · Life · Cartoon · cars · education · stories · tips · kid songs · Preschool Songs · Songs · Preschool · Cartoons · Learning · kids

Rain

Rain

Hans Zimmer · Music

The Gaming Market is Starting to Break.

The Gaming Market is Starting to Break.

Mrwhosetheboss · Music · PlayStation · Gaming · nintendo · Tech · technology · science

Swimming Against Man-Made Waves

Swimming Against Man-Made Waves

Linus Tech Tips · technology · science

Vestige I

Vestige I

LORN · Music

Valve's Steam Frame is okay... but I love other things about it

Valve's Steam Frame is okay... but I love other things about it

Linus Tech Tips · Other · technology · science

Apple's $599 laptop is surprising

Apple's $599 laptop is surprising

Mrwhosetheboss · technology · science

Asking Linus the Important Questions, Clanker Attacks Me | Why is WAN Late Episode 26

Asking Linus the Important Questions, Clanker Attacks Me | Why is WAN Late Episode 26

Linus Tech Tips · technology · science

Why Fitbit Air Could Be Huge

Why Fitbit Air Could Be Huge

Marques Brownlee · technology · science

This 100-year-old ride must never change again.

This 100-year-old ride must never change again.

Tom Scott · photography · education

A robot just swapped my electric car's battery

A robot just swapped my electric car's battery

Tom Scott · car · cars · education