⚪ NEOTLIX.SPACE — Enhver skaber er en instruktør. Enhver fan er en fremtidig stjerne! ⚪ Alle kan spille i enhver video ⚪ Lej dit ansigt ud ⚪ Tjen penge på dine videoer ⚪ Gør dine følgere til royalties ⚪ Se hvordan det fungerer ⚪

Næste

Transformers, the tech behind LLMs | Deep Learning Chapter 5 Transformers, the tech behind LLMs | Deep Learning Chapter 5 28 min Jump or Burn: The Luxor Balloon Crash | Fascinating Horror Jump or Burn: The Luxor Balloon Crash | Fascinating Horror 12 min The Unsinkable Woman | Fascinating Horror Shorts The Unsinkable Woman | Fascinating Horror Shorts 1 min A Deadly Mistake When On Safari | Fascinating Horror A Deadly Mistake When On Safari | Fascinating Horror 11 min Defunctland: The Abandoning of Celebration City Defunctland: The Abandoning of Celebration City 49 min What 'Made In America' Jeans Actually Look Like What 'Made In America' Jeans Actually Look Like 15 min Extended Interview: Air Force officer shot down in Iran on surviving behind enemy lines Extended Interview: Air Force officer shot down in Iran on surviving behind enemy lines 30 min The FDNY band that played at funerals for fallen brothers | 60 Minutes Archive The FDNY band that played at funerals for fallen brothers | 60 Minutes Archive 12 min Incredible Wolf Moments | BBC Earth Incredible Wolf Moments | BBC Earth 41 min Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive 38 min Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition) Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition) 47 min ✨Living Alone Diaries | reorganize the kitchen and rooms, having Heytea, & set up the lab space ✨Living Alone Diaries | reorganize the kitchen and rooms, having Heytea, & set up the lab space 12 min The Forces Tearing Africa Apart Are Getting Stronger The Forces Tearing Africa Apart Are Getting Stronger 57 min Life Inside a Town Owned by One Company Life Inside a Town Owned by One Company 47 min Inside Albuquerque - What’s It Really Like Inside Albuquerque - What’s It Really Like 56 min Lynxie - Nothing Left To Lose | House | NCS - Copyright Free Music Lynxie - Nothing Left To Lose | House | NCS - Copyright Free Music 3 min This Poodle Killed Three People | Fascinating Horror Shorts This Poodle Killed Three People | Fascinating Horror Shorts 1 min Abandoned - Nara Dreamland Abandoned - Nara Dreamland 17 min I Went to Florida's Remote Prison Towns I Went to Florida's Remote Prison Towns 42 min Inside Maine’s Forgotten Company Town Inside Maine’s Forgotten Company Town 57 min Inside America’s 'Closed Off' Nuclear Town Inside America’s 'Closed Off' Nuclear Town 71 min The Basement: Jeremy Corbell | Betrayal, Surveillance, and the Secret Higher Than Nuclear Weapons The Basement: Jeremy Corbell | Betrayal, Surveillance, and the Secret Higher Than Nuclear Weapons 240 min Samsung S26 Ultra Review - Breaking Point. Samsung S26 Ultra Review - Breaking Point. 17 min Young Woman Turns ABANDONED BUS into a CAFE on Wheels | Start To Finish By ‪@Hoa-Mechanical‬ Young Woman Turns ABANDONED BUS into a CAFE on Wheels | Start To Finish By ‪@Hoa-Mechanical‬ Primitive Technology | Firing Tiles and Building the Roof on the Mud Mortar/Fired Brick Hut Primitive Technology | Firing Tiles and Building the Roof on the Mud Mortar/Fired Brick Hut 17 min I Promise you this is NOT Stupid I Promise you this is NOT Stupid 10 min We Followed A Drone 1,800 Miles From UK Factory To Ukraine Frontline | Dispatch We Followed A Drone 1,800 Miles From UK Factory To Ukraine Frontline | Dispatch 12 min Midjourney has a new side quest... death Midjourney has a new side quest... death 6 min stop trusting cloud cameras!! (here's what I use instead) stop trusting cloud cameras!! (here's what I use instead) 40 min Every Color of The New Samsung Galaxy Z Fold 8 Ultra, Fold 8 & Flip 8 Every Color of The New Samsung Galaxy Z Fold 8 Ultra, Fold 8 & Flip 8 24 min Android 17 Is the Biggest Upgrade in Years Android 17 Is the Biggest Upgrade in Years 18 min LLM & AI Agent Benchmarks vs Reality: Why AI Applications Break LLM & AI Agent Benchmarks vs Reality: Why AI Applications Break 16 min This 100-year-old ride must never change again. This 100-year-old ride must never change again. 17 min Defenders Must Adapt Fast💨 Defenders Must Adapt Fast💨 1 min How The Fukushima Nuclear Plant Melted Down | Fascinating Horror How The Fukushima Nuclear Plant Melted Down | Fascinating Horror 15 min A robot just swapped my electric car's battery A robot just swapped my electric car's battery 6 min What if that one video changes everything for your channel? What if that one video changes everything for your channel? 1 min To help fire this trebuchet, I climbed inside it To help fire this trebuchet, I climbed inside it 23 min Stop Expecting AI Perfection ❌ Stop Expecting AI Perfection ❌ 1 min Better Instructions, Better AI Results Better Instructions, Better AI Results 1 min This Mars rover's cool. But have you seen its wheels? This Mars rover's cool. But have you seen its wheels? 23 min Peppa Makes Perfume 🌸 #shorts #peppapig Peppa Makes Perfume 🌸 #shorts #peppapig 1 min Why Does AI Need Access to the Web? Why Does AI Need Access to the Web? 20 min AI News: OpenAI Absolutely Cooked This Week! AI News: OpenAI Absolutely Cooked This Week! 35 min Rain Rain Go Away | Family Song for Kids | Nursery Rhymes & Kids Songs | BabyBus Rain Rain Go Away | Family Song for Kids | Nursery Rhymes & Kids Songs | BabyBus 19 min Peppa Pig Paints The BIGGEST Picture in the World! 🎨 👩‍🎨 Peppa Pig Full Episodes | 1 Hour Peppa Pig Paints The BIGGEST Picture in the World! 🎨 👩‍🎨 Peppa Pig Full Episodes | 1 Hour 63 min AI News: The AI Agent Race Just Exploded AI News: The AI Agent Race Just Exploded 35 min Engineering FLOAT CHALLENGE! #Aiper #AiperExpertsDuo #AiperScubaV3 #AiperEcoSurferS2 Engineering FLOAT CHALLENGE! #Aiper #AiperExpertsDuo #AiperScubaV3 #AiperEcoSurferS2 2 min Blake Scholl: How 50 People Built a Supersonic Jet Blake Scholl: How 50 People Built a Supersonic Jet 51 min Kids Learn Teamwork | Kids Become Friends | Sharing is Caring | Preschool Songs | BabyBus Kids Learn Teamwork | Kids Become Friends | Sharing is Caring | Preschool Songs | BabyBus 35 min AI News: No One Saw This Coming! AI News: No One Saw This Coming! 36 min

Transformers, the tech behind LLMs | Deep Learning Chapter 5

2024 28 min

Breaking down how Large Language Models work, visualizing how data flows through. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support --- Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf Звуковая дорожка на русском языке: Влад Бурмистров. --- Timestamps 0:00 - Predict, sample, repeat 3:03 - Inside a transformer 6:36 - Chapter layout 7:20 - The premise of Deep Learning 12:27 - Word embeddings 18:25 - Embeddings beyond words 20:22 - Unembedding 22:22 - Softmax with temperature 26:03 - Up next

Arbejd med denne skaber

Pakker offentliggjort af skaberen bag denne video.

Alle pakker

Denne skaber har ikke sat sine priser endnu. Send en anmodning, og vi videresender den — prisen aftales, før noget opkræves.

Månedlig deltagelse

pr. måned

En tilbagevendende plads i mit indhold. Abonnenter går i en kø — eller en tilfældig lodtrækning, når der er flere abonnenter end pladser — og optræder i selve videoen, i krediteringerne eller i beskrivelsen.

Pris på forespørgsel

Log ind for at anmode

Garanteret placering — ny video

engangsbeløb

En garanteret optræden på mindst 10 sekunder i min næste video. Prisen afhænger af, hvor i spilletiden indsættelsen lander.

Pris på forespørgsel

  • Første 1–3 minutter
  • Midten af videoen
  • Slutningen af videoen
Log ind for at anmode

Garanteret placering — Short

engangsbeløb

En garanteret optræden på mindst 10 sekunder i en Short klippet fra en af mine eksisterende videoer.

Pris på forespørgsel

Log ind for at anmode

Mere som denne

Jump or Burn: The Luxor Balloon Crash | Fascinating Horror

Jump or Burn: The Luxor Balloon Crash | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · pilot · education · true stories · stories

The Unsinkable Woman | Fascinating Horror Shorts

The Unsinkable Woman | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

A Deadly Mistake When On Safari | Fascinating Horror

A Deadly Mistake When On Safari | Fascinating Horror

Fascinating Horror · Adventure · Horror · Documentary · Mystery · History · Music · Other · nature · Life · education · true stories · stories

Defunctland: The Abandoning of Celebration City

Defunctland: The Abandoning of Celebration City

Defunctland · Documentary · History · city · education

What 'Made In America' Jeans Actually Look Like

What 'Made In America' Jeans Actually Look Like

Business Insider · History · Country · vintage · Tech · technology · stories

Extended Interview: Air Force officer shot down in Iran on surviving behind enemy lines

Extended Interview: Air Force officer shot down in Iran on surviving behind enemy lines

60 Minutes · History · Interviews · video · reports · lines

The FDNY band that played at funerals for fallen brothers | 60 Minutes Archive

The FDNY band that played at funerals for fallen brothers | 60 Minutes Archive

60 Minutes · History · Interviews · city · video · reports

Incredible Wolf Moments | BBC Earth

Incredible Wolf Moments | BBC Earth

BBC Earth · History · Updates · nature · Life · moments · testing · stories

Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive

Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive

60 Minutes · History · Interviews · video · reports

Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition)

Audiobook: Fascinating Horror Reads "A Scandal in Bohemia" by Arthur Conan Doyle (Members Edition)

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

✨Living Alone Diaries | reorganize the kitchen and rooms, having Heytea, & set up the lab space

✨Living Alone Diaries | reorganize the kitchen and rooms, having Heytea, & set up the lab space

Alice Wu · Other

The Forces Tearing Africa Apart Are Getting Stronger

The Forces Tearing Africa Apart Are Getting Stronger

BRIGHT SIDE · Animation · Action · Documentary · Mystery · Music · Other · video · science · discoveries

Life Inside a Town Owned by One Company

Life Inside a Town Owned by One Company

Peter Santenello · Adventure · Documentary · War · Family · History · Other · trip · Vlog · Life · ambience · drive · video · India · scenes

Inside Albuquerque - What’s It Really Like

Inside Albuquerque - What’s It Really Like

Peter Santenello · Documentary · War · Family · Other · street · streets · city · Vlog · Life · drive · video · food · India · scenes · truck

Lynxie - Nothing Left To Lose | House | NCS - Copyright Free Music

Lynxie - Nothing Left To Lose | House | NCS - Copyright Free Music

NoCopyrightSounds · Music · Other · Gaming · video · Songs

This Poodle Killed Three People | Fascinating Horror Shorts

This Poodle Killed Three People | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

Abandoned - Nara Dreamland

Abandoned - Nara Dreamland

Bright Sun Films · Documentary · History · Other · japan · video

I Went to Florida's Remote Prison Towns

I Went to Florida's Remote Prison Towns

Peter Santenello · Adventure · War · Family · Other · drive · video · India · scenes

Inside Maine’s Forgotten Company Town

Inside Maine’s Forgotten Company Town

Peter Santenello · Documentary · War · Family · Other · Life · drive · video · India · scenes

Inside America’s 'Closed Off' Nuclear Town

Inside America’s 'Closed Off' Nuclear Town

Peter Santenello · Documentary · War · Family · History · Other · drive · video · India · scenes

The Basement: Jeremy Corbell | Betrayal, Surveillance, and the Secret Higher Than Nuclear Weapons

The Basement: Jeremy Corbell | Betrayal, Surveillance, and the Secret Higher Than Nuclear Weapons

The Why Files · War · Family · History · Music · Tech · video · weapons · science

Samsung S26 Ultra Review - Breaking Point.

Samsung S26 Ultra Review - Breaking Point.

Mrwhosetheboss · Music · Tech · technology · science

Young Woman Turns ABANDONED BUS into a CAFE on Wheels | Start To Finish By ‪@Hoa-Mechanical‬

Young Woman Turns ABANDONED BUS into a CAFE on Wheels | Start To Finish By ‪@Hoa-Mechanical‬

Quantum Makers · Walk · streets · Life · Tech HD · Tech

Primitive Technology | Firing Tiles and Building the Roof on the Mud Mortar/Fired Brick Hut

Primitive Technology | Firing Tiles and Building the Roof on the Mud Mortar/Fired Brick Hut

Primitive Technology · survival · testing · Tech · Primitive technology · technology · pyrotechnology · shelter · weapons · food & agriculture · food · agriculture · tools & machines · tools · machines · weaving & fiber · weaving · fiber

I Promise you this is NOT Stupid

I Promise you this is NOT Stupid

Linus Tech Tips · Gaming · drive · Tech · video · technology · security · science · tips

We Followed A Drone 1,800 Miles From UK Factory To Ukraine Frontline | Dispatch

We Followed A Drone 1,800 Miles From UK Factory To Ukraine Frontline | Dispatch

Business Insider · Western · Tech · technology · weapons · stories

Midjourney has a new side quest... death

Midjourney has a new side quest... death

Fireship · Tech · technology · science

stop trusting cloud cameras!! (here's what I use instead)

stop trusting cloud cameras!! (here's what I use instead)

NetworkChuck · Tech · technology · security · science

Every Color of The New Samsung Galaxy Z Fold 8 Ultra, Fold 8 & Flip 8

Every Color of The New Samsung Galaxy Z Fold 8 Ultra, Fold 8 & Flip 8

Unbox Therapy · Other · Updates · Tech · technology · science · gadgets

Android 17 Is the Biggest Upgrade in Years

Android 17 Is the Biggest Upgrade in Years

Mrwhosetheboss · Music · Tech · technology · science

LLM & AI Agent Benchmarks vs Reality: Why AI Applications Break

LLM & AI Agent Benchmarks vs Reality: Why AI Applications Break

IBM Technology · Updates · video · education

This 100-year-old ride must never change again.

This 100-year-old ride must never change again.

Tom Scott · photography · education

Defenders Must Adapt Fast💨

Defenders Must Adapt Fast💨

IBM Technology · Tech · security · education

How The Fukushima Nuclear Plant Melted Down | Fascinating Horror

How The Fukushima Nuclear Plant Melted Down | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · CGI · japan · vintage · science · education · true stories · stories

A robot just swapped my electric car's battery

A robot just swapped my electric car's battery

Tom Scott · car · cars · education

What if that one video changes everything for your channel?

What if that one video changes everything for your channel?

Think Media · video · education · tips

To help fire this trebuchet, I climbed inside it

To help fire this trebuchet, I climbed inside it

Tom Scott · photography · education

Stop Expecting AI Perfection ❌

Stop Expecting AI Perfection ❌

IBM Technology · education

Better Instructions, Better AI Results

Better Instructions, Better AI Results

IBM Technology · technology · education

This Mars rover's cool. But have you seen its wheels?

This Mars rover's cool. But have you seen its wheels?

Tom Scott · photography · drive · flying · education

Peppa Makes Perfume 🌸 #shorts #peppapig

Peppa Makes Perfume 🌸 #shorts #peppapig

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

Why Does AI Need Access to the Web?

Why Does AI Need Access to the Web?

IBM Technology · Updates · video · education · Learning

AI News: OpenAI Absolutely Cooked This Week!

AI News: OpenAI Absolutely Cooked This Week!

Matt Wolfe · Drama · NVIDIA · testing · video · technology · tools · science · Learning

Rain Rain Go Away | Family Song for Kids | Nursery Rhymes & Kids Songs | BabyBus

Rain Rain Go Away | Family Song for Kids | Nursery Rhymes & Kids Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · Family · Music · Life · cooking · Cartoon · car · cars · food · education · stories · tips · kid songs · Songs · Cartoons · Learning · kids

Peppa Pig Paints The BIGGEST Picture in the World! 🎨 👩‍🎨 Peppa Pig Full Episodes | 1 Hour

Peppa Pig Paints The BIGGEST Picture in the World! 🎨 👩‍🎨 Peppa Pig Full Episodes | 1 Hour

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

AI News: The AI Agent Race Just Exploded

AI News: The AI Agent Race Just Exploded

Matt Wolfe · Music · Other · NVIDIA · Updates · video · technology · tools · science · Learning

Engineering FLOAT CHALLENGE! #Aiper #AiperExpertsDuo #AiperScubaV3 #AiperEcoSurferS2

Engineering FLOAT CHALLENGE! #Aiper #AiperExpertsDuo #AiperScubaV3 #AiperEcoSurferS2

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

Blake Scholl: How 50 People Built a Supersonic Jet

Blake Scholl: How 50 People Built a Supersonic Jet

Y Combinator · Life · technology · science · Learning

Kids Learn Teamwork | Kids Become Friends | Sharing is Caring | Preschool Songs | BabyBus

Kids Learn Teamwork | Kids Become Friends | Sharing is Caring | Preschool Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · Other · Cartoon · cars · education · Preschool Songs · Songs · Preschool · Cartoons · Learning · kids

AI News: No One Saw This Coming!

AI News: No One Saw This Coming!

Matt Wolfe · Updates · daily · driving · Tech · video · technology · tools · security · devices · science · Learning