⚪ NEOTLIX.SPACE — Her yaratıcı bir yönetmendir. Her hayran geleceğin yıldızıdır! ⚪ Herkes Herhangi Bir Videoda Rol Alabilir ⚪ Yüzünüzü Kiralayın ⚪ Videolarınızdan Para Kazanın ⚪ Takipçilerinizi Telif Gelirine Dönüştürün ⚪ Nasıl Çalıştığını Görün ⚪

Sıradaki

Transformers, the tech behind LLMs | Deep Learning Chapter 5 Transformers, the tech behind LLMs | Deep Learning Chapter 5 28 dk Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive 38 dk It Rained Shredded Meat From The Sky | Fascinating Horror Shorts It Rained Shredded Meat From The Sky | Fascinating Horror Shorts 1 dk Steve Backshall Dives Into Crocodile Territory | Expedition Guyana | BBC Earth Steve Backshall Dives Into Crocodile Territory | Expedition Guyana | BBC Earth 3 dk The "Ride The Ducks" Disaster | Fascinating Horror The "Ride The Ducks" Disaster | Fascinating Horror 14 dk Travel through 4 billion years in BBC Earth Science’s Evolution with Chris Packham 🌏  #Shorts #BBC Travel through 4 billion years in BBC Earth Science’s Evolution with Chris Packham 🌏 #Shorts #BBC 1 dk DeepSeek is back... and Silicon Valley is terrified DeepSeek is back... and Silicon Valley is terrified 6 dk Defunctland VR: 20,000 Leagues Under the Sea Defunctland VR: 20,000 Leagues Under the Sea 15 dk AI News: OpenAI Just Put the Brakes on AI AI News: OpenAI Just Put the Brakes on AI 33 dk Recalling the heroism of FDNY firefighters at ground zero on 9/11 | 60 Minutes Archive Recalling the heroism of FDNY firefighters at ground zero on 9/11 | 60 Minutes Archive 41 dk Earth's Spectacular Island Wildlife | BBC Earth Earth's Spectacular Island Wildlife | BBC Earth 23 dk BETA SQUAD MAFIA GAME: ALL STAR EDITION BETA SQUAD MAFIA GAME: ALL STAR EDITION 54 dk Marvel Zombies (2027) Chris Hemsworth & Scarlett Johansson Marvel Zombies (2027) Chris Hemsworth & Scarlett Johansson 9 dk The #1 Best Food to Reverse Fatty Liver The #1 Best Food to Reverse Fatty Liver 2 dk The Real Gear I Use in My YouTube Studio! (Complete Tour) The Real Gear I Use in My YouTube Studio! (Complete Tour) 12 dk About 70% of Trump’s clemency actions did not go through DOJ #shorts About 70% of Trump’s clemency actions did not go through DOJ #shorts 3 dk SNEAKING A Painting Next To The Mona Lisa SNEAKING A Painting Next To The Mona Lisa 15 dk The Tragedy of Johnny Somali | The Most Pathetic Streamer on Kick The Tragedy of Johnny Somali | The Most Pathetic Streamer on Kick 63 dk Inside Wealthy Arkansas Inside Wealthy Arkansas 71 dk No One Can Stop It Now No One Can Stop It Now 9 dk A Trad Wife Tragedy | The Facade of Ballerina Farm A Trad Wife Tragedy | The Facade of Ballerina Farm 40 dk Революція серед наркотиків: шовковий шлях Революція серед наркотиків: шовковий шлях 63 dk The Wildest Smartphone I’ve Ever Seen 🤯 The Wildest Smartphone I’ve Ever Seen 🤯 2 dk I Tested YouTubers' Favourite Products I Tested YouTubers' Favourite Products 30 dk iPhone 18 Pro Review - My Last iPhone? iPhone 18 Pro Review - My Last iPhone? 14 dk Optimize Your Sleep Game Optimize Your Sleep Game 2 dk I put the NEWEST CPU in the OLDEST Motherboard I put the NEWEST CPU in the OLDEST Motherboard 14 dk Restoring PlayStation 3 Super Slim - Retro Console Repair Restoring PlayStation 3 Super Slim - Retro Console Repair 26 dk The Gaming Market is Starting to Break. The Gaming Market is Starting to Break. 23 dk Samsung's New Secret Screen (Samsung Galaxy S26 Ultra Unboxing) Samsung's New Secret Screen (Samsung Galaxy S26 Ultra Unboxing) 12 dk Making BULLET PROOF Power Armor | Real Life Power Armor (Part 6/?) Making BULLET PROOF Power Armor | Real Life Power Armor (Part 6/?) 32 dk Why Does AI Need Access to the Web? Why Does AI Need Access to the Web? 20 dk Thomas, a tank engine, is not Thomas the Tank Engine. Thomas, a tank engine, is not Thomas the Tank Engine. 18 dk One Reader Catches Every AI Article #shorts One Reader Catches Every AI Article #shorts 1 dk Products we wish existed, mocked up with @AdobeFirefly #adobepartner Products we wish existed, mocked up with @AdobeFirefly #adobepartner 3 dk DJI Pocket 4 & 4P ❌ USA DJI Pocket 4 & 4P ❌ USA 2 dk Inside Michelle Khare's Most Dangerous Video Inside Michelle Khare's Most Dangerous Video 90 dk They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror 11 dk Antique Steam Tractor Kills Five | Fascinating Horror Antique Steam Tractor Kills Five | Fascinating Horror 11 dk The Largest Biological Attack in US History | Fascinating Horror The Largest Biological Attack in US History | Fascinating Horror 11 dk AI Won the Content War and Lost the Traffic #shorts AI Won the Content War and Lost the Traffic #shorts 1 dk Baby Evie's in JAIL! 🚔 #PeppaPig #Shorts Baby Evie's in JAIL! 🚔 #PeppaPig #Shorts 1 dk Peppa Pig Paints The BIGGEST Picture in the World! 🎨 👩‍🎨 Peppa Pig Full Episodes | 1 Hour Peppa Pig Paints The BIGGEST Picture in the World! 🎨 👩‍🎨 Peppa Pig Full Episodes | 1 Hour 63 dk Making my Skull BULLETPROOF with Real Life Adamantium!? Making my Skull BULLETPROOF with Real Life Adamantium!? 25 dk The Road to 3 Million Views🚀 The Road to 3 Million Views🚀 1 dk Some of the STRANGEST borders I've visited Some of the STRANGEST borders I've visited 18 dk Security Drones Debrief! (Exclusive Members Bonus Video 🎥) Security Drones Debrief! (Exclusive Members Bonus Video 🎥) 11 dk Peppa Pig Tales 2026⏳Peppa Sees BABY Mummy & Daddy Pig! Secret Video❓BRAND NEW Peppa Pig Episodes Peppa Pig Tales 2026⏳Peppa Sees BABY Mummy & Daddy Pig! Secret Video❓BRAND NEW Peppa Pig Episodes 31 dk Don't Put It in Your Mouth | Baby Care & Home Safety | Kids Songs | BabyBus Don't Put It in Your Mouth | Baby Care & Home Safety | Kids Songs | BabyBus 21 dk Kid Became a Robot | Kids Learn to Be Responsible | Nursery Rhymes & Kids Songs | BabyBus Kid Became a Robot | Kids Learn to Be Responsible | Nursery Rhymes & Kids Songs | BabyBus 41 dk Boat Picnic 🧺 #shorts #peppapig Boat Picnic 🧺 #shorts #peppapig 1 dk

Transformers, the tech behind LLMs | Deep Learning Chapter 5

2024 28 dk

Breaking down how Large Language Models work, visualizing how data flows through. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support --- Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf Звуковая дорожка на русском языке: Влад Бурмистров. --- Timestamps 0:00 - Predict, sample, repeat 3:03 - Inside a transformer 6:36 - Chapter layout 7:20 - The premise of Deep Learning 12:27 - Word embeddings 18:25 - Embeddings beyond words 20:22 - Unembedding 22:22 - Softmax with temperature 26:03 - Up next

Ülke

Amerika Birleşik Devletleri

Work with this creator

Packages published by the creator behind this video.

All packages

This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.

Monthly participation

per month

A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.

Price on request

Sign in to request

Guaranteed placement — new video

one-off

A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.

Price on request

  • First 1–3 minutes
  • Middle of the video
  • End of the video
Sign in to request

Guaranteed placement — Short

one-off

A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.

Price on request

Sign in to request

Buna benzer

Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive

Barack Obama on the operation to find, kill Osama bin Laden | 60 Minutes Archive

60 Minutes · History · Interviews · video · reports

It Rained Shredded Meat From The Sky | Fascinating Horror Shorts

It Rained Shredded Meat From The Sky | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · nature · education · true stories · stories

Steve Backshall Dives Into Crocodile Territory | Expedition Guyana | BBC Earth

Steve Backshall Dives Into Crocodile Territory | Expedition Guyana | BBC Earth

BBC Earth · History · Updates · nature · Life · stories

The "Ride The Ducks" Disaster | Fascinating Horror

The "Ride The Ducks" Disaster | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · War · Family · History · Music · Other · Life · car · cars · military · reports · technology · education · true stories · stories

Travel through 4 billion years in BBC Earth Science’s Evolution with Chris Packham 🌏  #Shorts #BBC

Travel through 4 billion years in BBC Earth Science’s Evolution with Chris Packham 🌏 #Shorts #BBC

BBC Earth · History · Updates · nature · Life · science · stories

DeepSeek is back... and Silicon Valley is terrified

DeepSeek is back... and Silicon Valley is terrified

Fireship · History · technology · science

Defunctland VR: 20,000 Leagues Under the Sea

Defunctland VR: 20,000 Leagues Under the Sea

Defunctland · History · Other · CGI · education

AI News: OpenAI Just Put the Brakes on AI

AI News: OpenAI Just Put the Brakes on AI

Matt Wolfe · History · Music · Updates · drive · video · technology · tools · science · Learning

Recalling the heroism of FDNY firefighters at ground zero on 9/11 | 60 Minutes Archive

Recalling the heroism of FDNY firefighters at ground zero on 9/11 | 60 Minutes Archive

60 Minutes · History · Interviews · video · reports

Earth's Spectacular Island Wildlife | BBC Earth

Earth's Spectacular Island Wildlife | BBC Earth

BBC Earth · History · Updates · nature · Life · survival · stories

BETA SQUAD MAFIA GAME: ALL STAR EDITION

BETA SQUAD MAFIA GAME: ALL STAR EDITION

Beta Squad · Other

Marvel Zombies (2027) Chris Hemsworth & Scarlett Johansson

Marvel Zombies (2027) Chris Hemsworth & Scarlett Johansson

Film Royalty · Animation · Horror · Action · Other · survival · video · tips

The #1 Best Food to Reverse Fatty Liver

The #1 Best Food to Reverse Fatty Liver

Dr. Eric Berg DC · Other · video · food · education · tips

The Real Gear I Use in My YouTube Studio! (Complete Tour)

The Real Gear I Use in My YouTube Studio! (Complete Tour)

Think Media · Music · Other · Livestream · Interviews · Walk · daily · video · education · scenes

About 70% of Trump’s clemency actions did not go through DOJ #shorts

About 70% of Trump’s clemency actions did not go through DOJ #shorts

60 Minutes · Other

SNEAKING A Painting Next To The Mona Lisa

SNEAKING A Painting Next To The Mona Lisa

Niko Omilana · Other

The Tragedy of Johnny Somali | The Most Pathetic Streamer on Kick

The Tragedy of Johnny Somali | The Most Pathetic Streamer on Kick

j aubrey · Comedy · Documentary · Other · japan · educate

Inside Wealthy Arkansas

Inside Wealthy Arkansas

Peter Santenello · Adventure · Documentary · War · Family · Other · Country · drive · video · India · scenes

No One Can Stop It Now

No One Can Stop It Now

penguinz0 · Other

A Trad Wife Tragedy | The Facade of Ballerina Farm

A Trad Wife Tragedy | The Facade of Ballerina Farm

j aubrey · Comedy · Documentary · Other · educate · education

Революція серед наркотиків: шовковий шлях

Революція серед наркотиків: шовковий шлях

3 x 4 · History · Life · Tech

The Wildest Smartphone I’ve Ever Seen 🤯

The Wildest Smartphone I’ve Ever Seen 🤯

Matt Wolfe · Tech · technology · science · gadgets

I Tested YouTubers' Favourite Products

I Tested YouTubers' Favourite Products

Mrwhosetheboss · Music · kit · Tech · technology · science · gadgets

iPhone 18 Pro Review - My Last iPhone?

iPhone 18 Pro Review - My Last iPhone?

Mrwhosetheboss · Music · Tech · technology · science

Optimize Your Sleep Game

Optimize Your Sleep Game

Unbox Therapy · Tech · video · technology · science · gadgets

I put the NEWEST CPU in the OLDEST Motherboard

I put the NEWEST CPU in the OLDEST Motherboard

Linus Tech Tips · Cyberpunk · Gaming · testing · Tech · technology · tools · science

Restoring PlayStation 3 Super Slim - Retro Console Repair

Restoring PlayStation 3 Super Slim - Retro Console Repair

Odd Tinkering · Other · PlayStation · Xbox · Gaming · nintendo · kit · Tech · video · tools · education · restoration videos · restoration

The Gaming Market is Starting to Break.

The Gaming Market is Starting to Break.

Mrwhosetheboss · Music · PlayStation · Gaming · nintendo · Tech · technology · science

Samsung's New Secret Screen (Samsung Galaxy S26 Ultra Unboxing)

Samsung's New Secret Screen (Samsung Galaxy S26 Ultra Unboxing)

Unbox Therapy · Updates · Tech · technology · science · gadgets

Making BULLET PROOF Power Armor | Real Life Power Armor (Part 6/?)

Making BULLET PROOF Power Armor | Real Life Power Armor (Part 6/?)

Hacksmith Industries · Action · Life · Tech · video · technology · tools · machines · science · Learning

Why Does AI Need Access to the Web?

Why Does AI Need Access to the Web?

IBM Technology · Updates · video · education · Learning

Thomas, a tank engine, is not Thomas the Tank Engine.

Thomas, a tank engine, is not Thomas the Tank Engine.

Tom Scott · photography · video · education

One Reader Catches Every AI Article #shorts

One Reader Catches Every AI Article #shorts

Neil Patel · education · tests

Products we wish existed, mocked up with @AdobeFirefly #adobepartner

Products we wish existed, mocked up with @AdobeFirefly #adobepartner

Colin and Samir · education

DJI Pocket 4 & 4P ❌ USA

DJI Pocket 4 & 4P ❌ USA

Think Media · education

Inside Michelle Khare's Most Dangerous Video

Inside Michelle Khare's Most Dangerous Video

Colin and Samir · moments · video · education · scenes · truck

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

They Left The Tourist Trail: Kris Kremers and Lisanne Froon | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

Antique Steam Tractor Kills Five | Fascinating Horror

Antique Steam Tractor Kills Five | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · city · Country · video · Australia · education · true stories · stories

The Largest Biological Attack in US History | Fascinating Horror

The Largest Biological Attack in US History | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · city · Country · education · true stories · stories

AI Won the Content War and Lost the Traffic #shorts

AI Won the Content War and Lost the Traffic #shorts

Neil Patel · War · education

Baby Evie's in JAIL! 🚔 #PeppaPig #Shorts

Baby Evie's in JAIL! 🚔 #PeppaPig #Shorts

Peppa Pig - Official Channel · Adventure · Animation · Musical · Music · Games · cooking · Cartoon · moments · driving · cars · video · education · stories · Songs · Preschool · Learning · kids

Peppa Pig Paints The BIGGEST Picture in the World! 🎨 👩‍🎨 Peppa Pig Full Episodes | 1 Hour

Peppa Pig Paints The BIGGEST Picture in the World! 🎨 👩‍🎨 Peppa Pig Full Episodes | 1 Hour

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

Making my Skull BULLETPROOF with Real Life Adamantium!?

Making my Skull BULLETPROOF with Real Life Adamantium!?

Hacksmith Industries · Action · War · Superhero · Cinematic · Life · Tech · video · technology · tools · machines · science · Learning

The Road to 3 Million Views🚀

The Road to 3 Million Views🚀

IBM Technology · Tech · video · education · Learning

Some of the STRANGEST borders I've visited

Some of the STRANGEST borders I've visited

Geography Now · Comedy · History · Other · Country · education · Learning

Security Drones Debrief! (Exclusive Members Bonus Video 🎥)

Security Drones Debrief! (Exclusive Members Bonus Video 🎥)

Hacksmith Industries · Action · Tech · video · technology · tools · machines · security · science · Learning

Peppa Pig Tales 2026⏳Peppa Sees BABY Mummy & Daddy Pig! Secret Video❓BRAND NEW Peppa Pig Episodes

Peppa Pig Tales 2026⏳Peppa Sees BABY Mummy & Daddy Pig! Secret Video❓BRAND NEW Peppa Pig Episodes

Peppa Pig - Official Channel · Animation · Family · History · Music · Games · Compilations · Life · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

Don't Put It in Your Mouth | Baby Care & Home Safety | Kids Songs | BabyBus

Don't Put It in Your Mouth | Baby Care & Home Safety | Kids Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · cooking · Cartoon · cars · education · tips · Preschool Songs · Songs · Preschool · Cartoons · Learning · kids

Kid Became a Robot | Kids Learn to Be Responsible | Nursery Rhymes & Kids Songs | BabyBus

Kid Became a Robot | Kids Learn to Be Responsible | Nursery Rhymes & Kids Songs | BabyBus

BabyBus - Preschool Songs & Learning Cartoons · cooking · food · education · stories · Preschool Songs · Songs · Preschool · Cartoons · Learning · kids

Boat Picnic 🧺 #shorts #peppapig

Boat Picnic 🧺 #shorts #peppapig

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Cartoon · video · education · stories · Songs · Preschool · Learning · kids