⚪ NEOTLIX.SPACE — ਹਰ ਸਿਰਜਣਹਾਰ ਇੱਕ ਨਿਰਦੇਸ਼ਕ ਹੈ। ਹਰ ਪ੍ਰਸ਼ੰਸਕ ਇੱਕ ਭਵਿੱਖ ਦਾ ਸਿਤਾਰਾ! ⚪ ਕੋਈ ਵੀ ਕਿਸੇ ਵੀ ਵੀਡੀਓ ਵਿੱਚ ਅਭਿਨੈ ਕਰ ਸਕਦਾ ਹੈ ⚪ ਆਪਣਾ ਚਿਹਰਾ ਕਿਰਾਏ 'ਤੇ ਦਿਓ ⚪ ਆਪਣੀਆਂ ਵੀਡੀਓ ਤੋਂ ਕਮਾਓ ⚪ ਆਪਣੇ ਫ਼ਾਲੋਅਰਾਂ ਨੂੰ ਰਾਇਲਟੀ ਵਿੱਚ ਬਦਲੋ ⚪ ਦੇਖੋ ਇਹ ਕਿਵੇਂ ਕੰਮ ਕਰਦਾ ਹੈ ⚪

ਅਗਲਾ

Transformers, the tech behind LLMs | Deep Learning Chapter 5 Transformers, the tech behind LLMs | Deep Learning Chapter 5 28 ਮਿੰਟ Defunctland VR: 20,000 Leagues Under the Sea Defunctland VR: 20,000 Leagues Under the Sea 15 ਮਿੰਟ Why Sagrada Familia Took 144 Years to Complete Why Sagrada Familia Took 144 Years to Complete 25 ਮਿੰਟ Prohibition - OverSimplified Prohibition - OverSimplified 34 ਮਿੰਟ Archaeologists Found an Ancient Treasure Worth Millions in Belize Archaeologists Found an Ancient Treasure Worth Millions in Belize 95 ਮਿੰਟ DefunctTV: The History of Fetch! with Ruff Ruffman DefunctTV: The History of Fetch! with Ruff Ruffman 23 ਮਿੰਟ Why This Olympic Sport Bothers Physicists Why This Olympic Sport Bothers Physicists 17 ਮਿੰਟ The Biggest Aquarium Collapse in History | Fascinating Horror Shorts The Biggest Aquarium Collapse in History | Fascinating Horror Shorts 1 ਮਿੰਟ "Nobody Leaves Without Paying" - The Ycuá Bolaños Fire | Fascinating Horror "Nobody Leaves Without Paying" - The Ycuá Bolaños Fire | Fascinating Horror 12 ਮਿੰਟ The 28 pages of 9/11 intelligence that were in a secret vault | 60 Minutes Archive The 28 pages of 9/11 intelligence that were in a secret vault | 60 Minutes Archive 15 ਮਿੰਟ Ramayana: Jai Jai Ram (Song) | Namit M, Nitesh T | Ranbir, Yash | AR Rahman, Shreya, Arijit S, Kumar Ramayana: Jai Jai Ram (Song) | Namit M, Nitesh T | Ranbir, Yash | AR Rahman, Shreya, Arijit S, Kumar 3 ਮਿੰਟ He Forgot The Most Important Thing | Fascinating Horror Shorts He Forgot The Most Important Thing | Fascinating Horror Shorts 1 ਮਿੰਟ The Ohio State Penitentiary Fire | Fascinating Horror The Ohio State Penitentiary Fire | Fascinating Horror 12 ਮਿੰਟ How to explain something complicated How to explain something complicated 10 ਮਿੰਟ Why do Human Feet Wash up on This Beach? | Fascinating Horror Shorts Why do Human Feet Wash up on This Beach? | Fascinating Horror Shorts 1 ਮਿੰਟ He's Back Again He's Back Again 9 ਮਿੰਟ One Piece of News From Every Country in the World One Piece of News From Every Country in the World 43 ਮਿੰਟ Small details take Time Small details take Time 2 ਮਿੰਟ Luna Pro 4K Vertical Video Is a HUGE Upgrade! Luna Pro 4K Vertical Video Is a HUGE Upgrade! 1 ਮਿੰਟ Psychedelics, mind control, radiation-eating: The secret superpowers of fungi - Max G. Levy Psychedelics, mind control, radiation-eating: The secret superpowers of fungi - Max G. Levy 7 ਮਿੰਟ What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts 1 ਮਿੰਟ A dream come true... #batman #batmobile #dreamgarage A dream come true... #batman #batmobile #dreamgarage 1 ਮਿੰਟ How Tech Companies Lie to You. How Tech Companies Lie to You. 25 ਮਿੰਟ Every Creator Wants This Camera... Every Creator Wants This Camera... 11 ਮਿੰਟ How do you upgrade a lifelong Tech??? - AMD $5000 Ultimate Tech Upgrade How do you upgrade a lifelong Tech??? - AMD $5000 Ultimate Tech Upgrade 30 ਮਿੰਟ ORBITRON vs World's Most Destructive BATTLEBOTS (VIDEO #5/6) ORBITRON vs World's Most Destructive BATTLEBOTS (VIDEO #5/6) 25 ਮਿੰਟ What could this project be? 👀🥬 (Members' Update #46) What could this project be? 👀🥬 (Members' Update #46) 4 ਮਿੰਟ Mac vs Windows - It's not close in 2026! Mac vs Windows - It's not close in 2026! 22 ਮਿੰਟ Humanity’s Real Plan to Stop This Asteroid (Feat. Mark Rober) Humanity’s Real Plan to Stop This Asteroid (Feat. Mark Rober) 22 ਮਿੰਟ I Investigated India’s Biggest Smartphone Controversy I Investigated India’s Biggest Smartphone Controversy 42 ਮਿੰਟ Marathon - Sentinel Shell Cinematic Trailer | PS5 & PC Games Marathon - Sentinel Shell Cinematic Trailer | PS5 & PC Games 2 ਮਿੰਟ The Deepest Point in the World: Crash Course Geology #12 The Deepest Point in the World: Crash Course Geology #12 12 ਮਿੰਟ The Stinky Fish Sauce Ancient Romans Couldn’t Live Without The Stinky Fish Sauce Ancient Romans Couldn’t Live Without 14 ਮਿੰਟ Reading & Writing Latin American literature: Crash Course Latin American Literature #13 Reading & Writing Latin American literature: Crash Course Latin American Literature #13 11 ਮਿੰਟ How Taiwan is Preparing to Get Invaded How Taiwan is Preparing to Get Invaded 17 ਮਿੰਟ They’re lying to you They’re lying to you 2 ਮਿੰਟ Why can't your house cat roar? #shorts #science #SciShow Why can't your house cat roar? #shorts #science #SciShow 1 ਮਿੰਟ this might melt your brain this might melt your brain 2 ਮਿੰਟ What your language says about you What your language says about you 8 ਮਿੰਟ Are we all just players in the game of life? #shorts Are we all just players in the game of life? #shorts 1 ਮਿੰਟ The Second Punic War - OverSimplified (Part 1) The Second Punic War - OverSimplified (Part 1) 29 ਮਿੰਟ The New ChatGPT Playbook & Prompting Guide The New ChatGPT Playbook & Prompting Guide 39 ਮਿੰਟ Peppa Pig Tales 2026 🫣 Peppa Plays CAMOUFLAGE HIDE AND SEEK! 👀 BRAND NEW Peppa Pig Episodes Peppa Pig Tales 2026 🫣 Peppa Plays CAMOUFLAGE HIDE AND SEEK! 👀 BRAND NEW Peppa Pig Episodes 31 ਮਿੰਟ i didn't want to like this.... i didn't want to like this.... 18 ਮਿੰਟ FULL METAL ALCHEMY (ft. Sir Isaac Newton) FULL METAL ALCHEMY (ft. Sir Isaac Newton) 1 ਮਿੰਟ We Made a Knife that can CUT THROUGH ANYTHING! We Made a Knife that can CUT THROUGH ANYTHING! 7 ਮਿੰਟ AI News: An INSANE Week… Here’s What Matters AI News: An INSANE Week… Here’s What Matters 31 ਮਿੰਟ The drawing took five minutes. The build did not. #engineering # #3dprinting #building #partner The drawing took five minutes. The build did not. #engineering # #3dprinting #building #partner 1 ਮਿੰਟ Peppa Pig Plays CHEESE HOLE IN THE WALL!🧀 BRAND NEW Peppa Pig Tales Full Episodes | 35 Mins Peppa Pig Plays CHEESE HOLE IN THE WALL!🧀 BRAND NEW Peppa Pig Tales Full Episodes | 35 Mins 36 ਮਿੰਟ I almost quit YouTube.... I almost quit YouTube.... 24 ਮਿੰਟ Why You Don’t Trust Tap Water Why You Don’t Trust Tap Water 27 ਮਿੰਟ

Transformers, the tech behind LLMs | Deep Learning Chapter 5

2024 28 ਮਿੰਟ

Breaking down how Large Language Models work, visualizing how data flows through. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support --- Here are a few other relevant resources Build a GPT from scratch, by Andrej Karpathy https://youtu.be/kCc8FmEb1nY If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic: https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources. https://transformer-circuits.pub/2021/framework/index.html History of language models by Brit Cruise, @ArtOfTheProblem https://youtu.be/OFS90-FX6pg An early paper on how directions in embedding spaces have meaning: https://arxiv.org/pdf/1301.3781.pdf Звуковая дорожка на русском языке: Влад Бурмистров. --- Timestamps 0:00 - Predict, sample, repeat 3:03 - Inside a transformer 6:36 - Chapter layout 7:20 - The premise of Deep Learning 12:27 - Word embeddings 18:25 - Embeddings beyond words 20:22 - Unembedding 22:22 - Softmax with temperature 26:03 - Up next

ਦੇਸ਼

ਸੰਯੁਕਤ ਰਾਜ (ਅਮਰੀਕਾ)

Work with this creator

Packages published by the creator behind this video.

All packages

This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.

Monthly participation

per month

A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.

Price on request

Sign in to request

Guaranteed placement — new video

one-off

A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.

Price on request

  • First 1–3 minutes
  • Middle of the video
  • End of the video
Sign in to request

Guaranteed placement — Short

one-off

A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.

Price on request

Sign in to request

ਇਸ ਵਰਗੇ ਹੋਰ

Defunctland VR: 20,000 Leagues Under the Sea

Defunctland VR: 20,000 Leagues Under the Sea

Defunctland · History · Other · CGI · education

Why Sagrada Familia Took 144 Years to Complete

Why Sagrada Familia Took 144 Years to Complete

Real Engineering · History · Music · video · technology · science · education

Prohibition - OverSimplified

Prohibition - OverSimplified

OverSimplified · History · Music · Other · creative · education

Archaeologists Found an Ancient Treasure Worth Millions in Belize

Archaeologists Found an Ancient Treasure Worth Millions in Belize

BRIGHT SIDE · Animation · Action · Mystery · History · Music · Other · video · discoveries

DefunctTV: The History of Fetch! with Ruff Ruffman

DefunctTV: The History of Fetch! with Ruff Ruffman

Defunctland · History · education · kids

Why This Olympic Sport Bothers Physicists

Why This Olympic Sport Bothers Physicists

Cleo Abram · Mystery · Sport · History · Music · CGI · daily · Tech · video · technology · science

The Biggest Aquarium Collapse in History | Fascinating Horror Shorts

The Biggest Aquarium Collapse in History | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

"Nobody Leaves Without Paying" - The Ycuá Bolaños Fire | Fascinating Horror

"Nobody Leaves Without Paying" - The Ycuá Bolaños Fire | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · Crime · History · Music · Other · daily · education · true stories · stories

The 28 pages of 9/11 intelligence that were in a secret vault | 60 Minutes Archive

The 28 pages of 9/11 intelligence that were in a secret vault | 60 Minutes Archive

60 Minutes · History · Interviews · video · reports

Ramayana: Jai Jai Ram (Song) | Namit M, Nitesh T | Ranbir, Yash | AR Rahman, Shreya, Arijit S, Kumar

Ramayana: Jai Jai Ram (Song) | Namit M, Nitesh T | Ranbir, Yash | AR Rahman, Shreya, Arijit S, Kumar

T-Series · History · Music · T-Series · Music Label · Songs

He Forgot The Most Important Thing | Fascinating Horror Shorts

He Forgot The Most Important Thing | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · moments · education · true stories · stories

The Ohio State Penitentiary Fire | Fascinating Horror

The Ohio State Penitentiary Fire | Fascinating Horror

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · daily · education · true stories · stories

How to explain something complicated

How to explain something complicated

TED-Ed · Animation · Other · video · education · tips · Learning

Why do Human Feet Wash up on This Beach? | Fascinating Horror Shorts

Why do Human Feet Wash up on This Beach? | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

He's Back Again

He's Back Again

penguinz0 · Other

One Piece of News From Every Country in the World

One Piece of News From Every Country in the World

Wendover Productions · Animation · Other · Country · education

Small details take Time

Small details take Time

colinfurze · Other

Luna Pro 4K Vertical Video Is a HUGE Upgrade!

Luna Pro 4K Vertical Video Is a HUGE Upgrade!

Think Media · Music · Other · video · education

Psychedelics, mind control, radiation-eating: The secret superpowers of fungi - Max G. Levy

Psychedelics, mind control, radiation-eating: The secret superpowers of fungi - Max G. Levy

TED-Ed · Animation · Other · video · science · education · Learning

What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts

What if Your Hand Didn't Belong to You? | Fascinating Horror Shorts

Fascinating Horror · Horror · Documentary · Mystery · History · Music · Other · education · true stories · stories

A dream come true... #batman #batmobile #dreamgarage

A dream come true... #batman #batmobile #dreamgarage

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

How Tech Companies Lie to You.

How Tech Companies Lie to You.

Mrwhosetheboss · Music · Tech · technology · science

Every Creator Wants This Camera...

Every Creator Wants This Camera...

Unbox Therapy · Updates · Tech · video · technology · science · gadgets

How do you upgrade a lifelong Tech??? - AMD $5000 Ultimate Tech Upgrade

How do you upgrade a lifelong Tech??? - AMD $5000 Ultimate Tech Upgrade

Linus Tech Tips · Cyberpunk · Gaming · car · kit · Tech · technology · tools · science · tips

ORBITRON vs World's Most Destructive BATTLEBOTS (VIDEO #5/6)

ORBITRON vs World's Most Destructive BATTLEBOTS (VIDEO #5/6)

Hacksmith Industries · Action · Other · Updates · Tech · video · technology · tools · machines · science · Learning

What could this project be? 👀🥬 (Members' Update #46)

What could this project be? 👀🥬 (Members' Update #46)

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

Mac vs Windows - It's not close in 2026!

Mac vs Windows - It's not close in 2026!

Mrwhosetheboss · Music · Gaming · Tech · technology · science

Humanity’s Real Plan to Stop This Asteroid (Feat. Mark Rober)

Humanity’s Real Plan to Stop This Asteroid (Feat. Mark Rober)

Cleo Abram · Documentary · Music · daily · Tech · video · technology · science

I Investigated India’s Biggest Smartphone Controversy

I Investigated India’s Biggest Smartphone Controversy

Mrwhosetheboss · Music · Tech · technology · science · India

Marathon - Sentinel Shell Cinematic Trailer | PS5 & PC Games

Marathon - Sentinel Shell Cinematic Trailer | PS5 & PC Games

PlayStation · PlayStation · Games · Gameplay · Cinematic · Trailer · Gaming · survival · Tech · video · weapons

The Deepest Point in the World: Crash Course Geology #12

The Deepest Point in the World: Crash Course Geology #12

CrashCourse · Life · science · education · kids

The Stinky Fish Sauce Ancient Romans Couldn’t Live Without

The Stinky Fish Sauce Ancient Romans Couldn’t Live Without

SciShow · recipes · science · education · Learning

Reading & Writing Latin American literature: Crash Course Latin American Literature #13

Reading & Writing Latin American literature: Crash Course Latin American Literature #13

CrashCourse · education · kids

How Taiwan is Preparing to Get Invaded

How Taiwan is Preparing to Get Invaded

Wendover Productions · Animation · Other · video · education

They’re lying to you

They’re lying to you

AsapSCIENCE · education

Why can't your house cat roar? #shorts #science #SciShow

Why can't your house cat roar? #shorts #science #SciShow

SciShow · video · relaxing · science · education

this might melt your brain

this might melt your brain

AsapSCIENCE · education

What your language says about you

What your language says about you

AsapSCIENCE · science · education · psychology

Are we all just players in the game of life? #shorts

Are we all just players in the game of life? #shorts

TED-Ed · Animation · Life · education

The Second Punic War - OverSimplified (Part 1)

The Second Punic War - OverSimplified (Part 1)

OverSimplified · Adventure · War · History · Music · Other · creative · education

The New ChatGPT Playbook & Prompting Guide

The New ChatGPT Playbook & Prompting Guide

Matt Wolfe · Walk · city · video · technology · tools · science · Learning

Peppa Pig Tales 2026 🫣 Peppa Plays CAMOUFLAGE HIDE AND SEEK! 👀 BRAND NEW Peppa Pig Episodes

Peppa Pig Tales 2026 🫣 Peppa Plays CAMOUFLAGE HIDE AND SEEK! 👀 BRAND NEW Peppa Pig Episodes

Peppa Pig - Official Channel · Animation · Family · Music · Games · Compilations · Life · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

i didn't want to like this....

i didn't want to like this....

NetworkChuck · Games · Gaming · japan · video · technology · tools · science · Learning · kids

FULL METAL ALCHEMY (ft. Sir Isaac Newton)

FULL METAL ALCHEMY (ft. Sir Isaac Newton)

SciShow · History · Life · science · education · Learning

We Made a Knife that can CUT THROUGH ANYTHING!

We Made a Knife that can CUT THROUGH ANYTHING!

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

AI News: An INSANE Week… Here’s What Matters

AI News: An INSANE Week… Here’s What Matters

Matt Wolfe · Updates · video · technology · tools · security · science · Learning

The drawing took five minutes. The build did not. #engineering # #3dprinting #building #partner

The drawing took five minutes. The build did not. #engineering # #3dprinting #building #partner

Hacksmith Industries · Action · Tech · video · technology · tools · machines · science · Learning

Peppa Pig Plays CHEESE HOLE IN THE WALL!🧀 BRAND NEW Peppa Pig Tales Full Episodes | 35 Mins

Peppa Pig Plays CHEESE HOLE IN THE WALL!🧀 BRAND NEW Peppa Pig Tales Full Episodes | 35 Mins

Peppa Pig - Official Channel · Animation · Family · Music · Other · Games · Compilations · Life · Cartoon · video · education · stories · Songs · Preschool · Learning · kids

I almost quit YouTube....

I almost quit YouTube....

NetworkChuck · japan · Tech · video · technology · security · science · Learning

Why You Don’t Trust Tap Water

Why You Don’t Trust Tap Water

Johnny Harris · Music · Cinematic · Life · video · reports · education · stories · Learning