Επόμενο
But how do AI images and videos actually work? | Guest video by Welch Labs 38 λεπ 
Sea Wall 10 λεπ 
(VR) Я ❤️ Работу | Часть 2 (Job Simulator) 17 λεπ 
Dark Secrets Hidden in America’s Most Isolated Islands (nobody comes here) 39 λεπ 
I bought the most CURSED TECH on the internet ft. KSI 25 λεπ 
Игра Без Сохранений 2 (Мото VLOG) 58 λεπ 
Заперт с Монстром 🤣 | Murky Divers 17 λεπ 
Are you one of the lucky 50% that experience it? 2 λεπ 
How Tech Companies Lie to You. 25 λεπ 
How Earthquake Bearings Work 19 λεπ 
4,000,000 - Q&A 11 λεπ 
I Sent My Lookalike On NATIONAL News 15 λεπ 
My Thoughts on Resident Evil Movie 19 λεπ 
Is there a Priest Hole in Your House? | Fascinating Horror Shorts 1 λεπ 
The Macklemore controversy rocking Ed Sheeran’s tour 3 λεπ 
Members have a think about this DOOR? 7 λεπ 
One Piece of News From Every Country in the World 43 λεπ 
Scary Cat in the Hat Trend Causing Panic 10 λεπ 
Epic underground garage final dig complete 1 λεπ 
Man Renovates 2-Story Old House And Gives It A New Life | Start To Finish By @officialnuera1 15 λεπ 
Practical Magic (1998) - Sally Finds Her Perfect Man (7/11) | Movieclips 3 λεπ 
Practical Magic (1998) - The Exorcism of Nicole Kidman! (10/11) | Movieclips 6 λεπ 
Name That Infrastructure (Ep. 1) #shorts 1 λεπ 
The Weirdest Tool in Underwater Construction 18 λεπ 
Name That Infrastructure (Ep. 12) #shorts 1 λεπ 
Name That Infrastructure (Ep. 13) #shorts 1 λεπ 
This Spillway Failed On Purpose 20 λεπ 
How a broken heart affects your body 6 λεπ 
My Take on The New Apple 12 λεπ 
The Surprisingly Large Carbon Footprint of Rice #science #scishow #rice #climatechange 1 λεπ 
Why This Robot Kills Weeds With Lasers 15 λεπ 
Cancelled - American Heartland Theme Park 20 λεπ 
Unhinged Lady Ran for Senate and Got Arrested for Wild Behavior 21 λεπ 
How Do We Chart Missing Rivers? Ask Fish! #science #scishow #geography #newzealand 1 λεπ 
What Made The Bahamas’s “Atlantis” Rocks? 1 λεπ 
Earthquake Resistant Buildings 2 λεπ 
The Insane Engineering of the P-38 Lightning 27 λεπ 
Reading StarCloud’s Whitepaper So You Don’t Have To 22 λεπ 
Do you see the problem?! 1 λεπ 
How Airlines Decide Which Plane to Use 22 λεπ 
Prohibition - OverSimplified 34 λεπ 
The Cruise Industry's Arms Race 18 λεπ 
Sawing a Dam in Half (on Purpose) 21 λεπ 
I Made a Crazy Co-op Game IN REAL LIFE! #gaming #tabletopgaming #ChatGPT_Partner #ad @OpenAI 2 λεπ 
How billionaires buy American elections 45 λεπ 
Julia Roberts Discovers Dolce Far Niente | Eat Pray Love 3 λεπ 
Geography Now! KOSOVO 23 λεπ 
Peppa Pig Plays CHEESE HOLE IN THE WALL!🧀 BRAND NEW Peppa Pig Tales Full Episodes | 35 Mins 36 λεπ 
Why avalanches are most deadly when they stop - Simon Trautman 6 λεπ 
AI News: These Google Updates Are Dividing People 45 λεπ 
Dinosaurs Were Weirder Than We Thought 21 λεπ Diffusion models, CLIP, and the math of turning text into images Welch Labs Book: https://www.welchlabs.com/resources/imaginary-numbers-book Sections 0:00 - Intro 3:37 - CLIP 6:25 - Shared Embedding Space 8:16 - Diffusion Models & DDPM 11:44 - Learning Vector Fields 22:00 - DDIM 25:25 - Dall E 2 26:37 - Conditioning 30:02 - Guidance 33:39 - Negative Prompts 34:27 - Outro 35:32 - About guest videos Special Thanks to: Jonathan Ho - Jonathan is the Author of the DDPM paper and the Classifier Free Guidance Paper. https://arxiv.org/pdf/2006.11239 https://arxiv.org/pdf/2207.12598 Preetum Nakkiran - Preetum has an excellent introductory diffusion tutorial: https://arxiv.org/pdf/2406.08929 Chenyang Yuan - Many of the animations in this video were implemented using manim and Chenyang’s smalldiffusion library: https://github.com/yuanchenyang/smalldiffusion Cheyang also has a terrific tutorial and MIT course on diffusion models https://www.chenyang.co/diffusion.html https://www.practical-diffusion.org/ Other References All of Sander Dieleman’s diffusion blog posts are fantastic: https://sander.ai/ CLIP Paper: https://arxiv.org/pdf/2103.00020 DDIM Paper: https://arxiv.org/pdf/2010.02502 Score-Based Generative Modeling: https://arxiv.org/pdf/2011.13456 Wan2.1: https://github.com/Wan-Video/Wan2.1 Stable Diffusion: https://huggingface.co/stabilityai/stable-diffusion-2 Midjourney: https://www.midjourney.com/ Veo: https://deepmind.google/models/veo/ DallE 2 paper: https://cdn.openai.com/papers/dall-e-2.pdf Code for this video: https://github.com/stephencwelch/manim_videos/tree/master/_2025/sora Written by: Stephen Welch, with very helpful feedback from Grant Sanderson Produced by: Stephen Welch, Sam Baskin, and Pranav Gundu Technical Notes The noise videos in the opening have been passed through a VAE (actually, diffusion process happens in a compressed “latent” space), which acts very much like a video compressor - this is why the noise videos don’t look like pure salt and pepper. 6:15 CLIP: Although directly minimizing cosine similarity would push our vectors 180 degrees apart on a single batch, overall in practice, we need CLIP to maximize the uniformity of concepts over the hypersphere it's operating on. For this reason, we animated these vectors as orthogonal-ish. See: https://proceedings.mlr.press/v119/wang20k/wang20k.pdf Per Chenyang Yuan: at 10:15, the blurry image that results when removing random noise in DDPM is probably due to a mismatch in noise levels when calling the denoiser. When the denoiser is called on x_{t-1} during DDPM sampling, it is expected to have a certain noise level (let's call it sigma_{t-1}). If you generate x_{t-1} from x_t without adding noise, then the noise present in x_{t-1} is always smaller than sigma_{t-1}. This causes the denoiser to remove too much noise, thus pointing towards the mean of the dataset. The text conditioning input to stable diffusion is not the 512-dim text embedding vector, but the output of the layer before that, [with dimension 77x512](https://stackoverflow.com/a/79243065) For the vectors at 31:40 - Some implementations use f(x, t, cat) + alpha(f(x, t, cat) - f(x, t)), and some that do f(x, t) + alpha(f(x, t, cat) - f(x, t)), where an alpha value of 1 corresponds to no guidance. I chose the second format here to keep things simpler. At 30:30, the unconditional t=1 vector field looks a bit different from what it did at the 17:15 mark. This is the result of different models trained for different parts of the video, and likely a result of different random initializations. Premium Beat Music ID: EEDYZ3FP44YX8OWT
Χώρα
Ηνωμένες Πολιτείες
Packages published by the creator behind this video.
This creator has not set their rates yet. Send a request and we will pass it on — the price is agreed before anything is charged.
A recurring seat in my content. Subscribers enter a queue — or a random draw when there are more subscribers than slots — and appear in the video itself, in the credits, or in the description.
per month
Price on request
A guaranteed appearance of at least 10 seconds in my next video. Price depends on where in the runtime the insert lands.
Price on request
A guaranteed appearance of at least 10 seconds inside a Short cut from one of my existing videos.
one-off
Price on request