Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions 02-reverse-process/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ In the forward process, at each timestep, we progressively added noise to the im

Of course, because the noise added at step is random, there is no way to deterministically recover the actual image. Instead, we'll train a model to approximate the noise at timestep $t$, given image $x_t$.

Assuming we have some model that can predict this, our training objective now becomings minimizing the Kullback–Leibler divergence [[1]](wikipedia2023kullbackleiblerdivergence) between our predictions and the ground truth. Or in simpler terms, we want to minimize the surprise from predictions from our model, compared to the actual distribution:
Assuming we have some model that can predict this, our training objective now becomings minimizing the Kullback–Leibler divergence [[1]](#wikipedia2023kullbackleiblerdivergence) between our predictions and the ground truth. Or in simpler terms, we want to minimize the surprise from predictions from our model, compared to the actual distribution:

$$
\Huge
Expand All @@ -31,7 +31,7 @@ $$
We now have the basic training loop:

1. Sample image $x_0$ from our dataset
2. Sample timetep $t$ from Uniform$(1, \cdots, T)$
2. Sample timetep $t$ from Uniform$`(1, \cdots, T)`$
3. Sample Gaussian noise $\epsilon$ from $\mathcal{N}(0, 1)$
4. Compute our noised image $x_t$ using $x_0$, $t$, $\epsilon$
5. Predict noise $\epsilon_{\theta}$ from our model, given $(x_t, t)$
Expand Down