Programatically Understand Gaussian Processes: Part 1 (opens in new tab)

(nipunbatra.github.io)

50 pointsnipun_batra6y ago4 comments

4 comments

There's also "A Visual Exploration of Gaussian processes".

https://distill.pub/2019/visual-exploration-gaussian-process...

Everything from distill.pub is great.

I agree that distill.pub is great and so is the article you've mentioned. I did seek inspiration from the linked article amongst many others.

mcphage6y ago

I'm kinda confused by the graphs like this: https://nipunbatra.github.io/blog/2019/20d-conditional.gif

I would expect the graphs to curve (somewhat) smoothly between the 3rd and 4th known points, but instead the 4th point shows up as this weird discontinuity—the graphs are far above it, and then spike down to the 4th point only very close to that point. Why is that? The result doesn't seem (to my untrained eyes) to be very satisfactory.

nipun_batraOP6y ago

Good questions. A few quick thoughts. These may not be enough though!

First, the mean function specified in the prior is zero for all the points. Thus, points would have a high density near zero.

I have a strong hunch that choosing a "smoother" kernel would not lead to this discontinuity.

j / k navigate · click thread line to collapse

4 comments

ovi2566y ago

There's also "A Visual Exploration of Gaussian processes".

https://distill.pub/2019/visual-exploration-gaussian-process...

Everything from distill.pub is great.

nipun_batraOP6y ago

I agree that distill.pub is great and so is the article you've mentioned. I did seek inspiration from the linked article amongst many others.

mcphage6y ago

I'm kinda confused by the graphs like this: https://nipunbatra.github.io/blog/2019/20d-conditional.gif

nipun_batraOP6y ago

Good questions. A few quick thoughts. These may not be enough though!

First, the mean function specified in the prior is zero for all the points. Thus, points would have a high density near zero.

I have a strong hunch that choosing a "smoother" kernel would not lead to this discontinuity.

j / k navigate · click thread line to collapse