They explicitly say something harder than eigenvectors in the GP.

I was imagining something involving the spectral theorem or something like that, ie. beyond the most basic linear algebra.

OPs guide seems to cover plenty of things I'd expect someone to learn in undergrad, I think I touched on almost all of this - except for stuff involving jax and recent CNN architectures, both of which can easily be supplemented online.