Yes that's about right :)
The book can contain a mixture if Notebooks and normal markdown files, and also text representations of notebook files (see
https://jupyterbook.org/content-types/myst-notebooks.html)
The initial focus has been HTML, but now there is work ongoing to create a nice LaTeX/PDF "theme"