I have a similar setup, I use Caprover as a nicer way to manage docker. You can build whatever you want into the dockerfile then just map the user directory to a local one and port forward where needed.

If you want to run a web app through a domain with SSL then it's trivial to setup a nginx proxy container.

It takes minutes to spin up a new dev environment with everything setup out of the box including environment variables and access tokens.