If I may ask, and if you use Lambda Labs cloud GCP, how do you like it? I have visited their pricing page about ten times, their price for a single A100 is very good, but I haven’t talked to any customers. Do you basically get VPS with a GPU and all the usually software installed, and SSH/Mosh into it?
Yeah I found Lambda super easy to use, especially compared to GCP etc. It took me about 5 minutes to get a model up and running. They don't support launching machines with docker images or kubernetes or anything like that though (problem if you want to run a business on it) and recently they are extremely supply constrained (only available machine type 8xA100, no A6000s or V100s).