coif

I'm toying with the idea of GPU rentals for LLMs and need some guidance. While I do not plan on processing any PII or HIPAA-related data, I intend to run proprietary corporate information. It's crucial for me to ensure that my data remains private and isn't stored or leaked in any way.

From my initial understanding, you can get dedicated instances with AWS or other major cloud platforms, but they can get pricey. I've come across some offers like renting an A100 for just $2/hr. However, I'm unsure how isolated or secure these services are.

One of the alternatives I've come across is using spot instances of GPU compute. But again, there's the concern of these being "as available" and not necessarily isolated. Plus, even though they might appear cost-effective at first, they can add up.

Could anyone share experiences or insights on:

1) Understanding how GPU rental services work in terms of data privacy.

2) Recommendations for affordable yet secure GPU rental options?

3) Insights on the safety and isolation of services that offer GPUs at seemingly competitive rates?

Thanks in advance.