Suggest a low-end hosting provider with GPU

6 pointsbackend-dev-331y ago1 comments

I want to do zero-shot text classification with this model [1] or with something similar (Size of the model: 711 MB "model.safetensors" file, 1.42 GB "model.onnx" file ) It works on my dev machine with 4GB GPU. Probably will work on 2GB GPU too.

Is there some hosting provider for this?

My app is doing batch processing, so I will need access to this model few times per day. Something like this: start processing do some text classification stop processing Imagine I will do this procedure... 3 times per day. I don't need this model the rest of the time. Probably can start/stop some machine per API to save costs...

[1] https://huggingface.co/MoritzLaurer/roberta-large-zeroshot-v2.0-c

1 comments

backend-dev-33OP1y ago

I was just told about this thing: https://aws.amazon.com/ec2/instance-types/g4/

one NVIDIA T4 GPU, 16 GB RAM, and, this is an EC2 instance, it means "install anything" all this for $0.526 /Hour

do you see any hidden gotchas?

j / k navigate · click thread line to collapse