undefined | Better HN

0 pointssiquick26d ago0 comments

Rent a H100 on Modal which scales down to zero when not in use - you can set the time out period.

Cold boot times are around 5m but if your usage periods are predictable it can work out ok. Works out at $2 an hour.

Still far more expensive than a ChatGPT sub.

0 comments

Do you have some reference on what setup you're talking about? I'd like to integrate it into my IDE (cursor/vscode) - are there docs on such a setup?

siquickOP26d ago

Start here

or give this a go

You get $30 free credits each month on Modal which is enough to play around (i have no affiliation, just think they run a great service)

j / k navigate · click thread line to collapse