undefined | Better HN

0 pointschinchilla20202y ago0 comments

How long does a snowflake machine take to spin up? Why have an idle time at all?

I have never used snowflake so I'm not sure how this works.

0 comments

Their virtual warehouses usually take only a few seconds to spin up, but can take longer (especially for large warehouses).

If you keep the warehouse running, there's a fair amount of caching going on behind the scenes that can make your queries run faster on the warm warehouse (how much faster depends on the query) . This article shows one example - a cold query ran in 20 seconds, after caching it ran in 1.2 seconds on a warm warehouse:

https://community.snowflake.com/s/article/Caching-in-the-Sno...

So you don't always want to set the idle shutoff time to the minimum.

fbdab1032y ago

There are probably other use cases, but I only think of data warehouses for supporting batch/analytical workloads where latency is not a problem because the entire job takes minutes/hours to complete. In which case cold start does not significant.

Johnny5552y ago

Analysts and other data consumers don't want to wait 30 seconds for cache warming every time they refresh their dashboard.

Also, since you're paying by the second, it can be cheaper to keep a warehouse running longer to avoid having to re-warm the cache with every query.

j / k navigate · click thread line to collapse

0 comments

Johnny5552y ago

Their virtual warehouses usually take only a few seconds to spin up, but can take longer (especially for large warehouses).

https://community.snowflake.com/s/article/Caching-in-the-Sno...

So you don't always want to set the idle shutoff time to the minimum.

fbdab1032y ago

Johnny5552y ago

Analysts and other data consumers don't want to wait 30 seconds for cache warming every time they refresh their dashboard.

Also, since you're paying by the second, it can be cheaper to keep a warehouse running longer to avoid having to re-warm the cache with every query.

j / k navigate · click thread line to collapse