undefined | Better HN

0 pointswahnfrieden8y ago0 comments

The other key component of serverless is the pricing scheme: pay for what you use; don’t pay for provisioned capacity. This has a huge impact on how you design systems as you no longer have to consider throughput (besides account limitations that you can raise without cost), only latency. You can even treat lambda like an async queue which will never accumulate a backlog.

Interestingly lambda seems to make async IO technologies like nodejs less compelling, because throughput capacity isn’t really relevant anymore.

0 comments

8 comments · 3 top-level

rdsubhas8y ago· 3 in thread

> The other key component of serverless is the pricing scheme: pay for what you use; don’t pay for provisioned capacity.

There is another way of looking at it: Pay for a percentage of the traffic, irrespective of how fast your application runs or what your budget is. If you reach your monthly budget because of one hacker news trending article, yeah, then no more traffic for you. It can be insane.

If I have autoscaling with an upper bound, I can stay within a fixed budget per month. If I reach my budget, yeah no more new servers, but whatever running keeps running. My business doesn't disappear, I get business continuity. Paying based on % of traffic sounds insane. How will I plan for business continuity if my monthly budget is reached with this kind of model? (without any "minimum xx requests" kind of crap free tier, business continuity means fixed upper bound AND continuing service, not OR)

wahnfriedenOP8y ago

You’re looking for throttling which you can do with Lambda/API Gateway.

If you don’t have spikiness in your traffic and provisioning for peak capacity is affordable and simple, then serverless is a bit less compelling.

icebraining8y ago

I don't know if platforms already support it, but there's no reason why you can't have a throttle (calls/minute).

alpha_squared8y ago

I can't speak for all serverless platforms, but AWS API Gateway does support throttling and burst throttling[0].

[0] http://docs.aws.amazon.com/apigateway/latest/developerguide/...

k__8y ago· 1 in thread

What are good alternatives to nodejs that are better suited for this kind of architecture?

wahnfriedenOP8y ago

It’s more that you’re dealing with a different set of constraints on which to evaluate technologies. There’s not an overall better suited technology than nodejs - still good reasons to use it on Lambda.

To make the most of Lambda though you’ll want something that affords small code size (as there’s a 50MB limit), and has fast single execution latency.

bpicolo8y ago· 1 in thread

Which will never accumulate a backlog because it is happy to kill your task. ;)

wahnfriedenOP8y ago

Still need to use a dead letter queue, yes :)

j / k navigate · click thread line to collapse

0 comments

8 comments · 3 top-level

rdsubhas8y ago· 3 in thread

> The other key component of serverless is the pricing scheme: pay for what you use; don’t pay for provisioned capacity.

wahnfriedenOP8y ago

You’re looking for throttling which you can do with Lambda/API Gateway.

If you don’t have spikiness in your traffic and provisioning for peak capacity is affordable and simple, then serverless is a bit less compelling.

icebraining8y ago

I don't know if platforms already support it, but there's no reason why you can't have a throttle (calls/minute).

alpha_squared8y ago

I can't speak for all serverless platforms, but AWS API Gateway does support throttling and burst throttling[0].

[0] http://docs.aws.amazon.com/apigateway/latest/developerguide/...

k__8y ago· 1 in thread

What are good alternatives to nodejs that are better suited for this kind of architecture?

wahnfriedenOP8y ago

To make the most of Lambda though you’ll want something that affords small code size (as there’s a 50MB limit), and has fast single execution latency.

bpicolo8y ago· 1 in thread

Which will never accumulate a backlog because it is happy to kill your task. ;)

wahnfriedenOP8y ago

Still need to use a dead letter queue, yes :)

j / k navigate · click thread line to collapse