hassy

Hiya HN! tldr: Artillery is an open-source load testing toolkit. It's cloud-native, i.e. you can scale out your test with AWS Lambda (other runtimes coming soon). There's no infra to set up or manage - you give Artillery an AWS account, and it takes care of the rest.

We just released an update which includes cost reporting. Every time you run a load test, Artillery will show how much that cost in AWS Lambda fees.

Blog post with a demo here: https://www.artillery.io/blog/this-load-test-cost-us-how-much

The demo shows a distributed load test running in us-east-1 at 100k+ RPS for about 10 minutes. Total cost is $1.23.

We constantly hear from our users how cost is one of the biggest barriers to load testing more frequently. We're making cost much less of a factor with Artillery, and hoping that will unlock load testing at scale to more teams.

Would love to hear what the biggest barriers are for you with load testing!

Hassy & team Artillery

Hiya HN!

Just released Artillery Probe - a Swiss army knife for testing HTTP from the CLI. Think mini-curl with better UX for common use-cases, plus a couple of extra features.

Would love for you to try it and give some feedback!

https://www.artillery.io/blog/swiss-army-knife-for-http-testing

and:

  npm install artillery@latest

What does it do?

- First of all, it's a HTTP client! It does all the usual stuff you'd expect from a HTTP client... HTTP methods, request bodies, custom headers, forms, Basic Auth etc.

- Got some JSON or XML back? It'll pretty-print it, and syntax highlight it for you.

- It'll show you request waterfalls like this one: (inspired by httpstat)

   DNS Lookup | TCP Connection | SSL Handshake | Time to First Byte | Content Transfer
    56ms      |  14ms          |     19ms      |     181ms          |   88ms          |
              |                |               |                    |                 |
              56ms             |               |                    |                 |
                            70ms               |                    |                 |
                                             89ms                   |                 |
                                                                  270ms               |
                                                                                 total:358ms

- JSON responses can be queried and sliced and diced with JMESPath (same syntax as AWS CLI) - no need to reach for jq. XML & HTML may be queried with a jQuery-like syntax too.

- You can set expectations on the response, e.g. have the CLI check that the response is a 200, or that a certain header is set, and exit with non-zero code if not. Super handy for quick acceptance testing.

We've got lots of ideas for improvements, but would love to hear what you think!

Hi HN fam! Hassy from Artillery (YC S21) here. Playwright got a lot of love on HN today [1] - rightfully so, it's an incredible project! - so I thought I'd resubmit [2] an open-source project that lets you run load tests with existing Playwright scripts.

GitHub link: https://github.com/artilleryio/artillery-engine-playwright

The basic motivation for creating the project is that load testing complex web apps is a real pain in the ass. It takes ages to build out test scripts for a non-trivial web app with traditional API-oriented tools. If you've ever had to do it, you know how frustrating it can be.

So we thought, why not try load testing with real browsers instead? Especially if we can just reuse existing E2E testing scripts we already have? (based on Playwright of course!) Turns out it can work very well.

Is load testing with real browsers expensive? Yes, sort of - relative to more traditional load testing. This project lets you max out developer productivity points at the cost of... well, cost. But! developer time is expensive! And cloud compute is cheap - running 1,000 4 vCPU/12GB RAM containers on AWS Fargate for an entire hour is going to cost ~$220 in Fargate fees for example.

The project is still in its early days, would love any feedback! <3

1. https://news.ycombinator.com/item?id=30083042 2. https://news.ycombinator.com/item?id=29402399