Working on https://flakiness.io: GitHub-native test analytics. I worked on Playwright before, and this project started as a natural continuation of that work. We’ve since expanded beyond Playwright to support many popular test runners.

The idea is to connect test results and artifacts with commit history. Test reports should know whether a failure is new, whether a test has been flaky before, and which commit made a test start running 5x slower.

If you maintain an open-source GitHub project with tests, please give it a try. The free plan is a good fit for OSS projects: 1GB of storage is enough for roughly 10M+ test results.