undefined | Better HN

0 pointsa123b456c5y ago0 comments

Or something else changed at the same time. Hard to know without a control group.

0 comments

We did a randomised A/B test.

To ensure it wasn't some other wierd effect, we also fixed the bug and then deliberately re-added the same error message.

This bug was worth 15% of our revenue, so we did a lot of tests and trials...

Do you know what an A/B test is? It has a control group by design.

j / k navigate · click thread line to collapse

We did a randomised A/B test.

To ensure it wasn't some other wierd effect, we also fixed the bug and then deliberately re-added the same error message.

This bug was worth 15% of our revenue, so we did a lot of tests and trials...

Do you know what an A/B test is? It has a control group by design.

j / k navigate · click thread line to collapse