mistercheese

At my past few companies, there has been heavy investment into live A/B tests on the customer population. However, for bigger companies that have more exposure, I have a worry that we may not be able to have the proper ways to measure the real cost of an A/B test that may 1) Have negative PR or branding effects 2) Conflict with the objectives of other features.<p>Sure we can measure customer drop off or engagement, but given the number of tests and projects at any given time, there are too many confounding factors to isolate those measures to a particular test. I'd love to hear from Hackernews suggestions! Thanks!