Misadventures in experiments for growth

www.unofficialgoogledatascience.com

Large-scale live experimentation is a big part of online product development. In fact, this blog has published posts on this very topic. With the right experiment methodology, a product can make continuous improvements, as Google and others have done. But what works for established products may not work for a product that is still trying to find its audience. Many of the assumptions on which the "standard" experiment methodology is premised are not valid. This means a small and growing product has to use experimentation differently and very carefully. Indeed, failure to do so may cause experiments to mislead rather than guide. This blog post is about experimentation in this regime.

So good. I've been at the fledgeling company described in this post. Don't over-rely on experimentation before you have an established product!

Read more...
Linkedin

Want to receive more content like this in your inbox?