Spotify runs hundreds of different experiments at any point of each day. As a result, they found this overwhelming enough to search for a new way of experimentation coordination.
They find comfort in an idea called Bucket Reuse.
Bucket Reuse is a simple idea utilizing the power of hashing. Essentially the steps are as follows: decide on a number of buckets (B).
At the end of the blog post, Spotify shares their new and complete experimentation coordination strategy, one that will hopefully benefit you as well.Read more...