ACE reports are now one of the many reports you can run from the Campaigns tab (or through the API!). When you run a report segmented by “Experiment,” you’ll see a side-by-side comparison of the performance of your experimental campaign changes (“experiment”) versus your original setup (“control”). You’ll also be able to see the level of statistical significance for your experiment performance, which should help you judge if experiment performance was due to chance or an actual difference in performance. You can learn more about evaluating your results and statistical significance here.
Understanding your experiment's performance can help you determine whether you’re ready to accept your changes fully, remove changes or keep running your experiment. Reports also serve as an important record of experiment outcomes as you won’t see your past experiment data after you’ve accepted or removed your changes.

What are you waiting for? Ready, set, test!
No comments:
Post a Comment