Why increase Smart traffic?

Taking a traditional approach to A/B testing, all DataMilk customer domains start with their site traffic split 50% control and 50% treatment. We call the treatment group  “Smart” (or "Optimized”) traffic, sessions who experience Smart Components, and the control group “Original”, sessions who see the original, unchanged site.

If the Smart traffic group’s performance is measured to have a positive uplift, outperforming the Original group, then DataMilk automatically increases traffic to the maximum statistically appropriate level. DataMilk’s system will take into consideration all relevant parameters about the store’s traffic to make a statistically driven decision on what the Smart traffic ratio should be and when it should be actioned.

How DataMilk determines when to increase Smart traffic

The parameters that the DataMilk system takes into consideration when determining how much Smart traffic should be turned up to and when:

• Traffic volume type (low, medium, high)
• Confidence intervals of conversion rate, revenue, gross profit, and AOV uplift
• Period of time
• Risks 
• Benefits