Adding variants during the evaluation period
If you add a variant to an Optimizer Dialogue during the evaluation period, it will be kept track of just as the other variants are and its distribution values can be seen on the Variants tab. Do note that if you are using 'Automatic optimization' as variant strategy that the newly added variant will automatically get a higher distribution percentage in comparison to the existing variants. This is done to give the new variant a chance to 'catch up'.
Adding variants after the evaluation period ends
If you add a variant to an optimizer after the evaluation has occurred, what happens next depends on the "After Evaluation" setting. The following table summarizes what will happen with new variants added after an evaluation period ends.
|After Evaluation Setting||Description|
|Automatic Optimization||The new variant will be served along with the existing variants and its effectiveness will be scored. As time passes, if its effectiveness is higher than the existing variants, it will be served increasingly more often than those that are less effective. The process continues as such with the currently best performing variants always being served more often than those that perform less well.|
|Stop serving any variant||The new variant will not be served to any visitors.|
|Serve specific variant||The new variant will only be served if it is selected as the specific variant to use.|
|Serve winning variant||The new variant will not be shown.|
The following example shows a completed configuration of an optimizer's advanced and evaluation settings. The configuration includes the following:
- A "Start Date" of April 4th, 2014 at 2:00 PM.
- No "End Date" specified.
- The "Attribution Channel" is "www.blueconic.com".
- The "Frequency Cap" for individual visitors is 10 views per day.
- The "Evaluate At" setting is either 200 clicks or 25 conversions, whichever is reached first.
- The "Variants Strategy" is "Automatic Optimization".
- The "After Evaluation" setting is "Automatic Optimization".