Experiment terms

1. There are 3 levels of permission rights for users:

Term Definition
Admin Such user provides all the permissions; can integrate the code, set goals, create and edit variations, set rules, create segments, include and exclude page variations, publish and complete the experiment.
Advanced user Such user can integrate the code, set goals, create, and edit variations, set rules, create segments.
Regular user Such user can create and edit variations.

2. Check or refer to these terms used in the experiment creating:

Term Definition
Analytics event type A category of events in the analytics system that is required to identify your goal.
Any click A goal that can be any visitor’s click on your experimental page.
Attribute A traffic parameter that is detected by the system.
Сontent block An HTML element or a group of HTML elements (ID, XPath, Selector) that has its alternatives (with slight changes) for specific content in the MVT testing.
Conversion rate, % A conditional figure that is calculated as the proportion of all target actions (X) to variation generations Y: X/Y.
Conversion pixel goal A goal type for A/B/N and multivariate testing that is set in case you have to track the conversion on the websites of some third parties.

For instance, to complete the purchase, your customer is redirected to the X resource and has to provide the required information. Thus, only after this step is completed, the purchase is considered to be successful and the conversion is the redirection on the X resource of the third party. So, to track such type of conversion, you should insert the pixel code generated by Maxymizely and mark your third party website with this pixel, following the instructions from Maxymizely.
Goal An HTML element (ID, XPath, Selector) that defines the target action of your website visitors (a click, text editing, HTML Event Type, etc.); this action is used as an indicator of your page conversion (that’s what we track and what sort of data we collect).
HTML event type One of the events of a web browser after which the visitor’s action is tracked.
Original An initial version of your web page without any changes.
Search method A system of identification of an HTML element or group of such elements on the web page (comprises such fields as ID, XPath, Selector). This option enables you to accurately choose the search method of the elements, to which your variation should be applied.

  • ID – an attribute of the HTML element that provides a unique identification of the element among all elements in the web document.
  • XPath – a query that is used to navigate through elements and attributes in an XML document. Thus, it shows the path to the HTML element on your web page. Mind that if the page changes dynamically, the XPath turns to be incorrect.
  • Selector – an HTML element or a group of HTML elements that can be described with different element attributes, such as a class, value, etc.
Segment A share of traffic limited by some attributes.
Traffic settings
  • Non-experiment – the percentage of traffic provided for the original page. The share of this traffic will not participate in the experiment and only the basic analytics of the resource is collected.
  • Experiment – the percentage of traffic provided for the experiment.

Your experimental traffic might be split by one of the following methods:

  • Evenly – the traffic is shared evenly among all variations.
  • Intelligent conversion – the best variation gets the most of the traffic automatically. 20% of your traffic is distributed evenly among all variations, using which, the IC calculates the share to be distributed among the variations. You have to have at least 500 unique visitors of your experiment to be able to apply this method.
  • Manually – the scales of traffic splitting among variations are set manually.
Variation A changed version of the original web page. There may be as many variations as you need. Variations help to define what page view is more appealing for the visitors.

3. Refer to the following terms while studying the statistics of your experiment(s).

Chance to beat all A calculation of the probability that your page variation will win in the current Experiment. This value depends on variation conversion rate and test duration.
Unique conversions The accomplishment of your target action after the variation has been seen.
Unique occurrences A number of unique occurrences of page variations for your unique visitor; if your visitor revisits the page variation, he/she can see the same page variation.

4. Now, as you know the A/B/N & MVT language, think (hypothetically) of the Goals and Content blocks on your page.

Your Vision of Site Testing

 

5. Below, find the examples of ID, Selector, or XPath you need for your further A/B/N & MVT experiment.

Code Elements