How to Set up AB Testing via Email Channel in FirstHive?

How to Create Email Campaign?

Go to Campaigns >> Click Create Your Campaign >> Enter Campaign Name >> Select Email Campaign from the channels >> Select Send via from the drop-down >> Click Continue

Select the template for the Email campaign:

You have the following options,

Select the campaign type, whether it is Transaction or Promotional >> Enter a subject for the campaign >> Enter sender’s name (Default) >> Enter sender’s Email Id >> Enter Reply-to-Email Id >> Enter the purpose of the Email >> Enter other required details (if any) >> Click Continue

You can also add audience to the exclusion list by entering the Email Address in Comma Separated format, then click Add Exclusion List.

This takes you to the Preview section, where you have to options Baisc and Advance

Basic: Select Baisc >> Enter the Test Email Address >> Clik Back

This takes you to the Manage Campaigns page, where you can see the campaign >> Click Validate

This will ask you click on Send Activation Link >> You receive the activation link on the following email id > Click to validate >> Now, you can Execute the campaign

Advance

Here, you have the option to Run A/B Test.

Select Advance >> Enter the email id >> Click Run A/B Test

1. Select the Campaign from the drop-down. When you click in the check box and enter the subject, the subject remains same but the content changes. If you do not click on the check box, then this will send different subjects with their respective contents.
2. Enter Test Percentage (%).
3. Select the Metric from the drop-down. Depending on the campaign metric, this will decide which campaign performs better.
4. Select the Test Duration. The Test Duration range is between 1-24 Hours, after crossing the set time; this will decide which campaign has performed better.
5. If the result comes inconclusive (A=B), then you need to select the campaign of your preference/choice. Choose either A or B.
6. Click Continue. Once you click on continue, this will go to prgm_campaing_ABtesting, the record will be saved against the record id in pk_cmp_A and pk_cmp_B column. All the details including Test Percentage, Metric, etc., will be saved in this table.

When you click on Manage Campaign (get back to the main Menu), you see the A/B tag in the campaign dashboard.

A/B Testing

A/B testing compares two versions of an email campaign, or an aspect in a scenario to evaluate which performs best. With the different variants shown to your customers, you can determine which version is the most effective with data-backed evidence.

FirstHive offers A/B testing in scenarios (Email campaigns). A customer is assigned a variant that will be shown to them instantly when reaching an A/B split node in a scenario or matching the conditions for displaying an email campaign.

In Email Campaign, a user (customer) can perform two things when he/she receives an Email communication:

Steps

Step 1: Create two Campaigns.

Step 2: Put users in Campaign A.

• Copy the Exclusion IDs to Campaign B

Step 3: Validate the users.

Step 4: Get the Test % Users.

Step 5: Divide the users into two parts A and B.

Step 6: Call the Campaign API.

Step 7: Set the Wait Time.

Step 8: Calculate the Decision.

Step 9: Select the campaign version, either A or B.

Step 10: Send th Final Campaign.