Testing Groups

Overview

A Testing Group is conceptually similar to a Segment in that it selects consumers based on user-defined conditions or business rules. A Testing Group is primarily intended for A / B / n testing, where you want the consumer's inclusion in a group to be consistent. It represents a decision where you want the platform to treat consumers differently based on their inclusion in the Testing Group. For example, you may want to:

Testing Groups can be referenced within other areas of the platform, such as Classifier Rules

Access 

To access the Testing Groups screen, select Audiences from the Main Navigation Menu, then select Testing Groups from the Sub-Category menu.

Features

The Testing Groups screen provides the following features related to managing your Testing Groups:

 Searching and Sorting

Click hereClick here

Search

The search feature allows you to search for a specified text string anywhere within the following Testing Groups fields: Display Name, Internal Name, Tag, Category label, or Category name.

  1. Optionally, in the search field near the top of the Testing Groups screen, enter the desired text string.

  2. Optionally, to filter the Testing Groups by Status, from the "Status" drop-down menu, select a Testing Groups status (or "Any status").  

  3. Optionally, to filter the Testing Groups by effectivity, from the "Effectivity" drop-down menu, select a time period (or "Any effectivity").  

  4. Press Enter, or click the search button (magnifying glass icon).

  5. The Testing Groups screen is refreshed to show only the Testing Groups that meet your search criteria. Please note that if you enter multiple search criteria, the platform displays only the Testing Groupss that meet ALL criteria.

  6. To remove all search criteria, click the remove button ("X" icon).

Sort

The "Sort" drop-down menu allows you to sort the Testing Groups on a variety of different fields. To sort the list of Testing Groups, select the desired sort option from this menu.

  • Created Date (default)

  • Updated Date

Navigation

Once you've found the desired Testing Group, you can navigate to the following other screens:

 

 Create a New Testing Group

Click hereClick here

To create a new Testing Group: 

  1. In the "Enter Display Name" field, enter the Display Name value for the new Testing Group.  

  2. Click create. The "Edit Testing Group" pop-up window is displayed.

  3. The "Display Name" field is populated with the value you entered above; optionally edit this value.

  4. The Internal Name is automatically populated based on the Display Name value. This field is uneditable by default. To edit the Internal Name, check edit internal name. A confirmation dialog box is displayed; click ok. Edit the Internal Name value.

  5. In the "Description" field, optionally enter a description of the Testing Group. 

  6. Typically the consumers selected by a Testing Group are allocated to a Group based on a specifc distribution pattern. For example, perhaps you want to send 10% of your consumers one version of your message content, and the other 90% a different version. To create a Group, enter its name in the "Group" field. Repeat this step as needed to define additional Groups.

  7. Optionally, to assign this Testing Group to a Category, select the desired Testing Group Category from the "Category" drop-down menu. Repeat this step as needed. 

  8. Click save.

 

 

 View or Edit a Testing Group

Click hereClick here

To view or edit the details of a Testing Group:

  1. Search, sort, or filter the Testing Groups screen as described above.

  2. Click the name of the desired Testing Group.

  3. The Testing Group Details screen is displayed and populated with all of the information about this Testing Group. See Testing Group Details for more information.

 

 Deploy Testing Group Metadata

Click hereClick here

After you've created a Testing Group and defined its rules for selecting customers, you must deploy the Testing Group metadata. When you deploy the Testing Group metadata to the server, the process automatically deploys the metadata for ALL modified Testing Groups.  

  1. From the "Actions" menu in the top-right corner, select "Validate Testing Groups Metadata."

Note: You can deploy metadata immediately, but the best practice is to validate the Testing Group logic before deploying metadata to ensure no incorrect expression code gets deployed to the server that could cause issues.

  1. If the validation step passes, you'll see a message that says, "Testing Group metadata is valid." If the validation step fails, you'll receive an error message; review and correct your Testing Group expressions, then retry the validation step.

  2. Click deploy testing groups metadata.

  3.  A confirmation dialog box is displayed; click confirm.

  4. If the deployment was successful, you'll see a message that says, "Testing Group metadata has been deployed."

 

 View Deployed Testing Group Metadata

Click hereClick here

To see the details of what Testing Group metadata has been deployed:

  1. From the "Actions" menu in the top-right corner of the screen, select "View Deployed Testing Groups." The "View Snapshot" pop-up window is displayed.

  2. Click the plus-sign to expand the message to view additional details, such as the total number of deployed Testing Groups. You can also drill in deeper, to see details of each deployed Testing Group (Testing Group name, logic, included customers, etc.).

  3. When finished, click the "X" icon to close the pop-up window.

 

 Evaluate  Expression

Click hereClick here

To evaluate a Groovy expression:

  1. From the "Actions" drop-down menu, select "Evaluate Expression." The "Validate Expression" pop-up window is displayed.

  2. In the "Expression" field, enter the Groovy expression. 

  3. In the "Member" field, begin typing all or part of a Member's name (minimum of three characters). Pick the desired Member from the search results. 

  4. From the "Activity Type" drop-down menu, select the desired Activity type.

  5. The "Activity JSON" field is displayed and populated with the API payload for this Activity type. Enter the desired values in the API payload. 

  6. Click evaluate.

  7. The platform dispalys the results of the validation process, including whether the code is valid, and what the result is for the selected Member and Activity type. 

  8. When finished, click close.  

 

 Back to Audiences Overview

Last Updated: April 2022