Uploaded image for project: 'PUBLIC - Liferay Portal Community Edition'
  1. PUBLIC - Liferay Portal Community Edition
  2. LPS-97882

As a marketer, I can manage AB tests from the sidebar panel

    Details

    • Epic/Theme:
    • Sprint:
      SP | Sprint 15 | Jul10 - Jul23, SP | Sprint 16 | Jul24 - Aug06, SP | Sprint 17 | Aug07 - Aug21

      Description

      Motivation

      See Epic and Spike for general AB testing motivation.

      The initial AB testing design included the AB test creation flow as part of the page edition flow. This approach had some flaws, like the possibility of editing the base experience while a test for it was being created. Also assumed that the persona creating AB tests (and therefore their permissions) where the same as for editing a page. 

      The latest design separates the AB test creation from the page edition. The goal of this story is to honor this design and introduce the AB test button in the control bar, and a sidebar to manage AB tests.

      Scope

      The scope of this story is limited to the following actions:

      • Open the AB test sidebar through the AB test button in the control bar
      • Displaying experiences, navigating between experiences
      • Create/edit a new test with name and description only
      • Display currently in progress test (draft, stopped, scheduled, finished statuses) in the sidebar

      Design

      • Mockup: https://www.figma.com/file/AIvpwdchofYfAMcBi6WAc9/lps-96780-create-a-b-test?node-id=0%3A1
      • Variations with respect to the Figma (for this story only):
        • The AB test icon is provisional (see LEXI-637)
        • The AB sidebar panel opens like the simulation panel (opening it moves the control menu horizontally)
        • The information about tests in the experience drop down is not included
        • Test creation/edition form is limited to name and description
        • Test variation management is not included
        • AB test sidebar contains no tabs (it shows only the content of the Active AB test in the mockup)
        • The AB test creation modal does not display the steps component
        • The save as draft and the preview and Run buttons are not included

      Acceptance Criteria

      1. The AB test icon is shown

      • Given a content page
      • When the content page is viewed by a user with page edit permissions
      • Then the AB test icon is displayed in the control bar

      2. The AB test sidebar is opened through the AB test icon

      • Given the AB test icon is displayed in the control bar
      • When the AB test icon is clicked
      • Then the AB test sidebar is shown

      3. The AB test sidebar is empty

      • Given that there are no tests in progress for the current content page
      • When the AB test sidebar is shown
      • Then it contains:
        • The experiences dropdown
        • The create test button

      4. Open AB test modal (create)

      • Given that there are no tests in progress for the current content page
      • When the Create Test button is clicked
      • Then a modal is opened with:
        • Name (required, placeholder)
        • Description (placeholder)
        • Save (Main*) and Cancel buttons. For the scope of this story, the main button is “Save” and not “Next”

      5. Create AB test 

      • Given the AB test modal is open
      • When the required fields (Name) are filled 
      • And the Save button is clicked
      • Then the AB test is created 
      • And the modal is closed
      • And the sidebar shows:
        • A help message under experience selector, explaining why one a test can be added per experience
        • The test name
        • An action menu closed to the test name with actions
        • Edit Test (for now)
        • The control variant (The Add variant button is not displayed yet)

      6. Open the AB test modal (edit)

      • Given a page with an experience and an AB test exist
      • When the edit action in the actions menu next to the test title is clicked
      • Then a modal is opened with:
        • Name (with the test name)
        • Description (with the test description)
        • Save (Main*) and Cancel buttons. For the scope of this story, the main button is “Save” and not “Next”**

      7. Edit AB test

      • Given the modal is open when editing a test
      • When different values are added for the name and description fields
      • And the Save button is clicked
      • Then the modal closes
      • And the test is displayed in the sidebar with the changes

      8. Cancel AB test creation/edit

      • Given the AB test modal is open (when creating or editing)
      • When the cancel button (or the close modal button) is clicked
      • Then a warning message is shown
      • When OK is clicked, 
      • Then the modal is closed
      • And the test is not created

      9. Navigate through experiences

      • Given a content page with experiences Default and A
      • And that an AB test has been has been created for each experience
      • When I change from experience Default to experience A in the experience selector
      • Then the page shows the personalizations for this experience
      • And the sidebar shows the test corresponding to the selected experience

      10. Navigate through pages

      • Given we have several content pages with experiences 
      • And that AB tests have been created for the experiences of those pages
      • When I click on a different content page in the page navigation
      • Then the AB test sidebar panel shows the test of the current page
      • And the experience dropdown contains the experiences for that page

      11. Closing AB test sidebar

      • Given the AB test panel is open
      • When I click on the AB test icon on the control bar
      • Then the AB test sidebar is closed

        Attachments

          Issue Links

          1.
          Review Acceptance Criteria Technical Testing Closed Manoel Cyreno  
          2.
          Product QA Test Creation Technical Testing Closed Manoel Cyreno  
          3.
          Backend Review - Coverage for the Test Scenarios Technical Testing Closed Manoel Cyreno  
          4.
          Frontend Review - Coverage for the Test Scenarios Technical Testing Closed Manoel Cyreno  
          5.
          Product QA Test Validation - Round 1 Technical Testing Closed Manoel Cyreno  
          6.
          [Back] Show/hide AB Testing Sidebar Technical Task Closed Brian Chan  
          7.
          [Front] Add AB test UI to Sidebar Technical Task Closed Brian Chan  
          8.
          Hide AB test icon if DXP instance is not connected to Analytics Cloud Technical Task Closed Brian Chan  
          9.
          [Front] Remove Experiments code from Layout Editor Technical Task Closed Andres Fulla  
          10.
          [Front] Unit tests Technical Task Closed Brian Chan  
          11.
          Update page content based on selected experience Technical Task Closed Brian Chan  
          12.
          Show unsupported AB testing message for widgets Technical Task Closed Brian Chan  
          13.
          [BUG] The tooltip of the A/B Test is "title" and is not "A/B Test" Technical Task Closed Brian Chan  
          14.
          [BUG] The A/B Test icon appears when the user has not permission to edit the page Technical Task Closed Brian Chan  
          15.
          [BUG] When we open the A/B Test sidebar and click on the edit content page icon, the area of the A/B Test sidebar, keep opened Technical Task Closed Brian Chan  
          16.
          [BUG] When trying to edit the A/B Test, it allows blank values Technical Task Closed Brian Chan  
          17.
          Product QA Test Validation - Round 2 Technical Testing Closed Manoel Cyreno  
          18.
          [BUG] Create A/B Test modal appear in a wrong position Technical Task Closed Brian Chan  
          19.
          [BUG] Title of the Modal about edit A/B Test is related to the create A/B Test Technical Task Closed Brian Chan  
          20.
          [BUG] User has the permission to edit the page, but can't manage the A/B Test Technical Task Closed Brian Chan  
          21.
          Product QA Test Validation - Round 3 Technical Testing Closed Manoel Cyreno  

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Packages

                  Version Package
                  7.2.10 DXP FP2
                  7.2.10.1 DXP SP1
                  Master