Updated Release Testing Instructions WooCommerce 6.7 (markdown)

Alejandro López Ariza 2022-06-21 15:37:47 +02:00
parent 8871d92bc3
commit fb39568eb4
1 changed files with 248 additions and 18 deletions

@ -7,8 +7,7 @@ WooCommerce 6.7 includes:
### WC Admin Experiments ([#33452](https://github.com/woocommerce/woocommerce/pull/33452), [#33268](https://github.com/woocommerce/woocommerce/pull/33268), [#33395](https://github.com/woocommerce/woocommerce/pull/33395), [#33448](https://github.com/woocommerce/woocommerce/pull/33448), [#33428](https://github.com/woocommerce/woocommerce/pull/33428), [#33178](https://github.com/woocommerce/woocommerce/pull/33178))
### Interactive Walkthrough - Spotlight Tour ([#33452](https://github.com/woocommerce/woocommerce/pull/33452), [#33268](https://github.com/woocommerce/woocommerce/pull/33268), [#33395](https://github.com/woocommerce/woocommerce/pull/33395), [#33448](https://github.com/woocommerce/woocommerce/pull/33448), [#33400](https://github.com/woocommerce/woocommerce/pull/33400)))
**_Workflow: WooCommerce Core_** **_Workflow: WooCommerce Core_**
@ -48,6 +47,218 @@ document.querySelector("input.wp-tour-kit-spotlit").parentElement.insertBefore(d
Note: please find a [recording](https://user-images.githubusercontent.com/27843274/174014964-983b908b-8482-4852-ba73-da6c2e808780.mp4) to get a better understanding of the behaviour of this change. Note: please find a [recording](https://user-images.githubusercontent.com/27843274/174014964-983b908b-8482-4852-ba73-da6c2e808780.mp4) to get a better understanding of the behaviour of this change.
**Scenario 3: Spotlight tour is shown again after skipping it and reloading the page**
1. Enable experimental-product-tour feature flag via WooCommerce Admin Test Helper
2. Go to Tools > WCA Test Helper > Experiments
3. Add woocommerce_products_tour to treatment
4. Go to WooCommerce > Home > Add my products > Start with a template > Physical product
5. Observe that spotlight tour is displayed and dismiss it.
6. Switch to the text tab for product description
7. Reload the page
8. Observe that spotlight tour is displayed again
9. Click "next" button
10. Switch to the Visual tab
11. Observe that the spotlight tour is still shown and no typeError is shown in dev tools.
**Scenario 4: Product types appear as cards instead of a list of stacked items when adding new products while the woocommerce_products_task_layout_card_v2 experiment is enabled**
1. Navigate to Tools > WCA Test Helper > Experiments and add woocommerce_products_task_layout_card_v2 to treatment
2. Make sure your site has woocommerce_allow_tracking option set to yes
3. Go to WooCommerce > Home > Add my products
4. Product types are listed as cards (note than when the experiment is not in treatment, then the product types appear as a list of items)
**Scenario 5: Purchase task should be added to experimental task lists**
1. Proceed through OBW, and select the paid theme "Blooms" on the final step.
2. Be sure to opt into Marketing
3. When brought to the Homescreen, notice that the "Add Blooms to my store" task appears.
4. Go to Tools > WCA Test Helper > Experiments and add `woocommerce_tasklist_setup_experiment_1_*` to treatment
5. Refresh the Homescreen.
6. Note that the purchase task exists
7. Go to Tools > WCA Test Helper > Experiments and add the `woocommerce_tasklist_setup_experiment_2_*` experiment to treatment
8. Refresh the homescreen.
9. Note the purchase task exists
### Products ([#27804](https://github.com/woocommerce/woocommerce/pull/27804), [33397](https://github.com/woocommerce/woocommerce/pull/33397), [#32763](https://github.com/woocommerce/woocommerce/pull/32763), [#32971](https://github.com/woocommerce/woocommerce/pull/32971))
**_Workflow: WooCommerce Core_**
** Scenario 1: The image in the modal is the active image when opening a product with multiple images in the gallery**
1. Create a product with multiple images in the gallery
2. Click the image open photoswipe modal button
3. Ensure the image in the modal is the currently active image
** Scenario 2: The product description from the product templates now have more realistic examples**
1. Go to add my products
2. Click Start with a template
3. Choose Physical product
4. Observe that the `Hoodie in sweatshirt fabric made from a cotton blend.` text is shown in the product description
** Scenario 3: Product reviews should have a dedicated location within WooCommerce**
1. Add some products
2. Add some reviews to those products
3. Navigate to Products > Reviews
3.1. Product reviews and review replies are displayed on a list table
3.2. You can filter (by Type, Rating, and Product) the reviews
3.3. You can sort the reviews
3.4. You can search the reviews
3.5. You can moderate the reviews
4. Navigate to the WordPress Comments page
4.1. Product reviews and review replies are not displayed
5. Navigate to the WooCommerce > Home page and expand the reviews section
5.1. The Manage all reviews link redirects to the new Products > Reviews page
** Scenario 4: Warnings for malformed metadata should be suppressed in product template downloads**
1. Ensure `WP_DEBUG` is set to `true` in `wp-config.php`
2. Go to the Home screen
3. Open `wp-content/debug.log` and check that it does not contain any "Undefined index" trace
3. In the Home screen again, press "Add my products" on task list
4. Press Start with a template
5. Select Digital product
6. Ensure no warning is displayed here or within the `debug.log`
### Setup Wizard ([#33362](https://github.com/woocommerce/woocommerce/pull/33362))
**_Workflow: WooCommerce Core_**
1. On a fresh install, start the onboarding wizard.
** Scenario 1: The onboarding marketing checkbox should be default to false**
1. See that the marketing checkbox is not ticked by default
** Scenario 2: Continue button should be disabled when email is not entered**
1. Fill in details like Address, Country, City, and Postcode
2. Check the `Get tips, product updates and inspiration straight to your mailbox.` checkbox
3. Ensure the email textbox is empty
4. Observe that "Please enter your email address to subscribe" error is displayed, and "Continue" button is disabled
** Scenario 3: The "Yes, count me in!" button should not be loading when user decides to decline enabling usage tracking**
1. Skip setup wizard
2. Click the first button `No thanks`
3. Observe that only `No thanks` button is loading and `Yes, count me in!` button is disabled
### Themes ([#33308](https://github.com/woocommerce/woocommerce/pull/33308), [#32840](https://github.com/woocommerce/woocommerce/pull/32840))
**_Workflow: WooCommerce Core_**
**Scenario 1: Design of Single Product template in block themes should look right when product had no reviews or additional info**
1. Create a new product and make sure it has no description, no reviews and no additional information.
2. With [TT2 theme](https://wordpress.org/themes/twentytwentytwo/), visit that product in the frontend.
3. Verify the footer doesn't render on top of the single product template.
**Scenario 2: Twenty Twenty-Two theme should not break when updating modifying the alignment of a Classic Template Block**
1. With Twenty Twenty-Two, edit the Product Catalog template.
2. Select the Group block that contains the Classic Template.
3. Set an arbitrary background color.
4. On a new tab, go to the shop page on the front end, see the background is set and the layout doesn't break.
5. Back to the Site Editor tab, select the Classic Template block, and set the alignment to Wide.
6. See it reflects on the front end.
### WC Admin ([#32728](https://github.com/woocommerce/woocommerce/pull/32728), [#33064](https://github.com/woocommerce/woocommerce/pull/33064), [#33241](https://github.com/woocommerce/woocommerce/pull/33241), [#33270](https://github.com/woocommerce/woocommerce/pull/33270))
**_Workflow: WooCommerce Core_**
**Scenario 1: Admins should be able to add different values for `name` and `id` HTML input attributes in wc-admin-settings**
1. Create two custom fields through 'woocommerce_account_settings' filter, and define "field_name" and "value" pairs as below:
```
array(
'title' => __( '[FR] Digit Code : Error message', 'woocommerce' ),
'id' => 'number_error_message_fr',
'field_name' => 'number_error_message[fr]',
'value' => get_option('number_error_message')['fr'] ?? '',
'default' => 'Le numéro doit contenir 6 chiffres',
'type' => 'text',
'autoload' => false,
),
array(
'title' => __( '[EN] Digit Code : Error message', 'woocommerce' ),
'id' => 'number_error_message_en',
'field_name' => 'number_error_message[en]',
'value' => get_option('number_error_message')['en'] ?? '',
'default' => 'The number must contain 6 digits',
'type' => 'text',
'autoload' => false,
),
```
2. Check if 'number_error_message' option is properly set when the form is submitted (Should be an array of values from form inputs)
3. There should be no "Array to string conversion" error when redisplaying the form
**Scenario 2: Order/product count should be correct even when order status changes or product stock is set to zero**
1. Create a couple of products and orders
2. Hide the task list
3. The Orders and Stock panel should show up, and notice how two request were made to the WC api (one to `/wc/v3/products` and one to `/wc/v3/orders`)
4. If you change an order to processing, the correct number should show up in the panel header
5. If you enable stock management on a product and set stock to zero, the stock panel should show products
**Scenario 3: Navigation nudge note should not be added when while using the previous WC navigation**
1. Do not enable the new navigation
2. Visit the homescreen
3. Make sure the navigation note ("You now have access to the WooCommerce navigation") is not added
**Scenario 4: Navigation nudge note should not be added when while using the previous WC navigation**
1. Make sure `woocommerce_show_marketplace_suggestions` is set to `no` in **wp_options** table
2. Navigate to http://your-site/wp-admin/admin.php?page=wc-admin&task=marketing
3. Confirm the Pinterest has a "Built by WooCommerce" label
### Others ([#33219](https://github.com/woocommerce/woocommerce/pull/33219), [#33036](https://github.com/woocommerce/woocommerce/pull/33036), [#33164](https://github.com/woocommerce/woocommerce/pull/33164))
**_Workflow: WooCommerce Core_**
**Scenario 1: Filtering of cookie flags should be allowed**
1. Put items in cart
2. Verify in your browser that valid set-cookie headers exist in the HTTP response
**Scenario 2: Report days calculation should be correct for DST based timezones**
1. Select a timezone (US, London, etc) that utilizes DST in your site's General settings
2. Install an email logging plugin
3. Go to the Revenue report
4. Select October 1 - October 31 as a custom date
5. Click "Download" to export the report
6. Check your email logs to make sure the report is sent and can be downloaded
7. Check that the number of "days" is correct in the summary numbers at the bottom of the Revenue report
**Scenario 3: Categories should load as expected in Analytics**
1. Create some categories
2. Place some orders with products in various categories
3. Navigate to Analytics->Categories
4. Make sure the categories and category names load as expected
### Events tracking ([#33305](https://github.com/woocommerce/woocommerce/pull/33305), [#33400](https://github.com/woocommerce/woocommerce/pull/33400), [#33177](https://github.com/woocommerce/woocommerce/pull/33177))
**_Workflow: WooCommerce Core_**
1. Start with a fresh install of WooCommerce
2. Enable usage tracking when completing the Setup Wizard
3. Install and activate the latest [WooCommerce Test Helper plugin](https://github.com/woocommerce/woocommerce-admin-test-helper/releases/tag/v0.7.6)
**Scenario 1: Navigation event is tracked in statistics when it is enabled**
1. Go to /wp-admin/admin.php?page=wc-settings&tab=advanced&section=features
2. Enable the `Navigation` setting
3. Verify in Tracks that the `wcadmin_settings_change` event is fired with `settings: woocommerce-navigation_enabled`
**Scenario 2: Navigation event is tracked in statistics when it is disabled**
1. Go to /wp-admin/admin.php?page=wc-settings&tab=advanced&section=features
2. Disable the `Navigation` setting
3. Verify in Tracks that the `wcadmin_settings_change` event is fired with `settings: woocommerce-navigation_disabled`
**Scenario 3: Events are tracked successfully when creating a product from template using the previous walkthrough** **Scenario 3: Events are tracked successfully when creating a product from template using the previous walkthrough**
1. **Without** enabling the `woocommerce_products_tour` experiment 1. **Without** enabling the `woocommerce_products_tour` experiment
2. Open your browser console and make sure tracking is enabled 2. Open your browser console and make sure tracking is enabled
@ -60,22 +271,7 @@ Note: please find a [recording](https://user-images.githubusercontent.com/278432
9. Observe `wcadmin_walkthrough_product_completed` track 9. Observe `wcadmin_walkthrough_product_completed` track
**Scenario 4: Spotlight tour is shown again after skipping it and reloading the page** **Scenario 4: Events are tracked successfully when creating a product from template using the new walkthrough (spotlight tour)**
1. Go to Tools > WCA Test Helper > Features
2. Enable experimental-product-tour
3. Go to Tools > WCA Test Helper > Experiments
4. Add woocommerce_products_tour to treatment
5. Go to WooCommerce > Home > Add my products > Start with a template > Physical product
6. Observe that spotlight tour is displayed and dismiss it.
7. Switch to the text tab for product description
8. Reload the page
9. Observe that spotlight tour is displayed again
10. Click "next" button
11. Switch to the Visual tab
12. Observe that the spotlight tour is still shown and no typeError is shown in dev tools.
**Scenario 5: Events are tracked successfully when creating a product from template using the new walkthrough (spotlight tour)**
1. Enable `experimental-product-tour` 1. Enable `experimental-product-tour`
2. Go to Tools > WCA Test Helper > Experiments 2. Go to Tools > WCA Test Helper > Experiments
3. Add `woocommerce_products_tour` to treatment 3. Add `woocommerce_products_tour` to treatment
@ -90,3 +286,37 @@ Note: please find a [recording](https://user-images.githubusercontent.com/278432
12. Observe `wcadmin_walkthrough_product_completed` track 12. Observe `wcadmin_walkthrough_product_completed` track
**Scenario 5: Event should be fired when a user clicks the load sample products cancel button**
1. Go to Tools > WCA Test Helper > Experiments
2. Toggle woocommerce_products_task_layout_stacked to set you to the treatment group.
3. Go to Woocommerce > Home
4. Click "Add my products"
5. Enable track logging `localStorage.setItem( 'debug', 'wc-admin:*' );` in your browser console
6. Click View more product types
7. Click Load Sample Products
8. Click Cancel button
9. It should record a `wcadmin_tasklist_cancel_load_sample_products_click` event
**Scenario 6: Event `wcadmin_product_add_publish` should send the props sent for the event `wcadmin_product_updates`**
1. Enter `localStorage.setItem( 'debug', '*' );` in your browser console to enable debug messages
2. Verify in your browser console that the following prop list is being sent correctly for the event wcadmin_product_update.
-- description: Yes|No
-- short_description: Yes|No
-- product_image: Yes|No
-- product_gallery: Int (count of images in the gallery)
-- categories: Int (count of categories)
-- tags: Int (count of tags)
-- sale_price: Yes|No
-- weight: Yes|No
-- dimensions: Yes|No
-- upsells: Yes|No
-- cross-sells: Yes|No
-- attributes: Int (count of attributes)
-- purchase_note: Yes|No
-- menu_order: Yes|No
-- enable_reviews: Yes|No
4. Create a new product.
5. Go to WooCommerce -> Status -> Logs (URL wp-admin/admin.php?page=wc-status&tab=logs).
6. Select a tracks-* log from the dropdown.
7. Verify that the event wcadmin_product_add_publish is sending the props described in step 2 correctly.