From fb39568eb414b37148ec9ebeca609b50530256b9 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Alejandro=20L=C3=B3pez=20Ariza?= <45979455+alopezari@users.noreply.github.com> Date: Tue, 21 Jun 2022 15:37:47 +0200 Subject: [PATCH] Updated Release Testing Instructions WooCommerce 6.7 (markdown) --- ...se-Testing-Instructions-WooCommerce-6.7.md | 266 ++++++++++++++++-- 1 file changed, 248 insertions(+), 18 deletions(-) diff --git a/Release-Testing-Instructions-WooCommerce-6.7.md b/Release-Testing-Instructions-WooCommerce-6.7.md index 39668e5..7807d01 100644 --- a/Release-Testing-Instructions-WooCommerce-6.7.md +++ b/Release-Testing-Instructions-WooCommerce-6.7.md @@ -7,8 +7,7 @@ WooCommerce 6.7 includes: - -### Interactive Walkthrough - Spotlight Tour ([#33452](https://github.com/woocommerce/woocommerce/pull/33452), [#33268](https://github.com/woocommerce/woocommerce/pull/33268), [#33395](https://github.com/woocommerce/woocommerce/pull/33395), [#33448](https://github.com/woocommerce/woocommerce/pull/33448), [#33400](https://github.com/woocommerce/woocommerce/pull/33400))) +### WC Admin Experiments ([#33452](https://github.com/woocommerce/woocommerce/pull/33452), [#33268](https://github.com/woocommerce/woocommerce/pull/33268), [#33395](https://github.com/woocommerce/woocommerce/pull/33395), [#33448](https://github.com/woocommerce/woocommerce/pull/33448), [#33428](https://github.com/woocommerce/woocommerce/pull/33428), [#33178](https://github.com/woocommerce/woocommerce/pull/33178)) **_Workflow: WooCommerce Core_** @@ -48,6 +47,218 @@ document.querySelector("input.wp-tour-kit-spotlit").parentElement.insertBefore(d Note: please find a [recording](https://user-images.githubusercontent.com/27843274/174014964-983b908b-8482-4852-ba73-da6c2e808780.mp4) to get a better understanding of the behaviour of this change. +**Scenario 3: Spotlight tour is shown again after skipping it and reloading the page** +1. Enable experimental-product-tour feature flag via WooCommerce Admin Test Helper +2. Go to Tools > WCA Test Helper > Experiments +3. Add woocommerce_products_tour to treatment +4. Go to WooCommerce > Home > Add my products > Start with a template > Physical product +5. Observe that spotlight tour is displayed and dismiss it. +6. Switch to the text tab for product description +7. Reload the page +8. Observe that spotlight tour is displayed again +9. Click "next" button +10. Switch to the Visual tab +11. Observe that the spotlight tour is still shown and no typeError is shown in dev tools. + + +**Scenario 4: Product types appear as cards instead of a list of stacked items when adding new products while the woocommerce_products_task_layout_card_v2 experiment is enabled** +1. Navigate to Tools > WCA Test Helper > Experiments and add woocommerce_products_task_layout_card_v2 to treatment +2. Make sure your site has woocommerce_allow_tracking option set to yes +3. Go to WooCommerce > Home > Add my products +4. Product types are listed as cards (note than when the experiment is not in treatment, then the product types appear as a list of items) + + +**Scenario 5: Purchase task should be added to experimental task lists** +1. Proceed through OBW, and select the paid theme "Blooms" on the final step. +2. Be sure to opt into Marketing +3. When brought to the Homescreen, notice that the "Add Blooms to my store" task appears. +4. Go to Tools > WCA Test Helper > Experiments and add `woocommerce_tasklist_setup_experiment_1_*` to treatment +5. Refresh the Homescreen. +6. Note that the purchase task exists +7. Go to Tools > WCA Test Helper > Experiments and add the `woocommerce_tasklist_setup_experiment_2_*` experiment to treatment +8. Refresh the homescreen. +9. Note the purchase task exists + + +### Products ([#27804](https://github.com/woocommerce/woocommerce/pull/27804), [33397](https://github.com/woocommerce/woocommerce/pull/33397), [#32763](https://github.com/woocommerce/woocommerce/pull/32763), [#32971](https://github.com/woocommerce/woocommerce/pull/32971)) +**_Workflow: WooCommerce Core_** + + +** Scenario 1: The image in the modal is the active image when opening a product with multiple images in the gallery** +1. Create a product with multiple images in the gallery +2. Click the image open photoswipe modal button +3. Ensure the image in the modal is the currently active image + + +** Scenario 2: The product description from the product templates now have more realistic examples** +1. Go to add my products +2. Click Start with a template +3. Choose Physical product +4. Observe that the `Hoodie in sweatshirt fabric made from a cotton blend.` text is shown in the product description + + +** Scenario 3: Product reviews should have a dedicated location within WooCommerce** +1. Add some products +2. Add some reviews to those products +3. Navigate to Products > Reviews + 3.1. Product reviews and review replies are displayed on a list table + 3.2. You can filter (by Type, Rating, and Product) the reviews + 3.3. You can sort the reviews + 3.4. You can search the reviews + 3.5. You can moderate the reviews +4. Navigate to the WordPress Comments page + 4.1. Product reviews and review replies are not displayed +5. Navigate to the WooCommerce > Home page and expand the reviews section + 5.1. The Manage all reviews link redirects to the new Products > Reviews page + + +** Scenario 4: Warnings for malformed metadata should be suppressed in product template downloads** +1. Ensure `WP_DEBUG` is set to `true` in `wp-config.php` +2. Go to the Home screen +3. Open `wp-content/debug.log` and check that it does not contain any "Undefined index" trace +3. In the Home screen again, press "Add my products" on task list +4. Press Start with a template +5. Select Digital product +6. Ensure no warning is displayed here or within the `debug.log` + + +### Setup Wizard ([#33362](https://github.com/woocommerce/woocommerce/pull/33362)) +**_Workflow: WooCommerce Core_** + + +1. On a fresh install, start the onboarding wizard. + + +** Scenario 1: The onboarding marketing checkbox should be default to false** +1. See that the marketing checkbox is not ticked by default + +** Scenario 2: Continue button should be disabled when email is not entered** +1. Fill in details like Address, Country, City, and Postcode +2. Check the `Get tips, product updates and inspiration straight to your mailbox.` checkbox +3. Ensure the email textbox is empty +4. Observe that "Please enter your email address to subscribe" error is displayed, and "Continue" button is disabled + +** Scenario 3: The "Yes, count me in!" button should not be loading when user decides to decline enabling usage tracking** +1. Skip setup wizard +2. Click the first button `No thanks` +3. Observe that only `No thanks` button is loading and `Yes, count me in!` button is disabled + + +### Themes ([#33308](https://github.com/woocommerce/woocommerce/pull/33308), [#32840](https://github.com/woocommerce/woocommerce/pull/32840)) +**_Workflow: WooCommerce Core_** + + +**Scenario 1: Design of Single Product template in block themes should look right when product had no reviews or additional info** +1. Create a new product and make sure it has no description, no reviews and no additional information. +2. With [TT2 theme](https://wordpress.org/themes/twentytwentytwo/), visit that product in the frontend. +3. Verify the footer doesn't render on top of the single product template. + +**Scenario 2: Twenty Twenty-Two theme should not break when updating modifying the alignment of a Classic Template Block** +1. With Twenty Twenty-Two, edit the Product Catalog template. +2. Select the Group block that contains the Classic Template. +3. Set an arbitrary background color. +4. On a new tab, go to the shop page on the front end, see the background is set and the layout doesn't break. +5. Back to the Site Editor tab, select the Classic Template block, and set the alignment to Wide. +6. See it reflects on the front end. + + +### WC Admin ([#32728](https://github.com/woocommerce/woocommerce/pull/32728), [#33064](https://github.com/woocommerce/woocommerce/pull/33064), [#33241](https://github.com/woocommerce/woocommerce/pull/33241), [#33270](https://github.com/woocommerce/woocommerce/pull/33270)) +**_Workflow: WooCommerce Core_** + + +**Scenario 1: Admins should be able to add different values for `name` and `id` HTML input attributes in wc-admin-settings** +1. Create two custom fields through 'woocommerce_account_settings' filter, and define "field_name" and "value" pairs as below: +``` +array( + 'title' => __( '[FR] Digit Code : Error message', 'woocommerce' ), + 'id' => 'number_error_message_fr', + 'field_name' => 'number_error_message[fr]', + 'value' => get_option('number_error_message')['fr'] ?? '', + 'default' => 'Le numéro doit contenir 6 chiffres', + 'type' => 'text', + 'autoload' => false, +), +array( + 'title' => __( '[EN] Digit Code : Error message', 'woocommerce' ), + 'id' => 'number_error_message_en', + 'field_name' => 'number_error_message[en]', + 'value' => get_option('number_error_message')['en'] ?? '', + 'default' => 'The number must contain 6 digits', + 'type' => 'text', + 'autoload' => false, +), +``` +2. Check if 'number_error_message' option is properly set when the form is submitted (Should be an array of values from form inputs) +3. There should be no "Array to string conversion" error when redisplaying the form + + +**Scenario 2: Order/product count should be correct even when order status changes or product stock is set to zero** +1. Create a couple of products and orders +2. Hide the task list +3. The Orders and Stock panel should show up, and notice how two request were made to the WC api (one to `/wc/v3/products` and one to `/wc/v3/orders`) +4. If you change an order to processing, the correct number should show up in the panel header +5. If you enable stock management on a product and set stock to zero, the stock panel should show products + + +**Scenario 3: Navigation nudge note should not be added when while using the previous WC navigation** +1. Do not enable the new navigation +2. Visit the homescreen +3. Make sure the navigation note ("You now have access to the WooCommerce navigation") is not added + + +**Scenario 4: Navigation nudge note should not be added when while using the previous WC navigation** +1. Make sure `woocommerce_show_marketplace_suggestions` is set to `no` in **wp_options** table +2. Navigate to http://your-site/wp-admin/admin.php?page=wc-admin&task=marketing +3. Confirm the Pinterest has a "Built by WooCommerce" label + + +### Others ([#33219](https://github.com/woocommerce/woocommerce/pull/33219), [#33036](https://github.com/woocommerce/woocommerce/pull/33036), [#33164](https://github.com/woocommerce/woocommerce/pull/33164)) +**_Workflow: WooCommerce Core_** + + +**Scenario 1: Filtering of cookie flags should be allowed** +1. Put items in cart +2. Verify in your browser that valid set-cookie headers exist in the HTTP response + + +**Scenario 2: Report days calculation should be correct for DST based timezones** +1. Select a timezone (US, London, etc) that utilizes DST in your site's General settings +2. Install an email logging plugin +3. Go to the Revenue report +4. Select October 1 - October 31 as a custom date +5. Click "Download" to export the report +6. Check your email logs to make sure the report is sent and can be downloaded +7. Check that the number of "days" is correct in the summary numbers at the bottom of the Revenue report + + +**Scenario 3: Categories should load as expected in Analytics** +1. Create some categories +2. Place some orders with products in various categories +3. Navigate to Analytics->Categories +4. Make sure the categories and category names load as expected + + + +### Events tracking ([#33305](https://github.com/woocommerce/woocommerce/pull/33305), [#33400](https://github.com/woocommerce/woocommerce/pull/33400), [#33177](https://github.com/woocommerce/woocommerce/pull/33177)) +**_Workflow: WooCommerce Core_** + +1. Start with a fresh install of WooCommerce +2. Enable usage tracking when completing the Setup Wizard +3. Install and activate the latest [WooCommerce Test Helper plugin](https://github.com/woocommerce/woocommerce-admin-test-helper/releases/tag/v0.7.6) + + +**Scenario 1: Navigation event is tracked in statistics when it is enabled** +1. Go to /wp-admin/admin.php?page=wc-settings&tab=advanced§ion=features +2. Enable the `Navigation` setting +3. Verify in Tracks that the `wcadmin_settings_change` event is fired with `settings: woocommerce-navigation_enabled` + + +**Scenario 2: Navigation event is tracked in statistics when it is disabled** +1. Go to /wp-admin/admin.php?page=wc-settings&tab=advanced§ion=features +2. Disable the `Navigation` setting +3. Verify in Tracks that the `wcadmin_settings_change` event is fired with `settings: woocommerce-navigation_disabled` + + **Scenario 3: Events are tracked successfully when creating a product from template using the previous walkthrough** 1. **Without** enabling the `woocommerce_products_tour` experiment 2. Open your browser console and make sure tracking is enabled @@ -60,22 +271,7 @@ Note: please find a [recording](https://user-images.githubusercontent.com/278432 9. Observe `wcadmin_walkthrough_product_completed` track -**Scenario 4: Spotlight tour is shown again after skipping it and reloading the page** -1. Go to Tools > WCA Test Helper > Features -2. Enable experimental-product-tour -3. Go to Tools > WCA Test Helper > Experiments -4. Add woocommerce_products_tour to treatment -5. Go to WooCommerce > Home > Add my products > Start with a template > Physical product -6. Observe that spotlight tour is displayed and dismiss it. -7. Switch to the text tab for product description -8. Reload the page -9. Observe that spotlight tour is displayed again -10. Click "next" button -11. Switch to the Visual tab -12. Observe that the spotlight tour is still shown and no typeError is shown in dev tools. - - -**Scenario 5: Events are tracked successfully when creating a product from template using the new walkthrough (spotlight tour)** +**Scenario 4: Events are tracked successfully when creating a product from template using the new walkthrough (spotlight tour)** 1. Enable `experimental-product-tour` 2. Go to Tools > WCA Test Helper > Experiments 3. Add `woocommerce_products_tour` to treatment @@ -90,3 +286,37 @@ Note: please find a [recording](https://user-images.githubusercontent.com/278432 12. Observe `wcadmin_walkthrough_product_completed` track +**Scenario 5: Event should be fired when a user clicks the load sample products cancel button** +1. Go to Tools > WCA Test Helper > Experiments +2. Toggle woocommerce_products_task_layout_stacked to set you to the treatment group. +3. Go to Woocommerce > Home +4. Click "Add my products" +5. Enable track logging `localStorage.setItem( 'debug', 'wc-admin:*' );` in your browser console +6. Click View more product types +7. Click Load Sample Products +8. Click Cancel button +9. It should record a `wcadmin_tasklist_cancel_load_sample_products_click` event + + +**Scenario 6: Event `wcadmin_product_add_publish` should send the props sent for the event `wcadmin_product_updates`** +1. Enter `localStorage.setItem( 'debug', '*' );` in your browser console to enable debug messages +2. Verify in your browser console that the following prop list is being sent correctly for the event wcadmin_product_update. +-- description: Yes|No +-- short_description: Yes|No +-- product_image: Yes|No +-- product_gallery: Int (count of images in the gallery) +-- categories: Int (count of categories) +-- tags: Int (count of tags) +-- sale_price: Yes|No +-- weight: Yes|No +-- dimensions: Yes|No +-- upsells: Yes|No +-- cross-sells: Yes|No +-- attributes: Int (count of attributes) +-- purchase_note: Yes|No +-- menu_order: Yes|No +-- enable_reviews: Yes|No +4. Create a new product. +5. Go to WooCommerce -> Status -> Logs (URL wp-admin/admin.php?page=wc-status&tab=logs). +6. Select a tracks-* log from the dropdown. +7. Verify that the event wcadmin_product_add_publish is sending the props described in step 2 correctly. \ No newline at end of file