Steve-Dee-Designs
/
woocommerce
mirror of https://github.com/woocommerce/woocommerce.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Updated Release Testing Instructions (markdown)

Julia Amosova 2020-04-30 14:53:55 -04:00
parent 4847f3529a
commit 6582287650
1 changed files with 2 additions and 260 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

262
Release-Testing-Instructions.md

@ -1,7 +1,7 @@
## Table of Contents
- [4.1](#41)
- [4.0](#40)
- [4.0](https://github.com/woocommerce/woocommerce/wiki/Release-Testing-Instructions-WooCommerce-4.0)
- [3.9](https://github.com/woocommerce/woocommerce/wiki/Release-Testing-Instructions-WooCommerce-3.9)
- [3.8](https://github.com/woocommerce/woocommerce/wiki/Release-Testing-Instructions-WooCommerce-3.8)
@ -372,262 +372,4 @@ Screenshot showing how to add code snippet via Code Snippets plugin is below:
![](https://cldup.com/ViCncdyNWL.jpg)
This is the end of testing instructions for WooCommerce 4.1. Thanks for testing!
# 4.0
WooCommerce 4.0 includes 3 main features:
- Action Scheduler 3.0
- WooCommerce Admin
- New Onboarding Experience
It also contains several bug fixes and enhancements that we would like to be tested as well.
### Action Scheduler 3.0
In this release, there is an upgrade of the Action Scheduler library to [Action Scheduler 3.0](https://woocommerce.wordpress.com/2020/01/08/action-scheduler-3-0/). This upgrade is a new, more performant version of Action Scheduler which utilizes custom tables to provide a good experience even on stores with large volumes of orders and posts in the database. This should considerably reduce the load on the standard WordPress database tables while enabling advanced analytics to run even on large stores.
The main thing we want to test is that everything keeps working as usual after the upgrade.
There are 2 ways to test Action Scheduler. Feel free to pick the one you feel more comfortable with:
* Basic
* Advanced
_Basic:_
1) **Make sure you run WooCommerce 3.9.2 on your site and don't have WooCommerce Admin plugin installed;**
2) Set up a [Webhook](https://docs.woocommerce.com/document/webhooks/) delivery URL via [https://webhook.site](https://webhook.site). The URL will be created automatically as soon as you visit the site. Copy the URL to clipboard:
![](https://cldup.com/5XRhermX7w.jpg)
3) Create a Webhook in WooCommerce by navigating to `WooCommerce > Settings > Advanced > Webhooks`:
- Name: `Action Scheduler Test Webhook`
- Status: `Active`
- Topic: `Order updated`
- Delivery URL: paste the URL you copied in the previous step on `https://webhook.site`
- Secret: `test`
- API Version: `WP REST API Integration v3`
- Save
Your Webhook data should look as follows:
![](https://cldup.com/-hACKvwfrG.jpg)
4) Next, navigate to any order on your site and change order status. For example, from `processing` to `completed`;
5) The hook should be fired off which can be checked on the `https://webhook.site`:
![](https://cldup.com/Fhieu1lP_o.jpg)
6) Check error logs by navigating to `WooCommerce / Status / Logs` and selecting `webhooks delivery` log in the dropdown field. Verify that your hook firing was logged and that there are no errors:
![](https://cldup.com/0y_dujaamO.jpg)
7) **Update WooCommerce to beta version 4.0** and repeat the steps 4-6 (you can use the same webhook);
8) Make sure the hook fires and that there are no errors in the logs.
_Advanced:_
* For more thorough testing, generate a lot of orders. You can use [WC Smooth Generator](https://github.com/woocommerce/wc-smooth-generator) to create fake customers, products, and orders.
* Repeat steps 1-3 from _Basic_ testing instructions;
* Install [WooCommerce Admin](https://wordpress.org/plugins/woocommerce-admin/) plugin and start processing data by navigating to `Analytics > Settings`:
![](https://cldup.com/KuAs_fYAm2.jpg)
* While the data is being processed, update WooCommerce to beta version 4.0;
* Check the logs after the data is done processing. There should be no errors in the logs.
### WooCommerce Admin
The new version of [WooCommerce Admin plugin is included in this release](https://woocommerce.wordpress.com/2020/01/31/woocommerce-4-0-is-coming/). WooCommerce Admin is a new JavaScript-driven interface for managing your WooCommerce stores that is focusing on creating new and improved reports, and a dashboard to monitor all the important key metrics of your site.
**To test you will need to have WordPress 5.3+. Store running older versions of WordPress will have WooCommerce Admin automatically disabled.**
This testing assumes upgrading WooCommerce to version 4.0 on the existing site with no WooCommerce Admin plugin installed.
As the WooCommerce Admin plugin is now included in WooCommerce 4.0 you should no longer see a prompt to install it in WP Admin. This prompt usually appears at the top of WP-Admin on any WooCommerce page:
![](https://cldup.com/6NesXLmN5l.png)
As we are merging all of the existing WooCommerce Admin functionality you may want to test all areas of it including:
* _WooCommerce / Dashboard:_
* Navigate to `WooCommerce / Dashboard`;
* Go through each step to set up the store - make sure you can complete each step successfully:
![](https://cldup.com/e6KEBk-zeO.jpg)
* _Analytics:_
There is a brand new section with all kinds of analytics available. Please check a couple of reports to make sure they match what you expect. For example, you can check how many orders you received in February via `Analytics / Orders` (note that amounts shown are `net`):
![](https://cldup.com/JWeGSBbGPn.jpg)
And compare it to what you see on the `All Orders` view via `WooCommerce / Orders`. Note that in order to compare net amounts, you'd need to open each order on the page:
![](https://cldup.com/-wFf6B3Jh4.jpg)
* _Inbox:_
* Navigate to `WooCommerce / Dashboard`;
* Click on `Inbox` on the panel in the top right corner;
* Go through each option available via `Inbox` - make sure you can complete each step successfully:
![](https://cldup.com/25XCwxxrPk.jpg)
* _Orders:_
* Navigate to `WooCommerce / Dashboard`;
* Click on `Orders` on the panel in the top right corner;
* Proceed through actions available via `Orders` - such as `Begin fulfillment`;
* Make sure you can complete each step successfully.
* _Stock:_
* Navigate to `WooCommerce / Dashboard`;
* Click on `Stock` on the panel in the top right corner;
* Update stock of several products;
* Navigate to each of the products individually to make sure that stock was updated.
* _Reviews:_
* Leave reviews on several products on your site;
* Navigate to `WooCommerce / Dashboard`;
* Click on `Reviews` on the panel in the top right corner;
* Proceed through the options available such as `Manage` review;
* Make sure you can complete each step successfully.
* _Notices:_
Your site may not have any notices (not all the sites do at any given moment) but if it does, you can test them as follows:
* Navigate to `WooCommerce / Dashboard`;
* Click on `Notices` on the panel in the top right corner;
* Make sure that notices get displayed. It could a notice letting you know that your site needs a Database update, for example:
![](https://cldup.com/stxFu6UBt7.jpg)
### New Onboarding Experience
This release adds an a/b test to the setup wizard, which for 50% of users will allow opt-in to the new WooCommerce Admin onboarding experience. This allows us to test our changes, prior to launching for all new users next year.
**Note that the new onboarding experience is available on sites running WordPress 5.3+.**
For users in the test group, the WooCommerce Admin installation step is done before anything else, and the user is redirected to the new onboarding experience after install.
To test:
- Go to `/wp-admin/admin.php?page=wc-setup` and try your luck with the a/b test logic. If you are part of the 50% that gets selected for the `a` (control) old version, you should just see the normal setup wizard with no changes as shown below:
![](https://cldup.com/jhDZMAPt6C.png)
- Update the `woocommerce_setup_ab_wc_admin_onboarding` option in your database to `b` to enable new onboarding experience. The easiest way to do that is by using the snippet that you can find [here](https://gist.github.com/justinshreve/6e945dcb4714134156aba1b3c7f086cf). You can implement the snippet using the [Code Snippets](https://en-gb.wordpress.org/plugins/code-snippets/) plugin;
- Go back to `/wp-admin/admin.php?page=wc-setup` - you should now see the new onboarding prompt screen that looks like this:
![](https://cldup.com/5W8rmAxdx0.png)
- Test the continue/skip link and make sure you can use the normal setup wizard;
- Go back to `/wp-admin/admin.php?page=wc-setup` once again, and click `Yes Please`;
- You should be redirected to the start of the new onboarding experience;
- Go through the new Setup Wizard and make sure you can complete all the steps successfully.
### Additional enhancements
In addition to the above, we have also included the following user-facing enhancements and bug fixes in WooCommerce 4.0:
**1) Changed the shipping options to not calculate until shipping address details are provided**
To test:
* Navigate to `WooCommerce / Settings / General` and make sure `Store Address` is filled out with a test location of your choice and `Default customer location` is set to `No location by default`.
![](https://cldup.com/sQ1gWuPZXT.png)
* Navigate to `WooCommerce / Settings / Shipping` and set up some shipping zones with flat rate shipping methods
![](https://cldup.com/LNmXhRiuV6.png)
* Using your browser's incognito mode add any non-virtual product to your cart and view the cart. You will be prompted to enter your address to see shipping options as the store is not aware of your location due to the `Default customer location` being set to `No location by default`
![](https://cldup.com/SlP3VdTcpv.png)
* Enter address details that match one of the shipping zones you have.
![](https://cldup.com/n0dmUSJMAU.png)
* Shipping options will update and match what you specified for the shipping zone
![](https://cldup.com/erH2vVFHUi.png)
* Test further by repeating these steps but changing the `Default customer location` in `WooCommerce / Settings / General` to the other options and make sure the shipping options displayed match.
For example if you set `Default customer location` to `Shop base address` and you already have a shipping zone for your store address you should see in the cart the correct shipping option for that zone with the option to calculate shipping for your own address.
![](https://cldup.com/MuedUwdeNW.png)
**2) Enhancements and extra information on order details**
To test:
* Create a new order that has a mixture of items, discounts, shipping, taxes etc.
* Open that order in `WooCommerce / Orders`
* Verify that the cost of the line items now displays their gross amount (before any discounts are applied) This makes it easier to understand how a discount is being applied on a line by line basis.
* Verify the new information on the screen is present
* `Items Subtotal:` and `Order Total`
* Displays `Paid by Customer` with the amount paid on a new line below the order total
* Verify the totals are correct
![](https://cldup.com/vpYF_BWrGV.png)
* Refund part or all of the order
* Verify the new information on the screen is present
* It displays the total amount refunded below "Paid by customer" along with a new net payment amount
![](https://cldup.com/8QVybJha2J.png)
* Repeat this testing for different payment methods and combinations of items, discounts, shipping, taxes and if you are using plugins that can add fees.
![](https://cldup.com/MniPwRmFwq.png)
**3) Fix for duplicate webhook deliveries**
Previously there was a possibility that WooCommerce may sometimes trigger multiple webhook deliveries for a single webhook if the webhook topic has multiple hooks. The fix means only one delivery will now happen.
To test:
* Navigate to `Appearance / Theme Editor` and select the `Theme Functions (functions.php)` file for editing.
* Add this line of code to instruct your WooCommerce installation to delivery webhooks synchronously:
`add_filter( 'woocommerce_webhook_deliver_async', '__return_false' );`
* Save your changes by clicking `Update File`
![](https://cldup.com/pSakbQRWDh.png)
* Set up a [Webhook](https://docs.woocommerce.com/document/webhooks/) delivery URL via [https://webhook.site](https://webhook.site). The URL will be created automatically as soon as you visit the site. Copy the URL to clipboard:
![](https://cldup.com/AWF8dDEKWw.png)
* Navigate to `WooCommerce > Settings > Advanced > Webhooks`:
![](https://cldup.com/Wp_cQgoior.png)
* Create a new Webhook, choosing a webhook topic that has multiple hooks defined. For example, Customer Created (which has 3 defined).
- Name: `Testing webhook delivery fix`
- Status: `Active`
- Topic: `Customer created`
- Delivery URL: paste the URL you copied in the previous step on `https://webhook.site`
- Secret: `test`
- API Version: `WP REST API Integration v3`
- Save
![](https://cldup.com/GxbdC_wf9x.png)
* Navigate to `Users / Add New` and manually create a customer in your WooCommerce Store (use `Role` of `Customer`)
![](https://cldup.com/cWJ4mK3JAw.png)
* The hook should be fired off which can be checked on the [https://webhook.site](https://webhook.site)
* Check error logs by navigating to `WooCommerce / Status / Logs` and selecting `webhooks delivery` log in the dropdown field. Verify that the customer was delivered once (not 3 times):
![](https://cldup.com/Ns7fPuhiCn.png)
This is the end of testing instructions for WooCommerce 4.1. Thanks for testing!