Updated Release Testing Instructions WooCommerce 5.7 (markdown)
rodelgc
parent
91b407abd3
commit
58299b72ac
|
|
@ -14,6 +14,156 @@ WooCommerce 5.7 includes:
|
|||
1. Click the Download button.
|
||||
1. Open the downloaded file and confirm the status values match the table.
|
||||
|
||||
The following tests are taken from the [WooCommerce Admin Smoke Test Checklist](https://github.com/woocommerce/woocommerce-admin/wiki/Smoke-Test-Checklist). In each of these tests, we need to make sure that no existing functionalities got broken in this release.
|
||||
|
||||
### Regression test: Onboarding Profile Wizard Flows
|
||||
|
||||
Onboarding can be initialized either by:
|
||||
* Navigating to **WooCommerce** -> **Settings** -> **Help**, and pressing the **Setup Wizard** button.
|
||||
* Using the URL `/wp-admin/admin.php?page=wc-admin&path=%2Fsetup-wizard`.
|
||||
|
||||
On a new test site ( Jurassic Ninja or Atomic Ephmeral ), test out the onboarding flow to ensure no regressions have occurred.
|
||||
|
||||
If using Jurassic Ninja, remove the Jetpack plugin before proceeding.
|
||||
|
||||
<img src="https://i.imgur.com/1IveWGW.png" width="50%"/>
|
||||
|
||||
Note that the first variants are for the non **WooCommerce Admin plugin version**, when just testing WooCommerce.
|
||||
- [ ] Variant A: WooCommerce Payments is listed as a business feature for US or PR based address.
|
||||
- [ ] Variant B: WooCommerce Payments is **not** listed as a business feature for addresses based in BR, ID, VN, PL, NG, GR, BE, PT, DK, SE, and JP.
|
||||
|
||||
When testing any of these onboarding flows, maybe mix it up with some of these options:
|
||||
|
||||
- [ ] Option: Select a paid product type upsell like subscriptions.
|
||||
- [ ] Option: Toggle some extension promotions off
|
||||
- [ ] Option: Select a Paid theme or non-default theme selection
|
||||
- [ ] Option: Go through Jetpack Connection at the end.
|
||||
|
||||
### Regression test: Welcome Modal
|
||||
|
||||
- [ ] Upon completing the onboarding wizard, verify you see the welcome modal on the home screen.
|
||||
<img src="https://i.imgur.com/LTetybH.png" width="50%"/>
|
||||
|
||||
### Regression test: Setup Check List
|
||||
|
||||
If you installed woo in a way that results in the setup check list not to be shown by default, it can be toggled on/off by visiting Settings > Help.
|
||||
|
||||
<img src="https://i.imgur.com/IbTaVVj.png" width="50%"/>
|
||||
|
||||
- [ ] Complete all steps on setup checklist. This has many different options such as payment methods, product entry etc. Try to mix it up a bit!
|
||||
<img src="https://i.imgur.com/UoFkj4c.png" width="50%"/>
|
||||
|
||||
- [ ] Verify the ability to Hide the Setup Checklist also works ( use the help menu above to toggle it on/off )
|
||||
Activity Panel Area
|
||||
<img src="https://i.imgur.com/QNGDmuv.png" width="50%"/>
|
||||
|
||||
- [ ] Verify the display toggle works as expected for 1 or 2 column view
|
||||
- [ ] Verify the Help Menu works as expected
|
||||
|
||||
### Regression test: Store Management Links
|
||||
|
||||
<img src="https://i.imgur.com/IDbVwPN.png" width="50%"/>
|
||||
|
||||
- [ ] Verify they are not shown when setup checklist is being shown
|
||||
- [ ] Verify when setup checklist is done/hidden that the links are shown.
|
||||
|
||||
### Regression test: Stats Overview
|
||||
|
||||
<img src="https://i.imgur.com/R4YrGvS.png" width="50%"/>
|
||||
|
||||
- [ ] Interact with display options and verify they function as expected
|
||||
- [ ] Click on a summary number and confirm you are directed the the appropriate analytics report
|
||||
- [ ] Optional: Connect via Jetpack through this component if shown.
|
||||
|
||||
### Regression test: Inbox
|
||||
|
||||
<img src="https://i.imgur.com/RZucwuW.png" width="50%"/>
|
||||
|
||||
- [ ] Interact with some notes, do an action.
|
||||
- [ ] Dismiss a single note
|
||||
- [ ] Dismiss All Notes
|
||||
|
||||
### Regression test: Task Management Area
|
||||
|
||||
<img src="https://i.imgur.com/xWRI1Fr.png" width="50%"/>
|
||||
|
||||
- [ ] If items are shown, like the orders panel, interact with the component.
|
||||
|
||||
### Regression test: Analytics page
|
||||
|
||||
Verify that going through these flows will also populate data for Analytics testing.
|
||||
|
||||
- [ ] Create a new product
|
||||
- [ ] Edit a product
|
||||
- [ ] Create an order ( front end )
|
||||
- [ ] Create an order ( back end )
|
||||
- [ ] Edit an Order Status
|
||||
- [ ] When on the various admin screens for the above, interact with the Activity Panel links ( Inbox and Help )
|
||||
|
||||
### Regression test: Analytics Overview Page
|
||||
|
||||
Again it is very helpful to have created at least one test order, and updated it to “Complete” to test out the analytics pages.
|
||||
|
||||
With those test orders in mind, perform the following:
|
||||
|
||||
- [ ] Verify the Summary Numbers / Performance Indicators look correct
|
||||
|
||||
<img src="https://i.imgur.com/Z0DpDDX.png" width="50%"/>
|
||||
|
||||
- [ ] Adjust the Date Range filter on the analytics overview page and verify the page updates as expected.
|
||||
- [ ] Interact with the elipsis menu in the Perofrmance Indicators section. Toggle stats on/off, rename seciton, and move the section down.
|
||||
|
||||
<img src="https://i.imgur.com/zJFrzgt.png" width="50%"/>
|
||||
|
||||
- [ ] Under the charts section, toggle between line and bar charts
|
||||
- [ ] Under Leaderboards section, toggle a leaderboard off or on
|
||||
- [ ] Hard refresh the page and verify order changes in sections, names, and summary number, chart, and leaderboard selections are persisted.
|
||||
|
||||
### Regression test: Other Analytics Reports
|
||||
|
||||
Select a report with data and verify basic analytics functionality works.
|
||||
|
||||
- [ ] Interact with date range picker
|
||||
- [ ] Clicking on a summary number adjusts the chart
|
||||
- [ ] Select a long date range, quarter to date, verify you can change the period on the chart
|
||||
- [ ] If applicable search in the table
|
||||
- [ ] Try a CSV download
|
||||
- [ ] Toggle visibility on table columns via ellipsis menu
|
||||
- [ ] Interact with advanced filters
|
||||
|
||||
### Regression test: Analytics Settings
|
||||
|
||||
- [ ] Change settings for Excluded and Actionable statuses
|
||||
- [ ] Adjust default date range
|
||||
- [ ] Save and hard refresh to verify settings have been persisted.
|
||||
|
||||
### Regression test: Help Panel
|
||||
|
||||
The Help panel on Home screen provides links to online documentation hosted on woocommerce.com
|
||||
|
||||
<img src="https://user-images.githubusercontent.com/9312929/109258605-867ef880-7835-11eb-95e1-c8aa9e932058.png" width="50%"/>
|
||||
|
||||
- [ ] Ensure each of the menu items link to appropriate documentation on woocommerce.com.
|
||||
|
||||
### Regression test: Other WooCommerce Admin Functionality
|
||||
|
||||
- [ ] Load the Marketing Overview Page wp-admin/admin.php?page=wc-admin&path=%2Fmarketing
|
||||
- [ ] Load the Customers page wp-admin/admin.php?page=wc-admin&path=%2Fcustomers
|
||||
|
||||
### Regression test: Unsupported WooCommerce Version
|
||||
|
||||
With a new WordPress site, install an unsupported version of WooCommerce. An unsupported version is less than the prerequisite version listed in the [README](https://github.com/woocommerce/woocommerce-admin#prerequisites). Note: .zip Downloads available [here](https://wordpress.org/plugins/woocommerce/advanced/) under Previous Versions.
|
||||
|
||||
- [ ] Try to activate WooCommerce Admin from the WordPress plugin screen. It should immediately deactivate.
|
||||
|
||||
### Regression test: Perform the following tasks with Gutenberg installed
|
||||
|
||||
Install the [Gutenberg plugin](https://wordpress.org/plugins/gutenberg/)
|
||||
|
||||
- [ ] Perform a task from the [Onboarding Profile Wizard Flows](#onboarding-profile-wizard-flows).
|
||||
- [ ] Perform a task from the [Home Screen](#home-screen).
|
||||
- [ ] Perform a task from the [WooCommerce Analytics Flows](#woocommerce-analytics-flows).
|
||||
|
||||
## WooCommerce Blocks Updates:
|
||||
|
||||
When using the testing instructions below, test only those cases presented in the section called "Feature plugin and package inclusion in WooCommerce core". There is no need to test cases in the "Smoke Testing" or "Feature plugin only" section since they are not a part of WooCommerce Core.
|
||||
|
|
|
|||
Loading…
Reference in New Issue