Commit Graph

90 Commits

Author SHA1 Message Date
Jamel Noel Reid 40dbc1f924
Update CI to use wp-env for api, e2e and performance tests (#34311)
* Renamed e2e to e2e-legacy

* Moved e2e folder to tests/e2e

* Updated gitignore

* Updted init script to work with wp-env

* Updated readme

* Updated commands to match new test structure

* Updated workflow to work with new test structure

* Added changelog

* turned off alternate wp cron in test

* Fixed path to playwright config

* Renamed e2e to e2e-pw

* Renamed e2e-legacy to e2e

* Updated e2e-pw path

* Fixed workflow

* Fixed csv test

* Updated .gitignore

* Removed puppeteer specific step
2022-08-15 11:47:53 -07:00
Lucas Bustamante edd453c40b
Skip test result generation and upload in forks (#34023)
* Skip test result generation and upload in forks

* Generate test report in fork
2022-07-21 11:49:25 -06:00
Lucas Bustamante 4ffd5992a9
Reduce e2e flakiness in CI (#33979) 2022-07-19 11:28:15 -06:00
rodelgc 9e576c2208
Upload API and E2E test reports to S3 bucket (#33843)
* Simplify if expression

* Call the new workflow in Woo Test Reports repo for publishing PR test reports

* Rename Playwright-related steps

* Archive Puppeteer screenshots only when Playwright flag is off

* Correct step name and if condition in Puppeteer steps

* Run only a single Playwright test for testing

* Correct workflow name

* Add commit message as input

* Remove invalid COMMIT_MESSAGE input

* Add root_dir input

* Update s3 root dir input

* Update link to full E2E test report

* Re-enable all Playwright tests
2022-07-14 14:15:20 -07:00
Jonathan Lane 0cebdf5277
Convert e2e tests to Playwright (#33462)
* Final updates for Playwright

* Update config

* Add uuid dependency

* Increase retries to 2

* Update selectors on shipping page

* Use baseURL instead of hard-coded URL for API

* Clarify comment

* Use baseURL instead of hard-coded URL

* Check to see if an order was created before attempting to delete it

* Add changelog

* Turn on Playwright tests in GitHub

* Increase timeout for CI execution

* Update configuration options (minor edit)

* Fix for checkout flaky test

* Parse orderId from URL

* Check for substring

* Streamline email tests

* Remove .only

* Only clear email logs of messages for test

* Get orderId from page element

* Fix for test not waiting for reset

* Add in second wait for Performance section

* Change significance from minor to patch

Co-authored-by: Jon Lane <jon.lane@automattic.com>
2022-07-06 14:28:00 -06:00
rodelgc aed4763414
Post test result summary in workflow run and in PR comment using github-actions[bot] (#33675)
* Temporarily toggle Playwright feature flag on

* Add job for test summary

* Add dummy run command

* Debug object contents

* Test getting json from prev step output

* Try toJSON()

* Test access to keys

* Try using context

* Use separate file

* Debug steps

* Try dummy job summary

* Minor job rename

* Add script for preparing job summary

* Fix context syntax error

* Correct artifact path

* List contents of artifacts folder

* inspect API summary contents

* inspect apisummary

* Remove dummy step for listing artifacts folder contents

* Parse number to string

* Correct SHA

* Try printing job summary on next step

* Create PR comment

* Minor step rename to test PR comment update

* Add another line break

* Test for puppeteer tests

* Test full Playwright test run

* Test full Puppeteer e2e run

* Fix spacing inconsistency

* Specify other test result categories in PPTR run

* Rename script file

* Minor refactor and documentation on script file

* Minor addition to script documentation
2022-07-06 11:17:51 -06:00
Jon Lane cb36fe8d50 Change flag back 2022-05-25 10:21:17 -07:00
Jon Lane 06d0e7a876 Test feature flag for Playwright 2022-05-25 10:19:50 -07:00
Rodel f69d8ba6cb Toggle flag off 2022-05-24 14:45:02 +08:00
Rodel 54ff88ffd7 Change step name 2022-05-24 14:44:10 +08:00
Rodel ed70a94a07 Install chromium browser only 2022-05-24 14:06:23 +08:00
Rodel a84d96afc7 Remove extra spaces 2022-05-24 13:31:59 +08:00
Rodel cb1910ab18 Change flag scope to workflow level 2022-05-24 13:27:53 +08:00
Rodel d1a5df46e6 Correct trigger for "Archive e2e report" step 2022-05-24 13:13:48 +08:00
Rodel fb51e5dfc2 Use flag on publish reports job 2022-05-24 13:11:12 +08:00
Rodel f279202ee8 Improve readability of if condition 2022-05-24 12:47:00 +08:00
Rodel 89a3924512 Remove unnecessary step id 2022-05-24 12:37:54 +08:00
Rodel abd4c5e683 Correct if conditions 2022-05-24 12:36:57 +08:00
Rodel c9ebaa22c2 Set flag to literal boolean value 2022-05-24 11:19:52 +08:00
Rodel 2a6554be94 Change variable assignment 2022-05-20 16:58:29 +08:00
Rodel 3407b2d0ad Remove unnecessary brackets 2022-05-20 16:39:38 +08:00
Rodel 08d34968ce Try correcting boolean value assignment 2022-05-20 16:38:59 +08:00
Rodel 40d04ff1b8 Ignore archiving of playwright test report when files were not generated 2022-05-20 16:32:04 +08:00
Rodel 4474e08ff9 Correct bad line break 2022-05-20 16:19:57 +08:00
Rodel 018677e35b Add step to generate e2e report on CI 2022-05-20 16:08:49 +08:00
Rodel b2a61a760c Add step to install playwright supported browsers 2022-05-20 16:05:12 +08:00
Rodel 0c826bf22d Change VM in Publish test reports job 2022-05-20 14:41:49 +08:00
Rodel a53e61c836 Implement Playwright feature flag in PR test workflow 2022-05-20 14:37:25 +08:00
rodelgc 7e49c151b7
Update publish-test-reports if condition (#33085)
Prevent running the "Publish test report" job when none of the tests ran
2022-05-19 11:20:33 +08:00
roykho 1042f22cf8
Extract cache and build to rest of workflows 2022-05-17 11:48:24 -07:00
roykho f4cf7899e7
Extract out caching step 2022-05-17 09:26:08 -07:00
roykho 916c285bc5
Remove redundant checkout step 2022-05-17 07:21:39 -07:00
roykho fa47ab3f8e
Add composite install and build action 2022-05-17 06:24:49 -07:00
roykho 73ba1e591f
Add composite install and build action 2022-05-17 06:20:23 -07:00
jonathansadowski 779ce5c23e
Merge pull request #33038 from woocommerce/update/workflow-cache
Cache Composer global store
2022-05-16 10:22:12 -05:00
roykho 7056cf93b6
Add additional pnpm cache dir 2022-05-16 06:01:53 -07:00
rodelgc 6cda659980
Publish API test reports to GitHub Pages
- Added workflow to publish API tests
2022-05-16 17:59:40 +08:00
roykho cf5c47eb09
Cache Composer global store 2022-05-13 13:43:33 -07:00
roykho ab58263e80
Add unique secrets cache key to enable clearing of cache 2022-05-04 15:20:31 -07:00
roykho a632ca67fd
Lock build script php version environment for consistency 2022-05-03 14:04:52 -07:00
roykho 45a036f35b
Match minor and patch 2022-05-02 10:08:52 -07:00
roykho f2e4a686f1
Lock pnpm to specific version 2022-05-02 09:39:40 -07:00
roykho 6f61dd8088
Update cache paths 2022-04-27 09:05:01 -07:00
roykho e1499a1772
Update port 2022-04-27 07:45:10 -07:00
roykho 6a447065d8
Fix paths and cache composer 2022-04-27 07:29:33 -07:00
roykho e5bdd3fcd3
Refactor workflows to remove action-build step 2022-04-27 06:40:37 -07:00
roykho 57c1c0bc1c
Freeze Ubuntu release to 20.04 for best practice and consistency 2022-04-26 18:28:56 -07:00
Roy Ho 018da05414
Merge branch 'trunk' into workflow/caching-3 2022-04-21 10:29:24 -07:00
roykho bd23093c42
Refactor caching for workflows 2022-04-21 09:45:12 -07:00
Joel T 1c162a14d2 Updating all instances of pnpx to pnpm dlx/exec 2022-04-07 17:52:05 -07:00