* First pass at updating release test workflow
* Add changelog
* Set dir env variables
* Update to workflow
* Fix indent
* Fix indent
* Clean up indent
* Re-order steps
* Change order of jobs
* Added common php versions
* Update pipeline
* Update some labels
* Simplify for testing
* Update paths
* Create tmp folder
* Fix path
* Paths
* Try outputting some debugging
* Add step ID back
* Remove working directory
* Another path tweak
* Add API release tests
* Add k6 tests
* Add PHP tests
* Launch wp-env during PHP tests
* Try default values
* Tweak some settings, add WP testing
* Tweak some settings
* Re-order e2e steps
* Update step descriptions
* Reorganize tests, add plugin tests
* Enable only e2e job
* Initial set up to run against release smoke test site
* Fix syntax
* Temporarily disable update wc spec
* Temporarily disable downloading woocommerce zip
* Download release zip using tag name
* Fix wrong job name
* Fix wrong job name
* Fix dir
* Delete fetch-asset-id.js
* REfactor update-woocommerce spec
* Add error handling
* Download release zip by tag
* Refactor update woo spec to download zip by tag
* Correct job name
* fail test on invalid tag
* Enable all e2e tests
* Run api tests before e2e tests
* Fix job dependency
* Add customer credentials to api job
* Separate job for WC Update
* Combine e2e allure-results, then report
* Enable report job
* Fix context
* Change job and artifact names
* Use test s3 path
* Minor job name change
* Upload artifacts to bucket
* Correct s3 path
* Add quiet option
* Retain video on failures
* Finalize s3 path
* Try WP latest-1
* Revert to wp latest
* Refine search for woocommerce zip asset
* Get created-at
* Specify repo in gh command
* Slugify env description
* Trim space
* Sync with bucket instead of copy
* Remove invalid --recursive flag
* Re-add missing step to combine e2e results from update wc test
* Ensure artifact upload on test failure
* Enable all e2e tests on WP latest
* Retain existing data before updating WC
* Make test compatible with 'Canceled' and 'Cancelled'
* Set env_desc as env var
* Re-add deleted file
* Fix UPDATE_WC in daily smoke test workflow
* Add tracing in global setup
* Remove tracing
* Temporarily run only basic spec
* Job for WP Latest-1 & 2
* Fix "Required input 'created_at' not provided"
* Minor rename
* Remove install filter
* Install deps in get-wp-matrix
* Delete get-wp-versions.js
* Add get-wp-versions.js to e2e-pw folder
* REname file
* REfactor
* Refactor script for getting WP prev versions
* Update job dependencies
* Temporarily remove disabled jobs
* Allow e2e-wp-latest after api test failure
* Update L-1 & L-2 job deps
* Fix report-wp-latest
* Fix failing api test
* Make get-wp-versions quicker
* Publish report immediately after test
* Test reporting in e2e-update-wc
* Fix missing parameter
* Fix env_desc, re-enable other jobs
* Enable all e2e tests
* Minor job name change
* Fix flaky test
* Add php version testing
* stringify php versions
* Re-enable all e2e tests
* Up timeout to 2min
* Remove PHP 8.0
* Add missing conditionals
* Fix php version verification script
* Fix starting dir
* Fix flakiness
* Skip e2e if api failed
* Verify woocommerce.zip early
* Add token
* Delete test summary on github for the meantime
* Use default playwright config
* More meaningful variable names
* Update step titles based on review
* Use expect.poll()
* Minor spacing corrections
* Use `stable-check` endpoint, delete unnecessary loop
* Update locators to be JN-compatible
* Fix erroneous getting of release tag
* Fix conflict of "No thanks" button locator with that of WP Mail Logging's
* Update github-script action to v6
* Revert to 'Cancelled'
* Remove unnecessary step
* Provide missing env variables
---------
Co-authored-by: Jon Lane <jon.lane@automattic.com>
Co-authored-by: Jonathan Lane <lanej0@users.noreply.github.com>
* Set paths to e2e-pw
* Delete and untrack storage state files
* Add changelog
* Checkout updated version of smoke test daily workflow
* Allow setting allure output paths to e2e-pw folder using environment variables
* Set allure output paths to be inside api-core-tests/api-test-report folder
* Remove unnecessary TODO comment
* Remove -- -- from scripts that fixed issue in pnpm 6, fix a couple TS issues in sep packages
* Minor fixes to analyzer scripts and doco based on pnpm 7
* Add dompurify types to data package to avoid TS errors
* Remove pnpx in favor of pnpm exec
* Modify the code analyzer to respect pnpm version if present.
* Update instructions for running recursive lint, add comments to explain
* Added Monorepo Setup Action
This action will handle the installation, building, and caching for all
projects within the monorepo. It has inputs for skipping builds and
filtering so that only specific packages are installed and built.
* Removed Test Caching
Caching the results of tests, while an interesting way to avoid
unnecessary execution, seems error-prone. We can't adequately
capture the environment such that we can rely on this working.
For instance, changes in PHP version might break PHPUnit tests,
but, cached runs will be shared across different workflows.
It seems better to just not cache it and rely on people only testing
code that has actually changed in the pull request.
* Added Input Parsing
This SHOULD allow for passing multiple filters as an array argument.
* Updated Workflows
This fully utilizes the new action across all of the workflows.
* Always Cache Build Output
Since there may be other commands run that populate the cache, we
should make sure that we are always caching just in case.
This replaces all `nx` commands with `turbo` commands and removes Nx from the repository. All of the `project.json` files have been removed and any commands that broke with Turborepo have been adjusted.
* Separate job for api test
* Remove unnecessary comment
* Use ubuntu 20.04 in job "publish-test-report"
* Simplify syntax in "if" condition
* Temporarily add push trigger for testing
* Temporarily disable running jest e2e tests for testing
* Remove unnecessary OR operator
* try: disable certain jobs for testing
* try: run 'hello' api test for testing
* Implement timeout override in API tests
* Allow workflow to override timeout of api tests
* Correct parsing of timeout override
* try: temporarily disable e2e job
* try: make api test verbose for troubleshooting
* try: temporarily disable some install steps for testing
* Correct smoke test env vars
* try: run all api tests
* Re-enable install-build steps
* Correct smoke test env var values
* Temporarily disable running all e2e tests after WC upgrade
* Remove unnecessary flag for daily smoke test runs
* Use different workflow for publishing daily smoke test report
* Use env vars instead of github expressions in accessing job outputs
* Correct multiline syntax
* Correct api_artifact input value
* Take only the first line of commit message
* Correct passing of input value
* Re-enable jobs before submitting for review
* Separate job for api test
* Remove unnecessary comment
* Use ubuntu 20.04 in job "publish-test-report"
* Simplify syntax in "if" condition
* Temporarily add push trigger for testing
* Temporarily disable running jest e2e tests for testing
* Remove unnecessary OR operator
* try: disable certain jobs for testing
* try: run 'hello' api test for testing
* Implement timeout override in API tests
* Allow workflow to override timeout of api tests
* Correct parsing of timeout override
* try: temporarily disable e2e job
* try: make api test verbose for troubleshooting
* try: temporarily disable some install steps for testing
* Correct smoke test env vars
* try: run all api tests
* Re-enable install-build steps
* Correct smoke test env var values
* Temporarily disable running all e2e tests after WC upgrade
* Remove unnecessary flag for daily smoke test runs
* Use different workflow for publishing daily smoke test report
* Use env vars instead of github expressions in accessing job outputs
* Correct multiline syntax
* Correct api_artifact input value
* Take only the first line of commit message
* Correct passing of input value
* Re-enable jobs before submitting for review
* Add push trigger for final testing
* Re-enable e2e tests, remove push trigger before merge
* Fix spacing
* Correct slack channel id
rodelgc
nigeljamesstevenson
Roy Ho
Sam Seay
Christopher Allford
Tam Mullen
jonathansadowski
Jon Lane
Joel T
jamelreid
Greg
Ron Rennick