Commit Graph

630 Commits

Author SHA1 Message Date
rodelgc 46300131ff
Correct `UPDATE_WC` value in the "Smoke test daily" workflow (#37049)
* Correct UPDATE_WC value

* Add changelog
2023-03-03 13:58:21 +01:00
Paul Sealock da1dce8f19
Package Release: handle initial release case (#36922) 2023-02-28 09:36:38 +13:00
rodelgc ea1925c841
Enable "Smoke test release" workflow (#36598)
* First pass at updating release test workflow

* Add changelog

* Set dir env variables

* Update to workflow

* Fix indent

* Fix indent

* Clean up indent

* Re-order steps

* Change order of jobs

* Added common php versions

* Update pipeline

* Update some labels

* Simplify for testing

* Update paths

* Create tmp folder

* Fix path

* Paths

* Try outputting some debugging

* Add step ID back

* Remove working directory

* Another path tweak

* Add API release tests

* Add k6 tests

* Add PHP tests

* Launch wp-env during PHP tests

* Try default values

* Tweak some settings, add WP testing

* Tweak some settings

* Re-order e2e steps

* Update step descriptions

* Reorganize tests, add plugin tests

* Enable only e2e job

* Initial set up to run against release smoke test site

* Fix syntax

* Temporarily disable update wc spec

* Temporarily disable downloading woocommerce zip

* Download release zip using tag name

* Fix wrong job name

* Fix wrong job name

* Fix dir

* Delete fetch-asset-id.js

* REfactor update-woocommerce spec

* Add error handling

* Download release zip by tag

* Refactor update woo spec to download zip by tag

* Correct job name

* fail test on invalid tag

* Enable all e2e tests

* Run api tests before e2e tests

* Fix job dependency

* Add customer credentials to api job

* Separate job for WC Update

* Combine e2e allure-results, then report

* Enable report job

* Fix context

* Change job and artifact names

* Use test s3 path

* Minor job name change

* Upload artifacts to bucket

* Correct s3 path

* Add quiet option

* Retain video on failures

* Finalize s3 path

* Try WP latest-1

* Revert to wp latest

* Refine search for woocommerce zip asset

* Get created-at

* Specify repo in gh command

* Slugify env description

* Trim space

* Sync with bucket instead of copy

* Remove invalid --recursive flag

* Re-add missing step to combine e2e results from update wc test

* Ensure artifact upload on test failure

* Enable all e2e tests on WP latest

* Retain existing data before updating WC

* Make test compatible with 'Canceled' and 'Cancelled'

* Set env_desc as env var

* Re-add deleted file

* Fix UPDATE_WC in daily smoke test workflow

* Add tracing in global setup

* Remove tracing

* Temporarily run only basic spec

* Job for WP Latest-1 & 2

* Fix "Required input 'created_at' not provided"

* Minor rename

* Remove install filter

* Install deps in get-wp-matrix

* Delete get-wp-versions.js

* Add get-wp-versions.js to e2e-pw folder

* REname file

* REfactor

* Refactor script for getting WP prev versions

* Update job dependencies

* Temporarily remove disabled jobs

* Allow e2e-wp-latest after api test failure

* Update L-1 & L-2 job deps

* Fix report-wp-latest

* Fix failing api test

* Make get-wp-versions quicker

* Publish report immediately after test

* Test reporting in e2e-update-wc

* Fix missing parameter

* Fix env_desc, re-enable other jobs

* Enable all e2e tests

* Minor job name change

* Fix flaky test

* Add php version testing

* stringify php versions

* Re-enable all e2e tests

* Up timeout to 2min

* Remove PHP 8.0

* Add missing conditionals

* Fix php version verification script

* Fix starting dir

* Fix flakiness

* Skip e2e if api failed

* Verify woocommerce.zip early

* Add token

* Delete test summary on github for the meantime

* Use default playwright config

* More meaningful variable names

* Update step titles based on review

* Use expect.poll()

* Minor spacing corrections

* Use `stable-check` endpoint, delete unnecessary loop

* Update locators to be JN-compatible

* Fix erroneous getting of release tag

* Fix conflict of "No thanks" button locator with that of WP Mail Logging's

* Update github-script action to v6

* Revert to 'Cancelled'

* Remove unnecessary step

* Provide missing env variables

---------

Co-authored-by: Jon Lane <jon.lane@automattic.com>
Co-authored-by: Jonathan Lane <lanej0@users.noreply.github.com>
2023-02-27 12:11:46 +08:00
Alejandro López Ariza 7fdd0f496f
Remove check to skip testing instructions if needed in PR template and add final check to confirm that testing instructions were added. (#36916)
* Remove check to skip testing instructions if needed from PR template and add final check to confirm that testing instructions were added.

* Update Pull Request template documentation to be consistent with the removal of the checkbox to skip testing instructions.

---------

Co-authored-by: Jonathan Lane <lanej0@users.noreply.github.com>
2023-02-22 15:00:58 -08:00
Leif Singer 1b74871bae
Assign milestone only if a PR touches WooCommerce Core (#36897)
* Assign milestone only if a PR touches WooCommerce Core

* add woocommerce-admin to list of paths
2023-02-21 18:21:29 +01:00
jonathansadowski e8a170165a
Update the release date for code freeze action readme generation (#36877)
Update the release date for code freeze action
2023-02-20 18:00:14 +13:00
Sam Seay 79fa0b9413
Fix permissions for NPM package prepare script (#36732)
Contents write is needed to write to pull requests.
2023-02-14 00:27:50 +13:00
Alejandro López Ariza 3681b84a4c
Add checkbox to the pull request template to ask the PR author to read the testing instructions guide before writing them. (#36577) 2023-02-13 11:34:22 +01:00
nigeljamesstevenson 7c84271ee2
update smoke test daily workflow to run api tests first (#36494) 2023-02-02 12:04:47 +00:00
nigeljamesstevenson add0c4a5be update after code review 2023-01-31 16:29:15 +00:00
Sam Seay 341541964c
Update action dependencies to remove set-output and save-state warnings (#36549) 2023-01-27 20:26:54 +13:00
Sam Seay 5eb13f89bc
Update the pnpm setup action in workflows to remove Node.js 12 deprecation warnings (#36547) 2023-01-24 15:44:31 +13:00
nigeljamesstevenson 7cf1599208 update smoke test daily workflow to run api tests first 2023-01-18 17:12:55 +00:00
Vedanshu Jain 8079c157bc Remove commented out code for cleaniliness. 2023-01-18 13:03:17 +05:30
Sam Seay d181008ac4
Fix TS issues and lint the release post tool by running `tsc` (#36412) 2023-01-18 18:43:22 +13:00
Sam Seay b1f80c1271
Create a manually triggered workflow to release WooCommerce Beta Tester (#36387) 2023-01-18 18:42:46 +13:00
Roy Ho d935b0137a
Add necessary permissions for code freeze workflows (#36399)
* Add necessary permissions for code freeze workflows

* Checkout pnpm-lock.yaml to prevent issues
2023-01-16 06:12:25 -08:00
Néstor Soriano 443b563335
Upgrade PHPUnit to v8 and stop using patched PHPUnit 7 for PHP 8 (#36273)
* Upgrade PHPUnit to v8, and remove usage of PHPUnit7 fork in CI

Once the minimum WordPress version supported by WooCommerce is 5.9
and the minimum PHP version supported is 7.2, we can switch to
PHPUnit 7 and the patched PHPUnit 7 with support for PHP 8 is
no longer needed.

* Resolve PHPUnit 8 deprecations in tests

* Add changelog file

* Fix code formatting
2023-01-16 20:58:09 +13:00
Sam Seay 262b2ecebd
Don't run CI checks on PRs that are just changelog changes (#36280) 2023-01-12 14:09:36 +13:00
Vedanshu Jain 475f21a985 Disable posting comment since it conflicts with normal E2E report comment. 2023-01-11 10:19:25 +05:30
Vedanshu Jain b3bd207baa Enable COT Tests for all PRs. 2023-01-11 09:31:11 +05:30
Roy Ho 929fd09fb6
Add permissions to issues endpoint (#36344) 2023-01-09 12:43:33 -08:00
Roy Ho 422b24770b
Add workflow for bumping wp l-2 version support (#36312) 2023-01-09 05:36:54 -08:00
Roy Ho 25f051cad2
Add PR write permissions (#36263) 2023-01-02 20:56:06 -08:00
Roy Ho 16386238cc
Add minimum required permissions for workflow token (#36200)
* Add minimum required permissions to e2e-tests

* Add minimum token permission to more workflows
2023-01-02 09:28:11 -08:00
rodelgc 3daeac9a69
Migrate E2E daily shopper tests (#35873)
Enable shopper E2E tests on Daily smoke test workflow
2022-12-28 18:28:17 +08:00
Vedanshu Jain 34ac47969c
Add cherry-pick support for git merge strategy. (#35927)
* Add changelog.

* Add merge strategy support to cherry-picker tool.
2022-12-22 09:26:14 +05:30
jonathansadowski bea954c2e5
Update code-freeze actions to Monday 22 days before release (#36023)
* Update code-freeze actions to Monday 22 days before release

* Fix incorrect params in workflow dispatch
2022-12-20 10:51:41 -06:00
rodelgc c4260c935f
Consistent folder structure for E2E and API test results (#35907)
Consistent folder structure for E2E and REST API test results
2022-12-19 14:33:22 +08:00
Sam Seay 03d52ff13b
Another set of migrations from set-output to GITHUB_OUTPUT (#35843)
Co-authored-by: Roy Ho <roykho77@gmail.com>
2022-12-16 11:41:03 +13:00
Sam Seay 7224c76053
Add a set_output function to script that uses the new GITHUB_OUTPUT (#35894) 2022-12-13 10:27:42 +13:00
rodelgc 93b6d358f4
Migrate merchant daily smoke tests to Playwright (#35492)
* Checkout files

* Remove reverted permalinks code

* Enable cron

* More accurate job names

* More accurate test summary title
2022-12-06 11:22:49 +08:00
Sam Seay 43143b848f
Remove some usages of set-output (#35799)
* Migrate straight script usage of set-output to write to GITHUB_OUTPUT
* Use file_put_contents in php scripts to set GITHUB_OUTPUT
2022-12-06 09:35:49 +13:00
Paul Sealock 2c03d6cc82
Live Branches: Avoid running job on community PRs (#35795) 2022-12-06 06:28:02 +13:00
Roy Ho aa96739964
Add s flag to show sniff codes (#35802) 2022-12-05 06:21:26 -08:00
Sam Seay 659894f851
Use workflow dispatch that now works with GITHUB_TOKEN (#35705) 2022-12-01 21:36:26 +13:00
Jonathan Lane fd7fc355fa
Fix/e2e environment test failures (#35679) 2022-11-22 16:16:42 -07:00
jonathansadowski 973961fbd5
Add workflow for building live branches (#35344)
* Add workflow for building live branches

* Fix inadvertent newline

* Only run on PR for default types
2022-11-15 13:58:27 -06:00
jonathansadowski f9e7a5a3fb
Increase timeout for changelogger (#35584) 2022-11-15 09:05:09 -06:00
Roy Ho 9d6fe84b47
Fail check when template updated without version (#35510)
* Fail check when template updated without version

* Update logic
2022-11-09 08:39:22 -08:00
Roy Ho 254fbd994f
Remove post merge comment about adding testing instructions (#35498) 2022-11-04 11:39:13 -07:00
Roy Ho ce133089b9
Fix random failing changelog entry (#35425) 2022-11-04 09:11:26 -07:00
Paul Sealock 19f0410bc1
PHPCS: Lint only changes (#35407)
Add `sirbrillig/phpcs-changed` to run PHPCS only on changes, not entire files
2022-11-01 07:53:01 +13:00
Alejandro López Ariza 4cb9bc45c4
Updated COT plugin used to set up the local environment with COT enabled. (#34990)
* Updated COT plugin used to set up the local environment with COT enabled.

* Enable HPOS in the e2e environment using env var (#35057)

* Updated COT plugin used to set up the local environment with COT enabled.

* Used env var to enable HPOS

* Disable HPOS for performance tests

* Updated permissions

* Set ENABLE_HPOS to 1

Co-authored-by: Alex López <alex.lopez@automattic.com>

Co-authored-by: Jamel Noel Reid <MrJnrman@users.noreply.github.com>
2022-10-26 09:29:41 -07:00
Chi-Hsuan Huang 1e94d3fc18
Fix changelog command in PR template (#35326) 2022-10-26 11:38:01 +08:00
jonathansadowski 1807fb20a4
Fix reference to HEAD to work with community PRs (#35315) 2022-10-25 16:36:46 -05:00
Sam Seay 197c43e557
Remove phpcs Github action in favor of running phpcs directly (#35237) 2022-10-25 20:17:38 +13:00
rodelgc 39b472be7a
Set paths for `allure-results`, `test-results.json`, and save state files to be inside their respective E2E or API folders (#35206)
* Set paths to e2e-pw

* Delete and untrack storage state files

* Add changelog

* Checkout updated version of smoke test daily workflow

* Allow setting allure output paths to e2e-pw folder using environment variables

* Set allure output paths to be inside api-core-tests/api-test-report folder

* Remove unnecessary TODO comment
2022-10-24 16:53:46 -07:00
jonathansadowski c6313abfd1
Update the config for assignment of community PRs (#35161)
* Update project-community-pr-assigner.yml

* Remove extraneous comment, add beta-tester to assignment config

* Update .github/project-community-pr-assigner.yml

Co-authored-by: Adrian Duffell <9312929+adrianduffell@users.noreply.github.com>

* Update .github/project-community-pr-assigner.yml

Co-authored-by: Adrian Duffell <9312929+adrianduffell@users.noreply.github.com>

* Update .github/project-community-pr-assigner.yml

Co-authored-by: Adrian Duffell <9312929+adrianduffell@users.noreply.github.com>

* Update .github/project-community-pr-assigner.yml

Co-authored-by: Adrian Duffell <9312929+adrianduffell@users.noreply.github.com>

* Update .github/project-community-pr-assigner.yml

Co-authored-by: Adrian Duffell <9312929+adrianduffell@users.noreply.github.com>

* Update .github/project-community-pr-assigner.yml

Co-authored-by: Adrian Duffell <9312929+adrianduffell@users.noreply.github.com>

Co-authored-by: Adrian Duffell <9312929+adrianduffell@users.noreply.github.com>
2022-10-24 10:35:18 -05:00
rodelgc 64320a2c5c
Migrate Daily smoke tests to Playwright (#35114)
* Checkout updated files

* Checkout more files

* Remove invalid php-version input

* Add changelog

* Update pnpm-lock.yaml

* Re-add accidentally deleted filter value

* Remove unnecessary TODO comment
2022-10-21 09:07:53 -07:00