Commit Graph

78 Commits

Author SHA1 Message Date
Rodel Calasagsag f63b8353ee Add support for draft releases 2023-10-14 16:20:33 +08:00
rodelgc c64ae36956
Fix recently failing "API on WP Latest" job in release testing workflow (#40453)
* Add changelog

* Add dedicated PW config and global setup files

* Add step to download chromium

* Specify config and env var

* Fix trivial whitespaces

* Disable Slack notif for now

* Re-enable Slack summary

* Simplify getting major, minor version numbers

* Use single line for response wait
2023-10-11 14:46:46 +08:00
Rodel Calasagsag 6d946930f1 Simplify WP L-1 wp-env setup 2023-09-03 18:19:25 +08:00
Rodel Calasagsag 9d1664b822 Fix input value 2023-09-03 11:55:16 +08:00
Rodel Calasagsag d34fb8b07e Re-enable steps and jobs 2023-09-03 10:56:37 +08:00
Rodel Calasagsag 8463c77765 Add command to verify wp version 2023-09-03 10:31:21 +08:00
Rodel Calasagsag 249f78b4ad Remove step to verify env details 2023-09-03 10:30:36 +08:00
Rodel Calasagsag 6af2632f5f Get only WP L-1 2023-09-03 10:29:42 +08:00
rodelgc be41a3b3dd
In the "Smoke test release" workflow, update `BASE_URL` to `API_BASE_URL` (#39954)
Fix environment variable
2023-08-30 10:24:58 +02:00
Christopher Allford 230bc04050
Updated `wp-env` To 8.0.0 (#38440) 2023-05-26 15:48:48 -07:00
nigeljamesstevenson c99d60647e
E2e/gutenberg latest nightly 0 (#38287) 2023-05-19 12:24:08 +01:00
rodelgc 8114e90703 Enable all jobs in release workflow 2023-05-13 10:12:40 +08:00
rodelgc 68cd32a55e Test Gutenberg and its nightly 2023-05-12 15:38:15 +08:00
rodelgc 68fe31abe4
Send Slack summary of release test results (#38180)
Check out files from WIP branch
2023-05-11 14:29:12 -07:00
rodelgc ef1f1c3757 Re-enable all tests 2023-03-22 19:38:01 +08:00
rodelgc 524ad3db3e Test artifact upload 2023-03-22 19:12:23 +08:00
rodelgc 17ae0a489f Remove test filters 2023-03-22 17:45:09 +08:00
rodelgc 65c698a386 Remove unnecessary dash 2023-03-18 08:37:39 +08:00
rodelgc a80f65cc11 Add run number 2023-03-18 08:36:22 +08:00
rodelgc 45071f2f03 Simplify upload scripts 2023-03-18 08:29:56 +08:00
rodelgc 2110d011ae More accurate step name 2023-03-18 08:02:43 +08:00
rodelgc ad8d2f9b44 More readable artifact names 2023-03-17 20:31:10 +08:00
rodelgc 9503868d71 Set environment descriptions 2023-03-17 20:16:01 +08:00
rodelgc b95b9000ce Fix artifact name 2023-03-17 18:13:43 +08:00
rodelgc bc44562329 Fix dependent job id 2023-03-17 18:07:32 +08:00
rodelgc 6a2239183d Remove install-filters in plugin tests 2023-03-17 17:55:55 +08:00
rodelgc 99e243a347 Shorten job name 2023-03-17 17:53:55 +08:00
rodelgc b7cb3f8284 Correct if condition 2023-03-17 17:52:11 +08:00
rodelgc b2e7478a30 Only run hello API tests 2023-03-17 17:48:26 +08:00
rodelgc f7c7a2c451 Add plugin tests 2023-03-17 17:47:28 +08:00
rodelgc 76dca5548b Use separate files 2023-03-17 15:41:06 +08:00
rodelgc 94eff753be Specify allure report and results dirs 2023-03-16 16:09:53 +08:00
rodelgc be550fec19 Use e2e and api composite actions in wp and php version tests 2023-03-16 15:13:41 +08:00
rodelgc 8b44038699 Run e2e-wp-latest 2023-03-16 13:38:29 +08:00
rodelgc 10029d0007 Skip e2e-wp-latest for now 2023-03-16 11:13:00 +08:00
rodelgc f89dd7e2c5 Use `run-api-tests` action 2023-03-16 11:08:46 +08:00
rodelgc e914281652 Revert to using E2E_WP_LATEST_ARTIFACT 2023-03-16 10:00:49 +08:00
rodelgc 4ca522a16d Fix env var reference 2023-03-16 09:49:28 +08:00
rodelgc 891942ac7c Correct artifact name 2023-03-16 09:45:33 +08:00
rodelgc 71c008eb7e Use e2e composite actions on update wc test 2023-03-16 08:52:33 +08:00
rodelgc b60cc128fd
Allow running of "Smoke test release" on draft releases (#36997)
* Conditionally use authorization token when getting WC Zip download URL.

* Exponse error message

* Handle undefined authorization token more gracefully

* Specify GH token in workflow

* Add changelog

* Use E2E_GH_TOKEN instead of default github.token

* Provide GitHub token to other jobs

* Fix getting of tag name from triggered event

* Use "inputs" context instead

* Add release version to workflow name

* Correct concurrency group

* Fix workflow name

* Add --archive option

* Fix output setting

* Fix script for verifying asset

* Remove unnecessary 'uses' line

* Remove node 12 deprecation messages

* Re-add "published" release type
2023-03-08 10:23:56 +01:00
rodelgc ea1925c841
Enable "Smoke test release" workflow (#36598)
* First pass at updating release test workflow

* Add changelog

* Set dir env variables

* Update to workflow

* Fix indent

* Fix indent

* Clean up indent

* Re-order steps

* Change order of jobs

* Added common php versions

* Update pipeline

* Update some labels

* Simplify for testing

* Update paths

* Create tmp folder

* Fix path

* Paths

* Try outputting some debugging

* Add step ID back

* Remove working directory

* Another path tweak

* Add API release tests

* Add k6 tests

* Add PHP tests

* Launch wp-env during PHP tests

* Try default values

* Tweak some settings, add WP testing

* Tweak some settings

* Re-order e2e steps

* Update step descriptions

* Reorganize tests, add plugin tests

* Enable only e2e job

* Initial set up to run against release smoke test site

* Fix syntax

* Temporarily disable update wc spec

* Temporarily disable downloading woocommerce zip

* Download release zip using tag name

* Fix wrong job name

* Fix wrong job name

* Fix dir

* Delete fetch-asset-id.js

* REfactor update-woocommerce spec

* Add error handling

* Download release zip by tag

* Refactor update woo spec to download zip by tag

* Correct job name

* fail test on invalid tag

* Enable all e2e tests

* Run api tests before e2e tests

* Fix job dependency

* Add customer credentials to api job

* Separate job for WC Update

* Combine e2e allure-results, then report

* Enable report job

* Fix context

* Change job and artifact names

* Use test s3 path

* Minor job name change

* Upload artifacts to bucket

* Correct s3 path

* Add quiet option

* Retain video on failures

* Finalize s3 path

* Try WP latest-1

* Revert to wp latest

* Refine search for woocommerce zip asset

* Get created-at

* Specify repo in gh command

* Slugify env description

* Trim space

* Sync with bucket instead of copy

* Remove invalid --recursive flag

* Re-add missing step to combine e2e results from update wc test

* Ensure artifact upload on test failure

* Enable all e2e tests on WP latest

* Retain existing data before updating WC

* Make test compatible with 'Canceled' and 'Cancelled'

* Set env_desc as env var

* Re-add deleted file

* Fix UPDATE_WC in daily smoke test workflow

* Add tracing in global setup

* Remove tracing

* Temporarily run only basic spec

* Job for WP Latest-1 & 2

* Fix "Required input 'created_at' not provided"

* Minor rename

* Remove install filter

* Install deps in get-wp-matrix

* Delete get-wp-versions.js

* Add get-wp-versions.js to e2e-pw folder

* REname file

* REfactor

* Refactor script for getting WP prev versions

* Update job dependencies

* Temporarily remove disabled jobs

* Allow e2e-wp-latest after api test failure

* Update L-1 & L-2 job deps

* Fix report-wp-latest

* Fix failing api test

* Make get-wp-versions quicker

* Publish report immediately after test

* Test reporting in e2e-update-wc

* Fix missing parameter

* Fix env_desc, re-enable other jobs

* Enable all e2e tests

* Minor job name change

* Fix flaky test

* Add php version testing

* stringify php versions

* Re-enable all e2e tests

* Up timeout to 2min

* Remove PHP 8.0

* Add missing conditionals

* Fix php version verification script

* Fix starting dir

* Fix flakiness

* Skip e2e if api failed

* Verify woocommerce.zip early

* Add token

* Delete test summary on github for the meantime

* Use default playwright config

* More meaningful variable names

* Update step titles based on review

* Use expect.poll()

* Minor spacing corrections

* Use `stable-check` endpoint, delete unnecessary loop

* Update locators to be JN-compatible

* Fix erroneous getting of release tag

* Fix conflict of "No thanks" button locator with that of WP Mail Logging's

* Update github-script action to v6

* Revert to 'Cancelled'

* Remove unnecessary step

* Provide missing env variables

---------

Co-authored-by: Jon Lane <jon.lane@automattic.com>
Co-authored-by: Jonathan Lane <lanej0@users.noreply.github.com>
2023-02-27 12:11:46 +08:00
Roy Ho 16386238cc
Add minimum required permissions for workflow token (#36200)
* Add minimum required permissions to e2e-tests

* Add minimum token permission to more workflows
2023-01-02 09:28:11 -08:00
Christopher Allford a49f23abfd
Optimize Workflow Caching (#34607)
* Added Monorepo Setup Action

This action will handle the installation, building, and caching for all
projects within the monorepo. It has inputs for skipping builds and
filtering so that only specific packages are installed and built.

* Removed Test Caching

Caching the results of tests, while an interesting way to avoid
unnecessary execution, seems error-prone. We can't adequately
capture the environment such that we can rely on this working.
For instance, changes in PHP version might break PHPUnit tests,
but, cached runs will be shared across different workflows.

It seems better to just not cache it and rely on people only testing
code that has actually changed in the pull request.

* Added Input Parsing

This SHOULD allow for passing multiple filters as an array argument.

* Updated Workflows

This fully utilizes the new action across all of the workflows.

* Always Cache Build Output

Since there may be other commands run that populate the cache, we
should make sure that we are always caching just in case.
2022-09-13 13:55:03 +12:00
Christopher Allford b7931409f2
Migrate From Nx to Turborepo (#33079)
This replaces all `nx` commands with `turbo` commands and removes Nx from the repository. All of the `project.json` files have been removed and any commands that broke with Turborepo have been adjusted.
2022-06-09 14:40:07 -07:00
roykho c92650df2b
Add paths input for install build workflow 2022-05-19 08:29:38 -07:00
roykho 1042f22cf8
Extract cache and build to rest of workflows 2022-05-17 11:48:24 -07:00
roykho 7056cf93b6
Add additional pnpm cache dir 2022-05-16 06:01:53 -07:00
roykho cf5c47eb09
Cache Composer global store 2022-05-13 13:43:33 -07:00
roykho 8f9957f0d4
Fix smoke test on release 2022-05-12 07:12:29 -07:00