Commit Graph

857 Commits

Author SHA1 Message Date
Adrian Moldovan 7b96dfca67
[e2e tests] Remove BuildKite reporter (#47449)
* Remove BuildKite reporter

* Changelog

* Remove BuildKite reporter from api tests
2024-05-14 10:25:17 +01:00
Adrian Moldovan 4ba770cbba
Update concurrency group for community label workflow (#47355) 2024-05-13 17:49:08 +03:00
Bart Kalisz 30756f74e3
Blocks E2E: Refactor configs and workflow (#46409) 2024-05-13 14:58:26 +02:00
nigeljamesstevenson 0cd8740a85
Ensure the cherry pick operation only executes against `trunk` (#47312)
* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-release-highlight-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update README.md

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update cherry pick workflow to only execute against trunk

* Update workflow to add safety checks before accessing nested properties

* Update workflow to add safety checks before accessing nested properties

* log outputs for debugging

* log outputs for debugging

* log outputs for debugging

* log outputs for debugging

* log outputs for debugging

* log outputs for debugging

* log outputs for debugging

* sync files pre PR
2024-05-11 22:15:53 +01:00
nigeljamesstevenson 1ce0f14de2
Update/workflow for rest api slack notifications (#47278)
* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-release-highlight-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update README.md

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* Update test-assistant-api-rest-change-tracker.yml

* update readme.md

* workflow updates

* Add script to determine milestone date

* udpate workflow

* udpate workflow

* Update to ensure variable is added to

* Update release highlight workflow

* Update workflows to ensure repo is checked out before referencing script
2024-05-11 21:14:06 +01:00
Adrian Moldovan 981fca33d6
[testing workflows] Fix for multi-line commit message not triggering tests (#47353) 2024-05-10 10:12:36 -03:00
Adrian Moldovan a9e7acf04f
Use @octokit/action and @actions/core versions instead of latest workflows (#47348) 2024-05-10 10:10:41 -03:00
Jonathan Lane 396c29d3ec
Install and set up BuildKite test analytics (#47202)
Co-authored-by: Jon Lane <jon.lane@automattic.com>
Co-authored-by: Adrian Moldovan <3854374+adimoldovan@users.noreply.github.com>
2024-05-10 11:47:23 +03:00
Sam Seay 54eba223b8
Add a basic blueprint to create WP Playground previews for pull requests. (#46761) 2024-05-09 17:30:35 +12:00
dependabot[bot] 98a77e0715
Bump tj-actions/changed-files from 37 to 41 in /.github/workflows (#43223)
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 37 to 41.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v37...v41)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-07 09:27:28 -07:00
Adrian Moldovan de91a0881d
[ci-jobs] Add support for github event and include HPOS disabled e2e tests in ci (#46922)
* Update env setup script to disable hpos

* Use DISABLE_HPOS instead of ENABLE_HPOS

* Log HPOS state

* Configure project for core e2e with HPOS disabled

* Add event argument for ci-jobs util

* Add event option for test jobs

* Add support for github events

* Add changelog

* Configure HPOS tests to run on pull_request

* Fix utils tests for undefined commandVars

* Added some tests for the event configuration

* Revert event for HPOS e2e to push

* Use matrix name in artifact name to avoid duplication

* Test with pull_request event

* Use job-index for unique artifacts names

* Revert event for HPOS e2e to push

* Add api tests for HPOS disabled

* Use unique artifact name for api tests

* Revert event for HPOS disabled api tests to push

* Rebuild monorepo utils to fix a merge conflict

* Updated wording
2024-05-01 10:36:24 -07:00
Adrian Moldovan b95293a99a
[e2e workflows] Increase actions timeout to 90 minutes for faily and release workflows (#47049) 2024-04-30 09:13:59 -07:00
Adrian Moldovan dc2cf822f2
[e2e tests] Update max failures number to 90 (#47019) 2024-04-29 16:38:38 +03:00
dependabot[bot] 3d8e20c62c
Bump octokit from 2.1.0 to 3.1.2 (#42891)
* Bump octokit from 2.1.0 to 3.1.2

Bumps [octokit](https://github.com/octokit/octokit.js) from 2.1.0 to 3.1.2.
- [Release notes](https://github.com/octokit/octokit.js/releases)
- [Commits](https://github.com/octokit/octokit.js/compare/v2.1.0...v3.1.2)

---
updated-dependencies:
- dependency-name: octokit
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Rename env variable

* Add changelog

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-04-26 10:52:25 -03:00
Adrian Moldovan d57ff87cb3
[e2e tests] Fix blocks tests failing with Gutenberg active (#46842)
* Fix plugin slug for reporting

* Comment out setting of woocommerce_coming_soon

* Add canvas utility

* Update create-cart-block.spec.js to use canvas instead of page

* Update create-checkout-block.spec.js to use canvas instead of page

* Extract common editor actions into editor utils

* Add changelog

* Update post and page creation tests to use canvas

* Update create-woocommerce-blocks.spec.js to use canvas

* Activate Gutenberg to test changes

* Remove plugins listing from env setup script

* Fix eslint errors

* Remove redundant env setup script call

* Install Gutenberg for test in CI

* Test with Gutenberg

* Remove Gutenberg

* Fix block editor variable product test

* Revert "Fix block editor variable product test"

This reverts commit cd004530a7.

---------

Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-04-23 13:38:19 -07:00
nigeljamesstevenson aba7cb753b
Update test-assistant-api-rest-change-tracker.yml 2024-04-22 13:28:25 +01:00
nigeljamesstevenson ab7d2dbb01
Update test-assistant-release-highlight-tracker.yml 2024-04-22 13:28:14 +01:00
Leif Singer d1be68b88c
Update @woo.com email addresses to @woocommerce.com (#46387)
* update @woo.com email addresses

* update %40woo.com email address

* add changelog file

* update docs manifest
2024-04-19 21:11:01 +00:00
Jonathan Lane 87ac3d2c85
Add stalebot for flaky e2e test reporter (#46585)
* Add flaky test reporter for flaky e2e test reporter

* Add to stalebot workflow instead

* Update stale action to 9 for node 20

---------

Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-04-17 11:03:12 -03:00
Ron Rennick 9cd793abbc
revert change to community assignment workflow (#46681) 2024-04-17 14:07:50 +01:00
Jonathan Lane 9888ee7f4b
Updated deprecated gh-script action to node 20 variant (#46673)
* Updated deprecated gh-script action to node 20 variant

* Minor change in e2e test to trigger CI

* Revert e2e test change

---------

Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-04-17 12:31:16 +01:00
Adrian Moldovan bed3124b8d
[testing workflows] Fix the plugins setup for daily e2e runs (#46511)
* Move daily site check workflow to deprecated

* Add install-plugin script

* Install plugins script

* Fix the script path, it was moved.

* Set env on job level

* Update working-directory

* Add changelog

* Use the right WC_SUBSCRIPTIONS_REPO variable

* Add a test channel id

* Update smoke-test-daily.yml

* Remove WC Subscriptions

* Update smoke-test-daily.yml

* Switch back the channel ID and remove pull_request trigger
2024-04-13 10:12:48 -07:00
Ron Rennick 4fa2e3822c
Update the monorepo to node v20 (#45148)
* test bumping node to v18

* remove community contributor condition from review assignment

* Add changefile(s) from automation for the following project(s): @woocommerce/tracks, @woocommerce/onboarding, @woocommerce/number, @woocommerce/notices, @woocommerce/navigation, @woocommerce/internal-js-tests, @woocommerce/extend-cart-checkout-block, @woocommerce/expression-evaluation, @woocommerce/explat, @woocommerce/experimental, @woocommerce/eslint-plugin, @woocommerce/dependency-extraction-webpack-plugin, @woocommerce/date, @woocommerce/data, @woocommerce/customer-effort-score, @woocommerce/currency, @woocommerce/csv-export, @woocommerce/create-woo-extension, @woocommerce/create-product-editor-block, @woocommerce/components, @woocommerce/api, @woocommerce/admin-e2e-tests, woocommerce-blocks, woocommerce-beta-tester, woocommerce, woo-ai

* bump node to v20

* Add changefile(s) from automation for the following project(s): @woocommerce/tracks, @woocommerce/onboarding, @woocommerce/number, @woocommerce/notices, @woocommerce/navigation, @woocommerce/internal-js-tests, @woocommerce/extend-cart-checkout-block, @woocommerce/expression-evaluation, @woocommerce/explat, @woocommerce/experimental, @woocommerce/eslint-plugin, @woocommerce/dependency-extraction-webpack-plugin, @woocommerce/date, @woocommerce/data, @woocommerce/customer-effort-score, @woocommerce/currency, @woocommerce/csv-export, @woocommerce/create-woo-extension, @woocommerce/create-product-editor-block, @woocommerce/components, @woocommerce/api, @woocommerce/admin-e2e-tests, packages/php/remote-specs-validation, woocommerce-blocks, woocommerce-beta-tester, woocommerce, woo-ai

* Add changefile(s) from automation for the following project(s): @woocommerce/tracks, @woocommerce/onboarding, @woocommerce/number, @woocommerce/notices, @woocommerce/navigation, @woocommerce/internal-js-tests, @woocommerce/extend-cart-checkout-block, @woocommerce/expression-evaluation, @woocommerce/explat, @woocommerce/experimental, @woocommerce/eslint-plugin, @woocommerce/dependency-extraction-webpack-plugin, @woocommerce/date, @woocommerce/data, @woocommerce/customer-effort-score, @woocommerce/currency, @woocommerce/csv-export, @woocommerce/create-woo-extension, @woocommerce/create-product-editor-block, @woocommerce/components, @woocommerce/api, @woocommerce/admin-e2e-tests, woocommerce-blocks, woocommerce-beta-tester, woocommerce, woo-ai

* add blocks eslint-plugin-woocommerce to project workspace

* add e2e-environment as a peer to e2e-utils

* restore version on @woocommerce/api

* update lock file

* move e2e-environment to devDependencies

* add undefined location check to admin js test

---------

Co-authored-by: Ron Rennick <ronald.rennick@automattic.com>
Co-authored-by: github-actions <github-actions@github.com>
2024-04-12 13:49:55 -03:00
Adrian Moldovan 1fee0439d3
[testing workflows] Move metrics job to ci.yml (#46471)
* Move deprecated workflows to deprecated folder

* Configure new test job for metrics

* Add changelog

* Update start command

* Update start command

* Archive metrics results

* Fix script path

* Fix name in archive results condition

* Add the actual run command for pull_request event

* Run with pnpm --filter

* Test run for push event

* Revert test conditions

* Add WP_ARTIFACTS_PATH env variable

* Update path to readme.txt

* Revert github event conditions

* Add CODEVITALS_PROJECT_TOKEN env

* Set WP_ARTIFACTS_PATH on job level

* Add blocks templates in the changes list
2024-04-12 11:46:01 -03:00
Job 28e78fd655
Default to docs and forums (#46520)
* Update triage-replies.yml

we want to default towards docs and forums

* Update 1-bug-report.yml
2024-04-12 09:24:35 +00:00
Adrian Moldovan 9df545046a
[test reporting] Include list of failed tests in Slack notifications (#46360) 2024-04-10 10:10:08 +03:00
Leif Singer 8ee74ede0e
Update Woo.com references to WooCommerce.com (#46259)
* replace capitalized Woo.com with WooCommerce.com

* replace http URLs

* replace https URLs

* replace developer.woo.com

* add missing version in `@since` tag

* unslash the HTTP_REFERER

* WordPress.Security.ValidatedSanitizedInput.InputNotSanitized

* add changelog file

* add more changelog files

* address linter errors

* address more linter errors

* fix test

* more linter errors
2024-04-09 09:50:15 +01:00
Ron Rennick e9dff60e95
update labels in non-hpos daily workflow (#46246)
Co-authored-by: Ron Rennick <ronald.rennick@automattic.com>
2024-04-05 11:04:47 +03:00
Jonathan Lane 4bce1da492
Update workflow to close support issues as "won't fix/not planned" (#46202)
Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-04-04 09:31:53 +03:00
Adrian Moldovan 4e9fc5a90f
[testing workflows] Tweak conditions for Slack alerts and reports publishing jobs (#46031) 2024-04-02 14:40:24 -03:00
Adrian Moldovan 7d6d2c94dd
Include e2e, api and performance tests in ci.yml (#45190)
Co-authored-by: Christopher Allford <6451942+ObliviousHarmony@users.noreply.github.com>
Co-authored-by: Ron Rennick <ron@ronandandrea.com>
2024-03-27 17:21:49 +02:00
Ron Rennick f8f94fa13a
skip PR live build on non-plugin changes (#45891)
Co-authored-by: Ron Rennick <ronald.rennick@automattic.com>
2024-03-26 10:35:22 +02:00
Adrian Moldovan e117bc6457
[e2e tests workflows] Fix merge reports depends on unknown job in HPOS disabled workflow (#45823) 2024-03-25 11:07:25 +00:00
Adrian Moldovan e9777de4aa
Update concurrency group for pr label workflow (#45793) 2024-03-22 12:51:28 -03:00
Adrian Moldovan de90c5f46e
[e2e tests workflows] Run non HPOS e2e tests on push instead of PR (#45746)
* Run non HPOS e2e tests on push instead of PR

* Removed evaluate job and renamed workflow
2024-03-21 10:21:37 -07:00
Alejandro López Ariza 1a8ec1c0c2
Update code freeze GH Actions workflow to upload the woocommerce packages to the R2 bucket on code freeze. (#45393)
* Update code freeze GH Actions workflow to upload the woocommerce packages to the R2 bucket on code freeze.

* Make the job that uploads WooCommerce release packages to the R2 bucket independent from the Slack integration in release-code-freeze.yml workflow.
2024-03-15 08:38:47 +01:00
Ron Rennick 93c7ebfed4
exclude gglobalstep from community contributors automation (#45492)
Co-authored-by: Ron Rennick <ronald.rennick@automattic.com>
2024-03-13 11:08:04 +02:00
Bart Kalisz ed6c7ea1e9
Blocks E2E: Make the workflow self-trigger (#45391) 2024-03-07 20:32:58 +01:00
jonathansadowski 41bb2ba0ad
Add workflow with cron for testing against WP nightly (#45260) 2024-03-07 11:12:13 -08:00
Bart Kalisz 211b6ef01b
Blocks E2E: Be more descriptive with the workflow job titles (#45381) 2024-03-07 13:32:29 +00:00
Bart Kalisz 9a14411937
Blocks E2E: Allow manually triggering the workflow (#45382) 2024-03-07 14:01:22 +01:00
Luigi Teschio 26c19fa1f8
Revert "[e2e tests blocks] Configure the number of shards for each ma… (#45324)
* Revert "[e2e tests blocks] Configure the number of shards for each matrix project (#45212)"

This reverts commit 72789656cf.

* trigger CI

* run E2E tests

* restore ci.yml file

* trigger E2E tests

* disable E2E tests about mini cart translations

* Add changefile(s) from automation for the following project(s): woocommerce-blocks

* Fix the setupAndFetchQueryContextURL utility

* add comment

* Remove obsolete test

* Blocks E2E: Update timeout values (#45353)

Set timeout values same as core

---------

Co-authored-by: github-actions <github-actions@github.com>
Co-authored-by: Bart Kalisz <bartlomiej.kalisz@gmail.com>
2024-03-06 16:52:37 +00:00
nigeljamesstevenson 75f037e31e
Update test-assistant-release-highlight-tracker.yml 2024-03-05 01:08:15 +00:00
Jonathan Lane 0cb1782342
Explicitly clear out customers before testing (#45229)
Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-03-01 15:03:03 +02:00
Jonathan Lane bf43cf7e37
Update workflow to use latest checkout actions (#45199)
* Update workflow to use latest checkout actions

* Update non-HPOS workflow as well

* Update additional actions

* Set a slow test threshold at 30 seconds (15 is default)

* Final action updates

* Slow tests has to be an object

* Pin external actions to commit

* Slow test threshold and max

---------

Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-02-29 18:58:28 -04:00
Adrian Moldovan 72789656cf
[e2e tests blocks] Configure the number of shards for each matrix project (#45212)
* Reduce the shards from 5 to 2 for blocks e2e tests

* Include the workflow in paths

* More granular shard config

* Refine shards config
2024-02-29 11:50:17 -08:00
Adrian Moldovan 5401d143a4
Fix K6 tests run on PR merge to trunk (#45139)
* Update workflow to use the same setup as for PRs

* Skip K6 job is PR is not merged
2024-02-29 11:45:12 -08:00
nigeljamesstevenson 7ad4ef8e4d
Update test-assistant-release-highlight-tracker.yml 2024-02-27 12:26:37 +00:00
Ron Rennick d1afc4abe4
exclude dependabot from commmunity contributor label (#44861)
* exclude dependabot from commmunity contributor label

* use prior art from block repo

---------

Co-authored-by: Ron Rennick <ronald.rennick@automattic.com>
2024-02-22 15:37:07 -04:00
Ron Rennick 6524f639b4
exclude tests folders from template version linting (#44721)
Co-authored-by: Ron Rennick <ronald.rennick@automattic.com>
2024-02-22 15:05:28 -04:00