Commit Graph

1164 Commits

Author SHA1 Message Date
Jonathan Lane 2e69e94028
Exclude skipped e2e tests from auto-closure (#51528)
Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-09-19 09:02:04 +02:00
jonathansadowski bd1bbfd63c
Update upload- and download-artifact versions in workflows (#51073)
* Update build zip workflow fo upload artifact v4

* Update download- and upload-artifact to v4 in code freeze workflow
2024-09-17 09:16:29 -05:00
louwie17 ad8a25bd63
Add cron for Storybook pages - daily at 2:30 UTC (#51445)
Add cron for storybook pages - daily at 2:30 UTC
2024-09-17 11:11:54 -03:00
Vladimir Reznichenko b98236a25e
[dev] CI: experimental version of performance metrics job (#51276) 2024-09-17 14:32:01 +02:00
Adrian Moldovan 79b8a40157
Update nighty build workflow (#51328) 2024-09-16 12:11:15 +03:00
jonathansadowski 9c81006156
Update team flux PR review assignments (#51241) 2024-09-10 12:13:24 -05:00
louwie17 cf4f76ecfb
Add Storybook GitHub workflow for publishing to GH pages (#51235)
* Add storybook workflow

* Update version and add trigger for push on trunk

* Add workflow_dispatch for manual trigger also

* Add permissions

* Add trigger for current branch

* Set install to true for monorepo setup

* Add write permissions

* Use hashes for GH action versions and add --quiet for building storybook

* Remove on push trigger for now
2024-09-10 12:19:57 -03:00
nigeljamesstevenson 474d0209ea
Update test-assistant-api-rest-change-tracker.yml 2024-08-28 19:08:19 +01:00
nigeljamesstevenson 8a0babc660
Update test-assistant-api-rest-change-tracker.yml 2024-08-28 18:37:13 +01:00
nigeljamesstevenson a5b8e92f3c
Update test-assistant-api-rest-change-tracker.yml 2024-08-28 18:26:08 +01:00
Adrian Moldovan cfdaa7e6cb
[testing workflows] Fix undefined BuildKite Analytics message (#50641) 2024-08-16 09:50:03 -07:00
louwie17 9fa6c20a24
Remove Mothra from community PR assigner (#50670) 2024-08-16 08:36:11 -03:00
Adrian Moldovan 8c9c784f45
Tweak stalebot settings for flaky tests issues (#50630) 2024-08-15 13:54:44 +01:00
Bart Kalisz 03049e0d17
Fix Metrics job (#50482) 2024-08-13 11:31:39 +02:00
Adrian Moldovan ff347bdcd4
[testing workflow] Disable shards when re-running failed tests (#50492) 2024-08-09 13:49:19 +03:00
Chi-Hsuan Huang 7b86ec137e
Fix broken beta tester release GH action (#50465)
* Test beta tester action

* Test beta tester action

* Fix beta tester release action
2024-08-08 16:33:11 +08:00
Adrian Moldovan a3161244b3
[test workflows] Add LAST_FAILED_RUN switch (#50452) 2024-08-07 21:57:36 +03:00
Jason Kytros 58d7467f31
Prevent 'PR highlight changes' from running for blockified templates (#50439) 2024-08-07 13:59:25 +02:00
Adrian Moldovan 81e5d24d3d
[testing workflows] Fix artifacts path for blocks e2e (#50432) 2024-08-07 11:08:30 +03:00
Vladimir Reznichenko f147bd9764
CI: consolidate 'pnpm/action-setup' version and it's usage (#50261)
In this PR we spin off usage of recently introduced packageManager-property across CI workflows and consolidate the version of pnpm/action-setup action we are using.
2024-08-07 09:04:24 +02:00
Adrian Moldovan adbdcceb28
[testing workflows] Only re-run failed e2e tests (#50267)
* Use Playwright's last info run

* Add changelog

* Fix workflow syntax

* Fix workflow syntax

* Try with continue-on-error

* Try with merge-multiple

* Try with pattern instead of name

* Print the run command

* Print the run command

* Use LAST_RUN_FLAG

* Update outputDir

* Update upload paths and parse the file content

* Don't try to download lat run info if the test type is not e2e

* Rename the downloaded file

* Rename the downloaded file

* Rename the downloaded file

* Full path to the downloaded file

* Check download path content

* Check download path content

* Check the last-run file in the right path

* Fail different tests on different run attempts

* Fix artifact name

* Force test failures

* Cleanup console logs

* Cleanup console logs

* Cleanup console logs

* Log if last run info exists but no tests are found

* Revert test changes
2024-08-06 14:50:25 -07:00
Adrian Moldovan e9146f5ba4
[testing workflows] Update concurrency group for CI workflow (#50407) 2024-08-06 15:18:56 +02:00
Adrian Moldovan 657a3fb99a
[testing workflows] Update concurrency to not cancel the workflow when running on trunk (#50397) 2024-08-06 13:39:57 +03:00
Bart Kalisz 52119dfcc9
Fix CI Metrics job (#50214) 2024-08-06 11:23:04 +02:00
Vladimir Reznichenko db51f54694
Monorepo: added instructions on how to update report flaky tests action. (#50366) 2024-08-05 17:01:04 +02:00
Vladimir Reznichenko 559c91626c
CI: minor speed boost for Check Asset Sizes and Build Project Jobs. (#50342) 2024-08-05 12:58:39 +02:00
Vladimir Reznichenko a3f4d722b9
CI: speedup 'Check Asset Sizes' job (take 3) (#50178)
* CI: attempt 3 to speedup 'Check Asset Sizes' job.

* CI: cleanup

* CI: changelog entry.
2024-08-01 14:15:10 -07:00
Vladimir Reznichenko 8da5a91842
CI: speedup 'Build Project Jobs' (#50197)
In this PR, we use shallow checkout if the environment provides no base_ref, which is needed for identifying changed files. If no ref provided, we are not able to calculate the diff and therefore go with faster shallow copy.
2024-08-01 14:18:08 +02:00
Adrian Moldovan 0ba308247a
[testing workflows] Add pre-release checks (#50204) 2024-08-01 13:48:58 +02:00
Adrian Moldovan 017fe40928
[testing workflows] Use choices for on-demand test run input (#50170) 2024-07-31 10:48:14 -07:00
Vladimir Reznichenko 045919d107
CI: git checkout speed tweaks in linting jobs. (#50169) 2024-07-31 14:31:41 +02:00
Vladimir Reznichenko 4b90743ada
CI: add some comments to CI-workflow about intended jobs generation strategy. (#50114) 2024-07-31 08:46:55 +02:00
Jonathan Lane 31c4ae8431
Adds concurrency limit to workflow run (#50034)
Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-07-29 16:25:26 +03:00
Vladimir Reznichenko 63c77caf95
CI: improve monorepo setup time in PHPUnit and API tests. (#50032)
In this PR we introduce a new installation logic aiming only PHPUnit and API test jobs as part of monorepo setup.
2024-07-29 13:01:58 +02:00
Adrian Moldovan c12cb6ccdf
[tests] Move API core tests as a suite in e2e-pw (#50024) 2024-07-29 13:51:36 +03:00
Adrian Moldovan f06302bbb5
[testing workflows] Harden the run condition for reporting jobs to only run in the monorepo (#50017) 2024-07-26 12:40:14 +01:00
Vladimir Reznichenko 5a37ae4333
CI: tweaks around 'Build Live Branch' job start conditions. (#50005)
The PR scope was reduced to filtering out the `.github` folder from target changes, except the workflow itself. It should reduce the amount of the job runs when we are working with GitHub actions related files.
2024-07-26 11:41:10 +02:00
Vladimir Reznichenko 2d6811e689
CI: speedup 'Check Asset Sizes' job (take 2) (#49992) 2024-07-26 11:21:58 +02:00
Adrian Moldovan d40b2ced59
[ci] Fix automate team reviewer workflow (#49904) 2024-07-24 13:23:53 +02:00
Vladimir Reznichenko 81cf40e8b3
Monorepo: speedup 'Check Asset Sizes' job. (#49793)
In this PR, we are improving the job execution time by leveraging available cached resources, refining the build artifacts cleaning approach between calculating asset sizes.
2024-07-23 14:21:05 +02:00
Vladimir Reznichenko b28ee008c6
CI: improve flacky test reporting job execution time (#49665)
In this PR we use pre-build version of flaky jobs reporter, in order to speed up the job.
2024-07-22 16:33:31 +02:00
Vladimir Reznichenko 419a538901
CI: fixes for handling workflow cancellation. (#49709) 2024-07-19 12:32:10 +02:00
Adrian Moldovan a5a5c0503f
[testing workflows] Add new workflow to trigger any jobs in ci.yml on demand (#49674) 2024-07-19 10:14:12 +02:00
Vladimir Reznichenko 46f952eeb5
Monorepo: enable babel-loader and Jest caching (inc. CI) (#49656)
In this PR, we are consolidating babel-loader caching and adding Jest caching, improving build/testing times locally and in CI. The improvement comes from cache covering transpile steps in the mentioned processes.
2024-07-19 09:40:01 +02:00
Manish Menaria aa5d9debbf
Modify PR template and document that tests are required (#49331)
* Update PULL_REQUEST_TEMPLATE.md to include a checklist item for adding/updating tests

Added a new checklist item to the pull request template for contributors to confirm they have added or updated relevant tests (E2E, Unit, Integration, etc.) to ensure their fix or feature works as intended. This helps maintain the quality and reliability of the codebase by encouraging thorough testing.

* Update workflow to request reviewers to check test coverage along with testing instructions

Modified the review-testing-instructions workflow to enhance the review process by asking reviewers to not only review the testing instructions but also verify that relevant tests (E2E, Unit, Integration, etc.) have been added or updated as needed. This change ensures a more thorough review process and helps maintain high code quality.

* Update action name

* Remove changes from Template
2024-07-17 18:04:12 +05:30
Vladimir Reznichenko 444f105eba
CI: Re-group PHPUnit jobs. (#49443)
In this PR, we reduce build time for REST API tests (lightweight build) and regroup a bit of PHPUnit jobs (fewer jobs with the same coverage).
2024-07-15 13:39:07 +02:00
Adrian Moldovan b9d6439b9d
Revert "Update ci.yml to be dispatchable and skippable" (#49442) 2024-07-12 12:52:16 +03:00
Adrian Moldovan e4aff57e56
Fix path to wp-env.json file in release-checks runs (#49397) 2024-07-11 20:27:35 +03:00
Adrian Moldovan 3ff155182e
Fix Blocks e2e environment setup in release checks (#49379) 2024-07-11 15:45:30 +03:00
Vladimir Reznichenko 4311640de2
Monorepo: caching deps per target package in GH actions (#49020)
In this PR, we are implementing per-package build and caching, which optimizes build and fetching cached dependencies times across our workflows.
2024-07-10 14:39:49 +02:00