Commit Graph

1179 Commits

Author SHA1 Message Date
Jonathan Lane 4f3e310dcd
Add a retry on the setup test environment step (#51871)
* Add a retry on the setup test environment step

* Minor change to an e2e test to trigger CI

* Add changefile(s) from automation for the following project(s): woocommerce

---------

Co-authored-by: Jon Lane <jon.lane@automattic.com>
Co-authored-by: github-actions <github-actions@github.com>
2024-10-03 00:53:53 +02:00
Vladimir Reznichenko 6b5dbbc6ac
[dev] Fix for an error introduced in #51845 (#51847) 2024-10-02 11:00:16 +02:00
Vladimir Reznichenko d26816d41f
[dev] CI: skip linting and testing jobs when merging changelog deletion PRs into trunk (#51845) 2024-10-02 10:52:06 +02:00
Vladimir Reznichenko c17d8519fe
[dev] CI: fix git checkout error in perfromance metrics job (take 2) (#51807) 2024-10-01 10:11:06 +02:00
Vladimir Reznichenko 9b925739fa
[dev] CI: fix git checkout error in perfromance metrics job (#51805) 2024-10-01 09:55:54 +02:00
Vladimir Reznichenko ce5f7cb471
[dev] CI: drop baseline caching in perfromance metrics job (#51804) 2024-10-01 09:05:53 +02:00
Vladimir Reznichenko d3b0f153ad
[dev] CI: feedback on updated perfromance metrics job (#51772) 2024-09-30 16:39:16 +02:00
Vladimir Reznichenko bc8067a1ce
[dev] CI: new version of perfromance metrics job (take 2) (#51710)
In this PR, we are re-iterating the job speedup and leveraging single wp-instance, incremental builds, and baseline reports caching. The original benchmarking tool is still available but bypassed as we evaluate results for this iteration approach.
2024-09-30 09:57:52 +02:00
Vladimir Reznichenko f756b486e4
[dev] CI: tweaks in assets sizes verification job for better performance and coverage (#51761)
In this PR we refine cleaning build artifacts to build-folders only and leverage wireit integration in GitHub actions for leveraging incremental build approach in the job and improving the job running time.
2024-09-30 08:32:56 +02:00
louwie17 ed1e40204a
Add composition path prefix to storybook to allow publishing to gh-pages (#51700)
Add composition path prefix to storybook
2024-09-26 09:24:29 -03:00
Adrian Moldovan e4554564df
[ci] Bump actions/checkout to v4 (#51708) 2024-09-26 14:57:43 +03:00
Adrian Moldovan a47e0ff95a
Update the stalebot exempt label used for skipped tests issues (#51685) 2024-09-26 13:52:13 +02:00
Vladimir Reznichenko fd62f0083a
[dev] CI: drop an experimental workflow. (#51702)
In this PR, we dropped an experimental workflow and a PoC and are rewriting it.
2024-09-26 10:53:16 +02:00
nigeljamesstevenson 21f7821c2d
Update test-assistant-api-rest-change-tracker.yml 2024-09-24 15:11:39 +01:00
nigeljamesstevenson 359e2d0249
Update test-assistant-api-rest-change-tracker.yml 2024-09-24 15:04:57 +01:00
Jonathan Lane 2e69e94028
Exclude skipped e2e tests from auto-closure (#51528)
Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-09-19 09:02:04 +02:00
jonathansadowski bd1bbfd63c
Update upload- and download-artifact versions in workflows (#51073)
* Update build zip workflow fo upload artifact v4

* Update download- and upload-artifact to v4 in code freeze workflow
2024-09-17 09:16:29 -05:00
louwie17 ad8a25bd63
Add cron for Storybook pages - daily at 2:30 UTC (#51445)
Add cron for storybook pages - daily at 2:30 UTC
2024-09-17 11:11:54 -03:00
Vladimir Reznichenko b98236a25e
[dev] CI: experimental version of performance metrics job (#51276) 2024-09-17 14:32:01 +02:00
Adrian Moldovan 79b8a40157
Update nighty build workflow (#51328) 2024-09-16 12:11:15 +03:00
jonathansadowski 9c81006156
Update team flux PR review assignments (#51241) 2024-09-10 12:13:24 -05:00
louwie17 cf4f76ecfb
Add Storybook GitHub workflow for publishing to GH pages (#51235)
* Add storybook workflow

* Update version and add trigger for push on trunk

* Add workflow_dispatch for manual trigger also

* Add permissions

* Add trigger for current branch

* Set install to true for monorepo setup

* Add write permissions

* Use hashes for GH action versions and add --quiet for building storybook

* Remove on push trigger for now
2024-09-10 12:19:57 -03:00
nigeljamesstevenson 474d0209ea
Update test-assistant-api-rest-change-tracker.yml 2024-08-28 19:08:19 +01:00
nigeljamesstevenson 8a0babc660
Update test-assistant-api-rest-change-tracker.yml 2024-08-28 18:37:13 +01:00
nigeljamesstevenson a5b8e92f3c
Update test-assistant-api-rest-change-tracker.yml 2024-08-28 18:26:08 +01:00
Adrian Moldovan cfdaa7e6cb
[testing workflows] Fix undefined BuildKite Analytics message (#50641) 2024-08-16 09:50:03 -07:00
louwie17 9fa6c20a24
Remove Mothra from community PR assigner (#50670) 2024-08-16 08:36:11 -03:00
Adrian Moldovan 8c9c784f45
Tweak stalebot settings for flaky tests issues (#50630) 2024-08-15 13:54:44 +01:00
Bart Kalisz 03049e0d17
Fix Metrics job (#50482) 2024-08-13 11:31:39 +02:00
Adrian Moldovan ff347bdcd4
[testing workflow] Disable shards when re-running failed tests (#50492) 2024-08-09 13:49:19 +03:00
Chi-Hsuan Huang 7b86ec137e
Fix broken beta tester release GH action (#50465)
* Test beta tester action

* Test beta tester action

* Fix beta tester release action
2024-08-08 16:33:11 +08:00
Adrian Moldovan a3161244b3
[test workflows] Add LAST_FAILED_RUN switch (#50452) 2024-08-07 21:57:36 +03:00
Jason Kytros 58d7467f31
Prevent 'PR highlight changes' from running for blockified templates (#50439) 2024-08-07 13:59:25 +02:00
Adrian Moldovan 81e5d24d3d
[testing workflows] Fix artifacts path for blocks e2e (#50432) 2024-08-07 11:08:30 +03:00
Vladimir Reznichenko f147bd9764
CI: consolidate 'pnpm/action-setup' version and it's usage (#50261)
In this PR we spin off usage of recently introduced packageManager-property across CI workflows and consolidate the version of pnpm/action-setup action we are using.
2024-08-07 09:04:24 +02:00
Adrian Moldovan adbdcceb28
[testing workflows] Only re-run failed e2e tests (#50267)
* Use Playwright's last info run

* Add changelog

* Fix workflow syntax

* Fix workflow syntax

* Try with continue-on-error

* Try with merge-multiple

* Try with pattern instead of name

* Print the run command

* Print the run command

* Use LAST_RUN_FLAG

* Update outputDir

* Update upload paths and parse the file content

* Don't try to download lat run info if the test type is not e2e

* Rename the downloaded file

* Rename the downloaded file

* Rename the downloaded file

* Full path to the downloaded file

* Check download path content

* Check download path content

* Check the last-run file in the right path

* Fail different tests on different run attempts

* Fix artifact name

* Force test failures

* Cleanup console logs

* Cleanup console logs

* Cleanup console logs

* Log if last run info exists but no tests are found

* Revert test changes
2024-08-06 14:50:25 -07:00
Adrian Moldovan e9146f5ba4
[testing workflows] Update concurrency group for CI workflow (#50407) 2024-08-06 15:18:56 +02:00
Adrian Moldovan 657a3fb99a
[testing workflows] Update concurrency to not cancel the workflow when running on trunk (#50397) 2024-08-06 13:39:57 +03:00
Bart Kalisz 52119dfcc9
Fix CI Metrics job (#50214) 2024-08-06 11:23:04 +02:00
Vladimir Reznichenko db51f54694
Monorepo: added instructions on how to update report flaky tests action. (#50366) 2024-08-05 17:01:04 +02:00
Vladimir Reznichenko 559c91626c
CI: minor speed boost for Check Asset Sizes and Build Project Jobs. (#50342) 2024-08-05 12:58:39 +02:00
Vladimir Reznichenko a3f4d722b9
CI: speedup 'Check Asset Sizes' job (take 3) (#50178)
* CI: attempt 3 to speedup 'Check Asset Sizes' job.

* CI: cleanup

* CI: changelog entry.
2024-08-01 14:15:10 -07:00
Vladimir Reznichenko 8da5a91842
CI: speedup 'Build Project Jobs' (#50197)
In this PR, we use shallow checkout if the environment provides no base_ref, which is needed for identifying changed files. If no ref provided, we are not able to calculate the diff and therefore go with faster shallow copy.
2024-08-01 14:18:08 +02:00
Adrian Moldovan 0ba308247a
[testing workflows] Add pre-release checks (#50204) 2024-08-01 13:48:58 +02:00
Adrian Moldovan 017fe40928
[testing workflows] Use choices for on-demand test run input (#50170) 2024-07-31 10:48:14 -07:00
Vladimir Reznichenko 045919d107
CI: git checkout speed tweaks in linting jobs. (#50169) 2024-07-31 14:31:41 +02:00
Vladimir Reznichenko 4b90743ada
CI: add some comments to CI-workflow about intended jobs generation strategy. (#50114) 2024-07-31 08:46:55 +02:00
Jonathan Lane 31c4ae8431
Adds concurrency limit to workflow run (#50034)
Co-authored-by: Jon Lane <jon.lane@automattic.com>
2024-07-29 16:25:26 +03:00
Vladimir Reznichenko 63c77caf95
CI: improve monorepo setup time in PHPUnit and API tests. (#50032)
In this PR we introduce a new installation logic aiming only PHPUnit and API test jobs as part of monorepo setup.
2024-07-29 13:01:58 +02:00
Adrian Moldovan c12cb6ccdf
[tests] Move API core tests as a suite in e2e-pw (#50024) 2024-07-29 13:51:36 +03:00