Commit graph

51 commits

Author SHA1 Message Date
Spencer 53ee7a762d
[savedObjects field count] run in baseline job (#70999)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-07 14:32:04 -07:00
Brian Seeders 465ed21194
[CI] Add pipeline task queue framework and merge workers into one (#64011) 2020-07-07 14:14:30 -04:00
Tre 12460b456c
[QA] [Code Coverage] Add Three Dot Compare Url (#70525) 2020-07-02 10:01:54 -06:00
Tre 175bdb588f
[QA] [Code Coverage] Integrate with Team Assignment Pipeline and Add Research and Development Indexes and Cluster (#69348)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-30 17:00:45 -06:00
Sonja Krause-Harder e91594aeb9
[Ingest Manager] Use DockerServers service in integration tests. (#69822)
* Partially disable test files.

* Use DockerServers in EPM tests.

* Only run tests when DockerServers have been set up

* Reenable ingest manager API integration tests

* Pass new test_packages to registry container

* Enable DockerServers tests in CI.

* Correctly serve filetest package for file tests.

* Add helper to skip test and log warning.

* Reenable further file tests.

* Add developer documentation about Docker in Kibana CI.

* Document use of yarn test:ftr

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-29 15:24:11 +02:00
Brian Seeders 1ad18794ef
[CI] Record Github commit statuses outside of PRs (#69432) 2020-06-23 13:32:03 -04:00
Spencer 051c93a6be
[ftr] add support for docker servers (#68173)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-06-18 15:24:16 -07:00
MadameSheema dea2768545
fixes screenshots upload (#69392) 2020-06-18 08:22:50 +02:00
Spencer 5c327a12dd
[ci/getCheckoutInfo] retry fetching upstream changes to calculate mergeBase (#69320)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-06-16 13:45:20 -07:00
Spencer 0577f9bdcf
include ci-stats metrics in pr comment (#68563)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-12 16:37:38 -07:00
Brian Seeders 9c98ba9a9e
[CI] Add pipeline library unit tests (#68556) 2020-06-11 12:19:14 -04:00
Dmitry Lemeshko 1f99144ef6
update script to always download node (#68421)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-05 23:28:49 +02:00
Dmitry Lemeshko 77abbf257d
Fix code coverage for jest, upload merged reports (#68149)
* replace path in json files

* upload combined reports to artifacts for debug purpose
2020-06-03 22:21:28 +02:00
Brian Seeders 7f2e32475a
[CI] Add new intake worker size with 2x memory, and move workspace to memory (#67676)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-05-28 17:25:52 -05:00
Spencer 778b01b11a
[ci/stats] fix merge base detection (#67030)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-05-27 11:22:04 -07:00
Brian Seeders c559eecd00
[CI] Change slack notifications icon to yellow heart for unstable (#66896) 2020-05-27 12:49:39 -04:00
spalger 49213bd20d Revert "[ci/stats] fix git metadata collection (#66840)"
This reverts commit 9eaf0c050a.
2020-05-19 08:16:56 -07:00
Spencer 9eaf0c050a
[ci/stats] fix git metadata collection (#66840) 2020-05-19 07:00:47 -07:00
Brian Seeders c192dd0772
[CI] Fix Slack test failure names in Slack alerts (#66815) 2020-05-19 09:08:33 -04:00
Brian Seeders e3f6da0416
Replace agent metrics link with the new one (#66632) 2020-05-15 10:41:02 -04:00
Brian Seeders 1c004e98d6
[CI] Add one retry to setup step (#66638) 2020-05-15 10:40:30 -04:00
Brian Seeders 58b77fcb34
[CI] Add slack alerts to tracked branch jobs, change default channel, change formatting (#66580) 2020-05-15 10:39:58 -04:00
Tre 4853f24705
Ingest code coverage (#62336) 2020-05-13 15:09:42 -06:00
Joe Reuter b7e87c2c8b
Switch to core application service (#63443) 2020-05-13 09:19:24 +02:00
Brian Seeders 1bb1091abe
[CI] Slack alerts - Elasticsearch snapshot failures (#64724) 2020-05-05 10:06:37 -04:00
Brian Seeders fb30a822b3
Add 2 flaky retries to es snapshot jobs (#64553) 2020-05-04 14:08:50 -04:00
Spencer 00ec971b6e
Implement basic CI metric reporting (#64263) 2020-04-27 13:24:52 -07:00
Spencer 4962fe9d8a
[jenkins] refer to sizes in most pipeline code (#62082)
* [jenkins] refer to sizes in most pipeline code

* switch back to `linux && immutable` for small instances

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-04-04 07:11:31 -07:00
Brian Seeders 42539a56eb
Only run xpack siem cypress in PRs when there are siem changes (#60661) 2020-03-23 10:30:14 -04:00
Brian Seeders c22dbb1764
[CI] Add error steps and help links to PR comments (#60772) 2020-03-23 10:29:33 -04:00
MadameSheema 19f719ccb5
[SIEM] Cypress screenshots upload to google cloud (#60556)
* testing screenshots upload to google cloud

* testing another pattern

* fixes artifact pattern

* uploads only the .png files

* only limit uploads from kibana-siem directory

Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-03-19 19:44:54 -07:00
Brian Seeders 8d19fb05a1
Skip CI based on changes in PR (#59939) 2020-03-12 11:06:53 -04:00
Brian Seeders c90cfe208d
[CI] Pipeline refactoring (#56447) 2020-03-02 15:04:27 -05:00
Spencer 4e8ab56497
build immutable bundles for new platform plugins (#53976)
* build immutable bundles for new platform plugins

* only inspect workers if configured to do so

* [navigation] use an index.scss file

* add yarn.lock symlink

* set pluginScanDirs in test so fixtures stay consistent

* cleanup helpers a little

* fix type error

* support KBN_OPTIMIZER_MAX_WORKERS for limiting workers via env

* test support for KBN_OPTIMIZER_MAX_WORKERS

* expand the available memory for workers when only running one or two

* add docs about KBN_OPTIMIZER_MAX_WORKERS environment variable

* fix README link

* update kbn/pm dist

* implement bundle caching/reuse

* update kbn/pm dist

* don't check for cache if --no-cache is passed

* update renovate config

* standardize on index.scss, move console styles over

* add support for --no-cache to cli

* include worker config vars in optimizer version

* ignore concatenated modules

* update integration test

* add safari to browserslist to avoid user-agent warnings in dev

* update docs, clean up optimizer message/misc naming

* always handle initialized messages, don't ignore states that are attached to specific events

* reword caching docs, add environment var to disable caching

* tweak logging and don't use optimizer.useBundleCache as that's disabled in dev

* handle change notifications

* batch changes for 1 second

* rename CompilerState type to CompilerMsg

* getChanges() no longer needs to assign changes to dirs

* remove unused deps

* split up run_worker.ts and share cacheKey generation logic

* add a couple docs

* update tests and remove unused imports

* specify files when creating bundle cache key

* remove one more unused import

* match existing dev cli output more closely

* update kbn/pm dist

* set KBN_NP_PLUGINS_BUILT to avoid warning in CI

* avoid extending global window type

* add note to keep pluginScanDirs in sync

* pass browserslistEnv in workerConfig so it is used for cache key

* load commons.bundle.js in parallel too

* emit initialized+success states if all bundles are cached

* load bootstraps as quickly as possible

* skip flaky suite

* bump

* update jest snapshots

* remove hashing from cache key generation

* remove unnecessary non-null assertion

* improve docs and break up Optimizer#run()

* remove unused import

* refactor kbn/optimizer to break up observable logic, implement more helpful cache invalidation logic with logging

* fix tests

* add initializing phase

* avoid rxjs observable constructor

* remove unnecessary rxjs helper, add tests for bundle cache

* update consumers of optimizer

* update readme with new call style

* replace "new platform" with "kibana platform"

* fix a couple more renames

* add support for several plain-text file formats

* fix naming of OptimizerMsg => OptimizerUpdate, use "store" naming too

* one more OptimizerMsg update

* ensure bundles are not cached when cache config is false

* test for initializing states and bundle cache events

* remove unnecessary timeout change

* Remove unnecessary helpers

* Add tests for BundleCache class

* Add tests for Bundle class

* test summarizeEvent$

* missing paths are no longer listed in mtimes map

* add tests for optimizer/cache_keys

* Add some extra docs

* Remove labeled loop

* add integration test for kbn-optimizer watcher components

* querystring-browser removed

* tweak logging a smidge, improve info and final message

* remove unused imports

* remove duplication of getModuleCount() method

* move type annotation that validates things

* clear up the build completion message

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-02-12 19:42:42 -07:00
Brian Seeders ba151fea0b
Fix Github PR comment formatting (#56078) 2020-01-27 20:45:24 -05:00
Brian Seeders 99f224097c
Remove matrix build support (#54202) 2020-01-27 17:10:34 -05:00
Brian Seeders 4df1c4c9c1
[CI] Retry flaky tests (#53961) 2020-01-27 14:46:05 -05:00
Dmitry Lemeshko 26ce6104a9
Code coverage setup on CI (#49003)
* running code coverage in CI

* apply review feedback

* add custom function to upload merged coverage reports

* fix artifacts upload without coverage

* add file extension to fix validation

* Check code_coverage is set

* run oss tests via grunt task

* review fixes

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-01-08 21:08:48 +01:00
Brian Seeders 4b6c2f84e1
Elasticsearch snapshots automation (#53706) 2020-01-07 11:50:08 -05:00
Brian Seeders f8f777b5ba
Add kibanamachine support to Github PR comments (#53852)
* Add kibanamachine support to Github PR comments

* Temporary commit for quick successful pipeline

* Only delete the last comment if it was made by kibanamachine

* Revert "Temporary commit for quick successful pipeline"

This reverts commit d31f579697.
2019-12-31 15:14:55 -05:00
Brian Seeders 1489c32a1d
Print out agent debugging links during CI (#52812) 2019-12-12 10:58:18 -05:00
Spencer a25bf49eb8
Add failure screenshot links to JUnit failures (#52449) 2019-12-11 09:42:43 -07:00
Spencer e17539c5da
[ci/pipeline/reportFailures] when aborted, run with --no-github-update (#52355) 2019-12-06 12:27:06 -07:00
Spencer 3c55e55b7a
[failed_tests_cli] update reports with links to github issues (#52048)
* [failed_tests_cli] update reports with links to github issues

* reorder test report hooks so that published Junit includes modified reports

* force failures and enable dry-run mode for debugging

* auto-switch to --dry-run when running in non-tracked branches/prs

* add --skip-junit-update flag to skip mutating the reports

* remove comma after URL to support auto-linking in Jenkins

* Revert "force failures and enable dry-run mode for debugging"

This reverts commit ac0c287a3f.

* fix method call

* extend TestResult to include relevence flag rather than wrapping

* fix createFailureIssue() tests

* make report messages more consistent, append when not dry-run

* rename module

* update snapshots to not contain valid xml

* don't send authorization header if no token defined

* merge with master modified fixtures
2019-12-05 08:46:27 -07:00
Brian Seeders 5d5a4ca0ab
Add PR comments to pipeline (#51504) 2019-12-03 18:06:30 -05:00
Brian Seeders c8eef0458b
Experimenting with delay in test startup (#51459)
* Experimenting with delay in test startup

* Move firefox tests sooner becuase they take a long time to run

* Move functional test parallel process delay to a spot that should work better for flaky test runner
2019-12-02 14:21:38 -05:00
Brian Seeders 504604a4f2
Add labels to shell scripts in Jenkins (#49657) 2019-11-15 10:59:05 -05:00
Brian Seeders a32213f849
Retry git clone up to 8 times before failing a build (#50734) 2019-11-15 10:55:57 -05:00
Brian Seeders 9da6c07059
Re-add pipeline for flaky test runner job (#48781)
* Revert "Revert "Add pipeline for flaky test runner job (#46740)""

This reverts commit 7d96a13fad.

Also reconcile changes to Jenkinsfile since original revert happened

* Fix param parsing and add missed change

* Add missing variable
2019-10-25 12:57:46 -04:00
Brian Seeders 7d96a13fad
Revert "Add pipeline for flaky test runner job (#46740)"
This reverts commit e89425552b.
2019-10-04 16:55:20 -04:00