Commit graph

59 commits

Author SHA1 Message Date
Spencer 8c8a9971fa
[jenkins] disable CI metrics for temporary feature branches (#81938) (#81958)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-10-28 15:50:19 -07:00
Spencer dbc09a5d42
[7.x] [kbn/optimizer] report limits with ci metrics (#78205) (#79950)
* [kbn/optimizer] report limits with ci metrics (#78205)

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

* update bundle limits for 7.x branch

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-10-07 18:09:38 -07:00
Tiago Costa 86f628d318
chore(NA): merge and solve conflicts with 7.x (#79237) 2020-10-02 02:40:18 +01:00
Spencer ae6f0fa9b1
[7.x] remove visual aspects of baseline job (#77815) (#77842)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-09-17 21:28:29 -07:00
Thomas Watson 95bb064afb
[7.x] [CI] ensure tests for @elastic/safer-lodash-set only runs once (#77146) (#77184) 2020-09-14 12:18:08 +02:00
Yuliia Naumenko e12fed17b1
Fixed alerting_api_integration/security_and_spaces tests failing if actions proxy set on for parallel process running using commands 'scripts/functional_tests_server' and 'scripts/functional_test_runner' (#75232) (#75884)
* Fixed alerting_api_integration/security_and_spaces tests failing if actions proxy set on for parallel process running using commands 'scripts/functional_tests_server' and 'scripts/functional_test_runner'

* -

* Fixed get port from range for Slack and webhook simulators, removed some test warnings

* Added check for listening proxy server

* changed logger to debug removed not useful error

* -

* changed proxy to dynamic target in a single place

* test retry

* -

* -

* -

* -

* test with no cleanup

* -

* -

* -

* -

* Added environment variable ALERTING_PROXY_PORT

* fixed type checks

* fixed clean up proxy server port
2020-08-25 10:29:33 -07:00
Stacey Gammon d6a84a92c2
Add asciidoc support for generated plugin list (#72292) (#75778)
* add asciidoc support for generated plugin list

Try level offset "=+2" instead of "=+1" to stop the inlining of the includes.

remove +2 back to +1

* Remove asciidoc, switch to regex. Rearrange dev guide to avoid nesting limit.

* Add tests for regex

* add a description to not throw off the table. Remove the heading from the paragraph snippet.

* Fix more READMEs so table renders correctly

* Update plugin list

* Remove code-exploration file, moved to plugin-list

* fix typo

* Add link to developer examples

* Update plugin list

* fix typo
# Conflicts:
#	docs/developer/architecture/code-exploration.asciidoc
2020-08-24 14:16:59 -04:00
Spencer 3bb0ef91dd
[7.x] [jenkins/security-cypress] run build before the tests (#75203) (#75248)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-17 23:39:12 -07:00
Spencer a697cd425f
[jenkins] add pipeline for hourly security solution cypress tests (#75087) (#75109)
* [jenkins] add pipeline for hourly security solution cypress tests

* support customizing email for status emails

* apply review feedback

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-08-14 22:11:39 -07:00
Spencer 4b65ae2113
[7.x] remove .kbn-optimizer-cache upload (#75086) (#75100)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-14 17:16:58 -07:00
Brian Seeders 2ece4f12a4
[7.x] [CI] Add pipeline task queue framework and merge workers into one (#71268) (#74276) 2020-08-14 16:41:47 -04:00
Spencer 94efd1e3de
[7.x] [Jenkins] run CI when plugin readmes change (#74388) (#74412)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-05 14:35:34 -07:00
Spencer 7f27248545
[7.x] [src/dev/build] build Kibana Platform bundles from source (#73591) (#74313)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-04 17:24:06 -07:00
Brian Seeders 5801b5c014
[CI] In-progress Slack notifications (#74012) (#74034) 2020-08-01 17:36:14 -04:00
Brian Seeders 1e76d4c5eb
[CI] Harden Slack notifications (#73361) (#73475) 2020-07-28 13:44:58 -04:00
Spencer 3b4d052871
[pipeline/commitStatus] update commit status in baseline-capture job (#72366) (#72978)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-22 17:38:26 -07:00
Brian Seeders 0fa62b0cff
[CI] In-progress PR comments (#72211) (#72743) 2020-07-21 21:39:41 -04:00
Spencer 6c2d8fed86
[7.x] Add plugin list to docs that is generated from the repo (#71731) (#72138)
Co-authored-by: Stacey Gammon <gammon@elastic.co>
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
# Conflicts:
#	src/dev/ci_setup/setup.sh
2020-07-16 14:26:38 -07:00
spalger d625f82718 [CI] Add baseline trigger job
(cherry picked from commit a5c9c4ec43)

rename visual_baseline -> baseline_capture

(cherry picked from commit a81d8b55ab)

remove unnecessary context reference from trigger job

(cherry picked from commit 817fdf9b439e85c3ddfda126b3efb4e45c36006b)
(cherry picked from commit b1433e6317)

fix triggered job name

(cherry picked from commit e318ea76dc)
2020-07-14 15:32:20 -07:00
Spencer ef3308fafb
[7.x] [scripts/report_failed_tests] fix report_failed_tests integration on CI (#71131) (#71524)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-07-13 14:11:51 -07:00
Sonja Krause-Harder b6a7080b47
[Ingest Manager] Use DockerServers service in integration tests. (#69822) (#70197)
* Partially disable test files.

* Use DockerServers in EPM tests.

* Only run tests when DockerServers have been set up

* Reenable ingest manager API integration tests

* Pass new test_packages to registry container

* Enable DockerServers tests in CI.

* Correctly serve filetest package for file tests.

* Add helper to skip test and log warning.

* Reenable further file tests.

* Add developer documentation about Docker in Kibana CI.

* Document use of yarn test:ftr

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
# Conflicts:
#	x-pack/scripts/functional_tests.js
2020-06-29 17:55:28 +02:00
Brian Seeders 41960cf60c
[CI] Record Github commit statuses outside of PRs (#69432) (#69722) 2020-06-23 16:16:17 -04:00
Spencer e7fd974b6f
[ftr] add support for docker servers (#68173) (#69593)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-06-20 18:46:35 -07:00
MadameSheema ae30913ca0
fixes screenshots upload (#69392) (#69473) 2020-06-18 10:15:31 +02:00
Spencer 71663a473b
[7.x] [ci/getCheckoutInfo] retry fetching upstream changes to calculate mergeBase (#69320) (#69335)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-06-16 15:56:42 -07:00
Brian Seeders e9627b09de
[CI] Add pipeline library unit tests (#68556) (#68910) 2020-06-15 16:37:00 -04:00
Spencer 54955521bb
[7.x] include ci-stats metrics in pr comment (#68563) (#69096)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-12 18:40:46 -07:00
Brian Seeders be7604bd96 [CI] Add new intake worker size with 2x memory, and move workspace to memory (#67676)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-05-28 17:28:37 -05:00
Brian Seeders 5f622ebeb4
[CI] Change slack notifications icon to yellow heart for unstable (#66896) (#67518) 2020-05-27 17:39:41 -04:00
Spencer 9349f32f0e
[7.x] [ci/stats] fix merge base detection (#67030) (#67534)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-05-27 13:18:32 -07:00
Brian Seeders 30f7662424
[CI] Fix Slack test failure names in Slack alerts (#66815) (#66999) 2020-05-19 11:45:38 -04:00
Brian Seeders c4d249de48
[CI] Add one retry to setup step (#66638) (#66748) 2020-05-15 16:02:48 -04:00
Brian Seeders 62bf51f9ea
Replace agent metrics link with the new one (#66632) (#66743) 2020-05-15 13:09:12 -04:00
Brian Seeders 53683d8c8c
[CI] Add slack alerts to tracked branch jobs, change default channel, change formatting (#66580) (#66739) 2020-05-15 13:08:08 -04:00
Joe Reuter ef2c5ef761
Switch to core application service (#63443) (#66353) 2020-05-13 11:34:57 +02:00
Brian Seeders 3d1024ca6a
[CI] Slack alerts - Elasticsearch snapshot failures (#64724) (#65270) 2020-05-05 12:02:48 -04:00
Brian Seeders 284c9e3083
Add 2 flaky retries to es snapshot jobs (#64553) (#65134) 2020-05-04 16:49:50 -04:00
Spencer 94ca9ca700
[7.x] Implement basic CI metric reporting (#64263) (#64580) 2020-04-27 16:28:05 -07:00
Spencer fec6b7c37e
[7.x] [jenkins] refer to sizes in most pipeline code (#62082) (#62549)
* [jenkins] refer to sizes in most pipeline code

* switch back to `linux && immutable` for small instances

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-04-04 10:24:00 -07:00
Brian Seeders 7c4c3b165c
[CI] Add error steps and help links to PR comments (#60772) (#60909) 2020-03-24 10:30:54 -04:00
Brian Seeders 91e56b845d
Only run xpack siem cypress in PRs when there are siem changes (#60661) (#60911) 2020-03-24 10:30:37 -04:00
Spencer ede40f7a88
[7.x] [SIEM] Cypress screenshots upload to google cloud (#6055… (#60719)
* testing screenshots upload to google cloud

* testing another pattern

* fixes artifact pattern

* uploads only the .png files

* only limit uploads from kibana-siem directory

Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: MadameSheema <snootchie.boochies@gmail.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-03-19 22:42:41 -07:00
Brian Seeders 1a935ad656
Skip CI based on changes in PR (#59939) (#60018) 2020-03-12 16:12:17 -04:00
Brian Seeders 62ea6e63cd
[CI] Pipeline refactoring (#56447) (#59077) 2020-03-02 17:24:57 -05:00
Spencer 9f94c39960
[7.x] build immutable bundles for new platform plugins (#53976) (#57528)
* build immutable bundles for new platform plugins (#53976)

* build immutable bundles for new platform plugins

* only inspect workers if configured to do so

* [navigation] use an index.scss file

* add yarn.lock symlink

* set pluginScanDirs in test so fixtures stay consistent

* cleanup helpers a little

* fix type error

* support KBN_OPTIMIZER_MAX_WORKERS for limiting workers via env

* test support for KBN_OPTIMIZER_MAX_WORKERS

* expand the available memory for workers when only running one or two

* add docs about KBN_OPTIMIZER_MAX_WORKERS environment variable

* fix README link

* update kbn/pm dist

* implement bundle caching/reuse

* update kbn/pm dist

* don't check for cache if --no-cache is passed

* update renovate config

* standardize on index.scss, move console styles over

* add support for --no-cache to cli

* include worker config vars in optimizer version

* ignore concatenated modules

* update integration test

* add safari to browserslist to avoid user-agent warnings in dev

* update docs, clean up optimizer message/misc naming

* always handle initialized messages, don't ignore states that are attached to specific events

* reword caching docs, add environment var to disable caching

* tweak logging and don't use optimizer.useBundleCache as that's disabled in dev

* handle change notifications

* batch changes for 1 second

* rename CompilerState type to CompilerMsg

* getChanges() no longer needs to assign changes to dirs

* remove unused deps

* split up run_worker.ts and share cacheKey generation logic

* add a couple docs

* update tests and remove unused imports

* specify files when creating bundle cache key

* remove one more unused import

* match existing dev cli output more closely

* update kbn/pm dist

* set KBN_NP_PLUGINS_BUILT to avoid warning in CI

* avoid extending global window type

* add note to keep pluginScanDirs in sync

* pass browserslistEnv in workerConfig so it is used for cache key

* load commons.bundle.js in parallel too

* emit initialized+success states if all bundles are cached

* load bootstraps as quickly as possible

* skip flaky suite

* bump

* update jest snapshots

* remove hashing from cache key generation

* remove unnecessary non-null assertion

* improve docs and break up Optimizer#run()

* remove unused import

* refactor kbn/optimizer to break up observable logic, implement more helpful cache invalidation logic with logging

* fix tests

* add initializing phase

* avoid rxjs observable constructor

* remove unnecessary rxjs helper, add tests for bundle cache

* update consumers of optimizer

* update readme with new call style

* replace "new platform" with "kibana platform"

* fix a couple more renames

* add support for several plain-text file formats

* fix naming of OptimizerMsg => OptimizerUpdate, use "store" naming too

* one more OptimizerMsg update

* ensure bundles are not cached when cache config is false

* test for initializing states and bundle cache events

* remove unnecessary timeout change

* Remove unnecessary helpers

* Add tests for BundleCache class

* Add tests for Bundle class

* test summarizeEvent$

* missing paths are no longer listed in mtimes map

* add tests for optimizer/cache_keys

* Add some extra docs

* Remove labeled loop

* add integration test for kbn-optimizer watcher components

* querystring-browser removed

* tweak logging a smidge, improve info and final message

* remove unused imports

* remove duplication of getModuleCount() method

* move type annotation that validates things

* clear up the build completion message

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

* [kbn/optimizer] Fix windows support (#57592)

* [kbn/optimizer] simplify run_workers.ts a smidge

* use Path.resolve() to create windows paths from normalized ones

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
(cherry picked from commit 343bc9c303)

* remove istanbul/code coverage references

* fix webpack config syntax

* removal of querystring-browser was backported to 7.x

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-02-14 11:35:24 -07:00
Brian Seeders 2de2658f4d
Remove matrix build support (#54202) (#56170) 2020-01-28 16:55:29 -05:00
Brian Seeders 82509cb97b
Fix Github PR comment formatting (#56078) (#56091) 2020-01-27 22:12:07 -05:00
Brian Seeders fc8e61470b
[CI] Retry flaky tests (#53961) (#56056) 2020-01-27 16:26:24 -05:00
Brian Seeders 896ae06cb6
[7.x] Elasticsearch snapshots automation (#53706) (#54150) 2020-01-08 10:27:17 -05:00
Brian Seeders 09a1495a88
[7.x] Add kibanamachine support to Github PR comments (#53852) (#53871)
* Add kibanamachine support to Github PR comments

* Temporary commit for quick successful pipeline

* Only delete the last comment if it was made by kibanamachine

* Revert "Temporary commit for quick successful pipeline"

This reverts commit d31f579697.
2019-12-31 21:42:16 -05:00