Commit graph

51 commits

Author SHA1 Message Date
Luke Elmers 6f31a759f4
[migrations v2] Integration test for multi-node cluster. (#100957) (#103559)
# Conflicts:
#	packages/kbn-test/src/es/test_es_cluster.ts
2021-06-28 18:34:31 -04:00
Tyler Smalley 6977be0140
Revert "Revert: [7.x] [FTR][CI] Use default distribution for all tests (#102019) (#102580)
* Revert "Revert: [7.x] [FTR][CI] Use default distribution for all tests (#102019)"

This reverts commit c272bdbc25.

* [FTR] Stabilize SSLP functional tests (#102553)

* Removes spaces check, since spaces should always be available
* Disables Monitoring, SecuritySolutions, and Reporting in SSPL tests
until #102552 is completed

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-06-21 03:28:12 -04:00
Tyler Smalley c272bdbc25
Revert: [7.x] [FTR][CI] Use default distribution for all tests (#102019)
* Revert "[FTR] Use importExport for saved_object/basic archive (#100244) (#102016)"

This reverts commit 9851b7bcfa.

* Revert "[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#101118)"

This reverts commit 73225daa87.
2021-06-13 23:29:03 -07:00
Tyler Smalley 73225daa87
[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#101118)
* [FTR][CI] Use default distribution for all tests (#94968)
* [FTR] Use importExport for saved_object/basic archive (#100244)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-06-12 09:53:10 -07:00
Tyler Smalley 52dd72e0a2 Revert "[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#99980)"
This reverts commit be40e96806.
2021-05-28 17:21:51 -07:00
Tyler Smalley be40e96806
[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#99980)
* [FTR][CI] Use default distribution for all tests (#94968)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* Use default output

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* [FTR] Use importExport for saved_object/basic archive

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* Update suggestions tests

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* Fix build

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* More migrations to kbnArchiver

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-05-28 15:25:52 -04:00
Brian Seeders a82e2cbc59
[CI] Create a ciGroup just for tests that use Docker (#98535) (#99088)
# Conflicts:
#	test/scripts/jenkins_xpack_build_kibana.sh
2021-05-03 15:52:17 -04:00
Kibana Machine 08c91529d0
Revert skips added while triaging ES OOMs (#97876) (#98067)
* Revert "skip flaky suite (#97382)"

This reverts commit e321f57f64.

* Revert "skip flaky suite (#97387)"

This reverts commit a89b756710.

* Revert "Skip test to try and stabilize master" (#97378)

This reverts commit 194355fdd3.

* upload heap dumps when they are created

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-22 16:53:49 -04:00
Kibana Machine 58e4ee3a02
[ci] ship Jest unit test junit with runbld in jest worker (#97197) (#97342)
Co-authored-by: Brian Seeders <seeders@gmail.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: Brian Seeders <seeders@gmail.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-19 16:54:08 +00:00
Kibana Machine 890ddce74f
[FTSR] Convert to tasks and add jest/api integration suites (#91770) (#91928)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-02-18 17:05:37 -05:00
Kibana Machine 854e833cf0
[CI] Build and publish storybooks (#87701) (#91917)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-02-18 16:26:10 -05:00
Tyler Smalley 6502c8f8e0
[7.x] [CI] Combines Jest unit tests (#89948) (#90828)
* [CI] Combines Jest unit tests (#89948)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
# Conflicts:
#	jest.config.oss.js
#	src/dev/code_coverage/shell_scripts/extract_archives.sh
#	test/scripts/jenkins_unit.sh
#	test/scripts/jenkins_xpack.sh
#	vars/kibanaCoverage.groovy
#	x-pack/jest.config.js

* Fix bad merge

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-02-09 17:52:27 -05:00
Brian Seeders 2af05b14ca
[CI] Only delay ciGroup processes when using tasks (#90038) (#90093) 2021-02-02 20:23:41 -05:00
Brian Seeders cb9002e72c
[CI] Move Jest tests to separate machines (#89770) (#89799) 2021-02-02 16:27:32 -05:00
Brian Seeders c4ec724d12
[CI] Sleep before starting ciGroup tasks to smooth out CPU spikes from ES starting up (#89751) (#89786) 2021-01-29 17:06:02 -05:00
Jonathan Budzenski c2163a5675 Revert "[7.x] [CI] Combines Jest test jobs (#85850) (#89432)"
This reverts commit e36dfcd49f.
2021-01-28 12:17:22 -06:00
Tyler Smalley e36dfcd49f
[7.x] [CI] Combines Jest test jobs (#85850) (#89432)
* [CI] Combines Jest test jobs (#85850)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
# Conflicts:
#	jest.config.oss.js
#	src/dev/code_coverage/shell_scripts/extract_archives.sh
#	test/scripts/jenkins_unit.sh
#	test/scripts/jenkins_xpack.sh
#	vars/kibanaCoverage.groovy
#	x-pack/jest.config.js

* [CI] Decrease number of Jest workers

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-01-27 16:16:22 -08:00
Spencer c7713f216d
[7.x] [functional_cors] use pre-defined unique port in CI (#88919) (#88978)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-01-21 10:46:28 -07:00
Tyler Smalley 9a8351cce1
[CI] Enables APM collection (#81731) (#84929)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-12-03 11:13:53 -08:00
Brian Seeders 19ef608933
[CI] Build docker image during packer_cache (#82145) (#83664) 2020-11-19 16:32:49 -05:00
Nicolas Chaulet acd3e35f90
[Fleet] Rename ingest_manager_api_integration tests fleet_api_integration (#83011) (#83326) 2020-11-12 16:37:41 -05:00
Brian Seeders 12828d6db1
[CI] Move notifyOnError to fix in-progress alerts for ciGroups (#82506) (#82618) 2020-11-04 16:58:01 -05:00
Spencer ae6f0fa9b1
[7.x] remove visual aspects of baseline job (#77815) (#77842)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-09-17 21:28:29 -07:00
Yuliia Naumenko e12fed17b1
Fixed alerting_api_integration/security_and_spaces tests failing if actions proxy set on for parallel process running using commands 'scripts/functional_tests_server' and 'scripts/functional_test_runner' (#75232) (#75884)
* Fixed alerting_api_integration/security_and_spaces tests failing if actions proxy set on for parallel process running using commands 'scripts/functional_tests_server' and 'scripts/functional_test_runner'

* -

* Fixed get port from range for Slack and webhook simulators, removed some test warnings

* Added check for listening proxy server

* changed logger to debug removed not useful error

* -

* changed proxy to dynamic target in a single place

* test retry

* -

* -

* -

* -

* test with no cleanup

* -

* -

* -

* -

* Added environment variable ALERTING_PROXY_PORT

* fixed type checks

* fixed clean up proxy server port
2020-08-25 10:29:33 -07:00
Spencer a697cd425f
[jenkins] add pipeline for hourly security solution cypress tests (#75087) (#75109)
* [jenkins] add pipeline for hourly security solution cypress tests

* support customizing email for status emails

* apply review feedback

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-08-14 22:11:39 -07:00
Spencer 4b65ae2113
[7.x] remove .kbn-optimizer-cache upload (#75086) (#75100)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-14 17:16:58 -07:00
Brian Seeders 2ece4f12a4
[7.x] [CI] Add pipeline task queue framework and merge workers into one (#71268) (#74276) 2020-08-14 16:41:47 -04:00
Spencer 7f27248545
[7.x] [src/dev/build] build Kibana Platform bundles from source (#73591) (#74313)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-04 17:24:06 -07:00
Brian Seeders 5801b5c014
[CI] In-progress Slack notifications (#74012) (#74034) 2020-08-01 17:36:14 -04:00
Brian Seeders 0fa62b0cff
[CI] In-progress PR comments (#72211) (#72743) 2020-07-21 21:39:41 -04:00
Spencer ef3308fafb
[7.x] [scripts/report_failed_tests] fix report_failed_tests integration on CI (#71131) (#71524)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-07-13 14:11:51 -07:00
Sonja Krause-Harder b6a7080b47
[Ingest Manager] Use DockerServers service in integration tests. (#69822) (#70197)
* Partially disable test files.

* Use DockerServers in EPM tests.

* Only run tests when DockerServers have been set up

* Reenable ingest manager API integration tests

* Pass new test_packages to registry container

* Enable DockerServers tests in CI.

* Correctly serve filetest package for file tests.

* Add helper to skip test and log warning.

* Reenable further file tests.

* Add developer documentation about Docker in Kibana CI.

* Document use of yarn test:ftr

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
# Conflicts:
#	x-pack/scripts/functional_tests.js
2020-06-29 17:55:28 +02:00
Brian Seeders 41960cf60c
[CI] Record Github commit statuses outside of PRs (#69432) (#69722) 2020-06-23 16:16:17 -04:00
MadameSheema ae30913ca0
fixes screenshots upload (#69392) (#69473) 2020-06-18 10:15:31 +02:00
Brian Seeders e9627b09de
[CI] Add pipeline library unit tests (#68556) (#68910) 2020-06-15 16:37:00 -04:00
Brian Seeders c4d249de48
[CI] Add one retry to setup step (#66638) (#66748) 2020-05-15 16:02:48 -04:00
Spencer ede40f7a88
[7.x] [SIEM] Cypress screenshots upload to google cloud (#6055… (#60719)
* testing screenshots upload to google cloud

* testing another pattern

* fixes artifact pattern

* uploads only the .png files

* only limit uploads from kibana-siem directory

Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: MadameSheema <snootchie.boochies@gmail.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-03-19 22:42:41 -07:00
Brian Seeders 1a935ad656
Skip CI based on changes in PR (#59939) (#60018) 2020-03-12 16:12:17 -04:00
Brian Seeders 62ea6e63cd
[CI] Pipeline refactoring (#56447) (#59077) 2020-03-02 17:24:57 -05:00
Spencer 9f94c39960
[7.x] build immutable bundles for new platform plugins (#53976) (#57528)
* build immutable bundles for new platform plugins (#53976)

* build immutable bundles for new platform plugins

* only inspect workers if configured to do so

* [navigation] use an index.scss file

* add yarn.lock symlink

* set pluginScanDirs in test so fixtures stay consistent

* cleanup helpers a little

* fix type error

* support KBN_OPTIMIZER_MAX_WORKERS for limiting workers via env

* test support for KBN_OPTIMIZER_MAX_WORKERS

* expand the available memory for workers when only running one or two

* add docs about KBN_OPTIMIZER_MAX_WORKERS environment variable

* fix README link

* update kbn/pm dist

* implement bundle caching/reuse

* update kbn/pm dist

* don't check for cache if --no-cache is passed

* update renovate config

* standardize on index.scss, move console styles over

* add support for --no-cache to cli

* include worker config vars in optimizer version

* ignore concatenated modules

* update integration test

* add safari to browserslist to avoid user-agent warnings in dev

* update docs, clean up optimizer message/misc naming

* always handle initialized messages, don't ignore states that are attached to specific events

* reword caching docs, add environment var to disable caching

* tweak logging and don't use optimizer.useBundleCache as that's disabled in dev

* handle change notifications

* batch changes for 1 second

* rename CompilerState type to CompilerMsg

* getChanges() no longer needs to assign changes to dirs

* remove unused deps

* split up run_worker.ts and share cacheKey generation logic

* add a couple docs

* update tests and remove unused imports

* specify files when creating bundle cache key

* remove one more unused import

* match existing dev cli output more closely

* update kbn/pm dist

* set KBN_NP_PLUGINS_BUILT to avoid warning in CI

* avoid extending global window type

* add note to keep pluginScanDirs in sync

* pass browserslistEnv in workerConfig so it is used for cache key

* load commons.bundle.js in parallel too

* emit initialized+success states if all bundles are cached

* load bootstraps as quickly as possible

* skip flaky suite

* bump

* update jest snapshots

* remove hashing from cache key generation

* remove unnecessary non-null assertion

* improve docs and break up Optimizer#run()

* remove unused import

* refactor kbn/optimizer to break up observable logic, implement more helpful cache invalidation logic with logging

* fix tests

* add initializing phase

* avoid rxjs observable constructor

* remove unnecessary rxjs helper, add tests for bundle cache

* update consumers of optimizer

* update readme with new call style

* replace "new platform" with "kibana platform"

* fix a couple more renames

* add support for several plain-text file formats

* fix naming of OptimizerMsg => OptimizerUpdate, use "store" naming too

* one more OptimizerMsg update

* ensure bundles are not cached when cache config is false

* test for initializing states and bundle cache events

* remove unnecessary timeout change

* Remove unnecessary helpers

* Add tests for BundleCache class

* Add tests for Bundle class

* test summarizeEvent$

* missing paths are no longer listed in mtimes map

* add tests for optimizer/cache_keys

* Add some extra docs

* Remove labeled loop

* add integration test for kbn-optimizer watcher components

* querystring-browser removed

* tweak logging a smidge, improve info and final message

* remove unused imports

* remove duplication of getModuleCount() method

* move type annotation that validates things

* clear up the build completion message

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

* [kbn/optimizer] Fix windows support (#57592)

* [kbn/optimizer] simplify run_workers.ts a smidge

* use Path.resolve() to create windows paths from normalized ones

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
(cherry picked from commit 343bc9c303)

* remove istanbul/code coverage references

* fix webpack config syntax

* removal of querystring-browser was backported to 7.x

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-02-14 11:35:24 -07:00
Brian Seeders 2de2658f4d
Remove matrix build support (#54202) (#56170) 2020-01-28 16:55:29 -05:00
Brian Seeders fc8e61470b
[CI] Retry flaky tests (#53961) (#56056) 2020-01-27 16:26:24 -05:00
Brian Seeders 896ae06cb6
[7.x] Elasticsearch snapshots automation (#53706) (#54150) 2020-01-08 10:27:17 -05:00
Brian Seeders 27c4a8b895
[7.x] Print out agent debugging links during CI (#52812) (#52901) 2019-12-12 15:14:35 -05:00
Spencer 7118e48c06
[7.x] Add failure screenshot links to JUnit failures (#52449) (#52775)
# Conflicts:
#	src/dev/mocha/junit_report_generation.js
2019-12-11 22:06:29 -07:00
Spencer 1e812b25c2
[7.x] [ci/pipeline/reportFailures] when aborted, run with --no… (#52423) 2019-12-06 14:23:29 -07:00
Spencer e36afbc8d9
[7.x] [failed_tests_cli] update reports with links to github i… (#52303)
* [failed_tests_cli] update reports with links to github issues (#52048)

* [failed_tests_cli] update reports with links to github issues

* reorder test report hooks so that published Junit includes modified reports

* force failures and enable dry-run mode for debugging

* auto-switch to --dry-run when running in non-tracked branches/prs

* add --skip-junit-update flag to skip mutating the reports

* remove comma after URL to support auto-linking in Jenkins

* Revert "force failures and enable dry-run mode for debugging"

This reverts commit ac0c287a3f.

* fix method call

* extend TestResult to include relevence flag rather than wrapping

* fix createFailureIssue() tests

* make report messages more consistent, append when not dry-run

* rename module

* update snapshots to not contain valid xml

* don't send authorization header if no token defined

* merge with master modified fixtures

* [ci/reportFailures] --dry-run is overloaded, split it up (#52314)

* [ci/reportFailures] --dry-run is overloaded, split it up

* force some failures to verify the fix

* Revert "force some failures to verify the fix"

This reverts commit cf2a58e139.

* update readme to mention new flags

* remove unnecessary commas

(cherry picked from commit 8e8571bae0)
2019-12-05 14:43:33 -07:00
Brian Seeders 4413e0a896
[7.x] Experimenting with delay in test startup (#51459) (#52010)
* Experimenting with delay in test startup (#51459)

* Experimenting with delay in test startup

* Move firefox tests sooner becuase they take a long time to run

* Move functional test parallel process delay to a spot that should work better for flaky test runner

* Fix Jenkinsfile
2019-12-02 17:34:21 -05:00
Brian Seeders 3a078811f8
[7.x] Add labels to shell scripts in Jenkins (#49657) (#50794) 2019-11-15 14:47:14 -05:00
Brian Seeders 921fa56659
[7.x] Retry git clone up to 8 times before failing a build (#5… (#50790) 2019-11-15 14:46:51 -05:00