Commit graph

144 commits

Author SHA1 Message Date
Dmitry
2fcce0bcbc
[coverage] re-enable jest (#85946)
* [coverage] re-enable jest

* fix coverage script for x-pack

* use presets in entry configs

* set max workers

* run tests from x-pack folde

* remove duplicate 'reporters' prop

* remove reporters for x-pack config

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-12-16 20:20:55 +01:00
Tiago Costa
1e3a483b06
chore(NA): rebalance x-pack cigroups (#85797) 2020-12-16 09:58:46 -08:00
Tyler Smalley
78bd95f5ca Skip Flaky Security Cypress tests
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-12-15 22:09:45 -08:00
Tyler Smalley
9b62100428
Removes Grunt abstraction from CI tasks (#85210)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-12-09 08:51:32 -08:00
Dmitry
ec1666be5a
Skip jest coverage on CI (#85375)
* [coverage] skip running jest tests

* run mocha only

* skip uploading jest artifacts
2020-12-09 16:31:00 +01:00
Tiago Costa
f961e90ea7
chore(NA): remove scripts on plugins to find circular deps (#84852)
* chore(NA): remove extra scripts on plugins to find circular deps

* chore(NA): remove madge as dependency

* Move cyclic dep jobs

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

Co-authored-by: Tyler Smalley <tyler.smalley@elastic.co>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-12-07 19:41:38 +00:00
Brian Seeders
aa2525c842
[CI] Bump intake instance size (#85082) 2020-12-04 20:50:55 -05:00
Tiago Costa
9c3ca2023e
chore(NA): removes auto install of pre-commit hook (#83566)
* chore(NA): remove kibana pre-commit hook installation from bootstrap

* chore(NA): add support for git ref flag on run precommit hook script

* chore(NA): integrate quick commit checks within the CI

* chore(NA): introduce logging trap to warn about quick commit checks failure and how to reproduce it

* chore(NA): update quick commit checks message

* fix(NA): quick commit checks function def

* chore(NA): fix quick commit checks message quotes

* chore(NA): fix functional call

* chore(NA): fix script to run

* chore(NA): add unexpected debugger statement to test quick commit checks

* chore(NA): update message to log before quick commit checks

* chore(NA): remove extra debugger statement

* chore(NA): add echo message inline with script execution

* chore(NA): add unexpected debugger statement to test quick commit checks

* chore(NA): remove extra usage of debug statement

* chore(NA): wrapping quick commit checks in a func

* chore(NA): export function to use later

* chore(NA): export function to use later

* chore(NA): use child bash script on github checks reporter

* chore(NA): define dir context for commit_check_runner.sh

* fix(NA): permissions for commit_check_runner.sh

* fix(NA): permissions for commit.sh

* chore(NA): format message to log

* chore(NA): add unexpected debugger statement to test quick commit checks

* chore(NA): remove extra usage of debug statement

* chore(NA): format runner message

* chore(NA): replace log.info by log.warning

* docs(NA): include docs for removing the pre-commit hook auto installation

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-12-04 14:43:33 +00:00
Tyler Smalley
74ef540e42
[CI] Enables APM collection (#81731)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-12-03 09:25:40 -08:00
Tyler Smalley
b593781009
Jest multi-project configuration (#77894)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-12-02 11:42:23 -08:00
Tiago Costa
6e8895403a
chore(NA): tool to find plugins circular dependencies between plugins (#82867)
* chore(NA): update gitignore to include first changes from moving into a single package.json

* chore(NA): update gitignore

* chore(NA): move all the dependencies into the single package.json and apply changes to bootstrap

* chore(NA): fix types problems after the single package json

* chore(NA): include code to find the dependencies used across the code

* chore(NA): introduce pure lockfile for install dependencies on build

* chore(NA): update clean task to not delete anything from xpack node_modules

* chore(NA): update gitignore to remove development temporary rules

* chore(NA): update notice file

* chore(NA): update jest snapshots

* chore(NA): fix whitelisted licenses to include a new specify form of an already included one

* chore(NA): remove check lockfile symlinks from child projects

* chore(NA): fix eslint and add missing declared deps on single pkg json

* chore(NA): correctly update notice

* chore(NA): fix failing jest test for storyshots.test.tsx

* chore(NA): fix cypress multi reporter path

* chore(NA): fix Project tests check

* chore(NA): fix problem with logic to detect used dependes on oss build

* chore(NA): include correct x-pack plugins dep discovery

* chore(NA): discover entries under dynamic requires on vis_type_timelion

* chore(NA): remove canvas

* chore(NA): add initial code to find circular deps

* chore(NA): ground work to integrate the circular deps scripts

* chore(NA): add correct filtering to find circular dependenices feature

* chore(NA): add ci mode flag into circular deps script

* chore(NA): feature complete circular dependencies detect script

* chore(NA): merge and solve conflicts with master

* chore(NA): remove unwanted changes

* chore(NA): remove unwanted changes on kbn storybook

* chore(NA): hook find circular deps tool into ci

* chore(NA): remove previous find plugin circular deps script

* chore(NA): add type for circular dep list

* chore(NA): add type for circular dep list for allowed list

* chore(NA): allow CI to fail check

* chore(NA): update deps allowed list

* chore(NA): run search circular deps script over examples too

* docs(NA): adds cli description

* chore(NA): use plugin search paths to build entries to find circular deps

* chore(NA): update allowed list

* chore(NA): snapshot update for kbn optimizer test

* chore(NA): update dpdm version

* chore(NA): remove thirdParty flag

* chore(NA): update docs to include info about the new tool

* docs(NA): update to link PR instead of the issue

* chore(NA): update debug logs to always output allowedList

* fix(NA): correctly list found differences number

* chore(NA): remove quiet flag

* fix(NA): correctly fail the CI if circular deps are found

* chore(NA): complete list of found circular deps

* chore(NA): used named capturing group into the regex

* docs(NA): update typescript best practices docs and styleguide

* chore(NA): introduce quick filter option flag

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-11-30 22:19:32 +00:00
Tiago Costa
aa8ec78060
chore(NA): enable yarn prefer offline and local mirror for development (#84124)
* chore(NA): enable --prefer-offline by default

* chore(NA): use prefer offline in the yarnrc

* chore(NA): update kbn pm

* chore(NA): add yarn offline mirror integration

* chore(NA): remove non wanted prune feature due to switching between branches

* chore(NA): re-introduce babel require hook
2020-11-25 00:18:18 +00:00
Tiago Costa
9ee1ec7f30
chore(NA): rebalance x-pack cigroups (#84099)
* chore(NA): rebalance cigroup1 into cigroup5

* chore(NA): get list api integration into cigropup1 again

* chore(NA): get apm integration basic into cigropup1 again

* chore(NA): move back apm_api_integration trial tests into ciGroup1

* chore(NA): move exception operators data types into ciGroup1 again

* chore(NA): move detection engine api security and spaces back into ciGroup1

* chore(NA): add a new xpack cigroup11

* chore(NA): correctly create 11 xpack ci groups

* chore(NA): try to balance ciGroup2 and 8

* chore(NA): reset number of xpack parallel worker builds to 10

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-11-24 21:33:47 +00:00
Brian Seeders
7d9f460a9c
[CI] Build docker image during packer_cache (#82145) 2020-11-18 11:17:41 -05:00
Nicolas Chaulet
fed9a4fddc
[Fleet] Rename ingest_manager_api_integration tests fleet_api_integration (#83011) 2020-11-12 13:50:59 -05:00
Brian Seeders
9bb8a410db
[CI] Move notifyOnError to fix in-progress alerts for ciGroups (#82506) 2020-11-04 10:45:12 -05:00
Spencer
0fec6cbc00
[ci] run server integration tests (#81698)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-11-03 15:50:01 -07:00
Tiago Costa
0eeaafa722
chore(NA): move into single pkg json (#80015)
* chore(NA): update gitignore to include first changes from moving into a single package.json

* chore(NA): update gitignore

* chore(NA): move all the dependencies into the single package.json and apply changes to bootstrap

* chore(NA): fix types problems after the single package json

* chore(NA): include code to find the dependencies used across the code

* chore(NA): introduce pure lockfile for install dependencies on build

* chore(NA): update clean task to not delete anything from xpack node_modules

* chore(NA): update gitignore to remove development temporary rules

* chore(NA): update notice file

* chore(NA): update jest snapshots

* chore(NA): fix whitelisted licenses to include a new specify form of an already included one

* chore(NA): remove check lockfile symlinks from child projects

* chore(NA): fix eslint and add missing declared deps on single pkg json

* chore(NA): correctly update notice

* chore(NA): fix failing jest test for storyshots.test.tsx

* chore(NA): fix cypress multi reporter path

* chore(NA): fix Project tests check

* chore(NA): fix problem with logic to detect used dependes on oss build

* chore(NA): include correct x-pack plugins dep discovery

* chore(NA): discover entries under dynamic requires on vis_type_timelion

* chore(NA): remove canvas

* test(NA): fix jest unit tests

* chore(NA): remove double react declaration from storyshot test file

* chore(NA): try removing isOSS check

* chore(NA): support for plugin development

* chore(NA): update logic to fix unit tests and typechecking

* chore(NA): support to run npm scripts in child kbn projects across all envs

* chore(NA): support github checks reporter on x-pack and remove cpy types as the package correctly provides them

* chore(NA): update cpy version

* chore(NA): include last kbn pm changes

* chore(NA): update style on build_production_projects.ts

* chore(NA): remove any cast fom telemetry opt in stats

* chore(NA): remove del and re-use rm -rf again

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-11-02 21:18:52 +00:00
Spencer
271a799ef8
[jenkins] disable CI metrics for temporary feature branches (#81938)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-10-28 14:08:56 -07:00
Spencer
fd066f7b63
[kbn/optimizer] report limits with ci metrics (#78205)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-10-07 15:43:14 -07:00
Tiago Costa
e5d8d49164
chore(NA): assures a single version for the same dependency across the entire project (#78825)
* chore(NA): script to check for multiple version of same dependency

* chore(NA): remove multiple versions for the same dependency

* chore(NA): hook single_version_dependencies script into the CI

* chore(NA): remove grunt from the CI hook integration

* chore(NA): update kbn pm dist

* chore(NA): fix typechecking

* chore(NA): update code to run under last extract-zip version

* fix(NA): multiple versions of the same type dependency

* move validation to bootstrap (#13)

Co-authored-by: spalger <spalger@users.noreply.github.com>

* chore(NA): todo to remove logic to validate single version deps once we move into a single package.json

* chore(NA): remove verify dependency versions jenkins task

* chore(NA): update kbn pm dist file

* chore(NA): remove last mention to verify_dependency_versions.sh fom tasks.groovy

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-10-02 00:46:00 +01:00
Tre
3a73e0b2ac
[QA][Code Coverage] Coverage teams lookup w/o Additional Config (#77111)
* [QA][Code Coverage] Coverage teams lookup

* Fix test per cr.

* Drop unused fn's.

* Add integration test to prove that the sys does indeed
strip the CC prefix and still walks the fs.

* Cleanup "todo" list.

* Use import, like Dima's previous suggestion.

* Add coverage teams only definitions to CODEOWNERS per Lee.

* Add coverage teams for logstash, reporting and security.

* Update description.

* Update names per Lee.

* Drop mutation.

* Fix dupes.

* Add the file check, per Dima

* Add more teams

* Update regex to only match on "build/" and add test.

* More teams

* More teams

* Add print statement of the canonical timestamp,
so we can lookup stuff in gcp during errors.

* CR fixups
2020-09-28 15:27:02 -06:00
Spencer
12e614d6ac
remove visual aspects of baseline job (#77815)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-09-17 19:40:15 -07:00
Thomas Watson
fd08782777
[CI] ensure tests for @elastic/safer-lodash-set only runs once (#77146) 2020-09-10 16:47:38 +02:00
Yuliia Naumenko
e31a0c27e6
Fixed alerting_api_integration/security_and_spaces tests failing if actions proxy set on for parallel process running using commands 'scripts/functional_tests_server' and 'scripts/functional_test_runner' (#75232)
* Fixed alerting_api_integration/security_and_spaces tests failing if actions proxy set on for parallel process running using commands 'scripts/functional_tests_server' and 'scripts/functional_test_runner'

* -

* Fixed get port from range for Slack and webhook simulators, removed some test warnings

* Added check for listening proxy server

* changed logger to debug removed not useful error

* -

* changed proxy to dynamic target in a single place

* test retry

* -

* -

* -

* -

* test with no cleanup

* -

* -

* -

* -

* Added environment variable ALERTING_PROXY_PORT

* fixed type checks

* fixed clean up proxy server port
2020-08-24 16:43:44 -07:00
Stacey Gammon
4ffef0a481
Add asciidoc support for generated plugin list (#72292)
* add asciidoc support for generated plugin list

Try level offset "=+2" instead of "=+1" to stop the inlining of the includes.

remove +2 back to +1

* Remove asciidoc, switch to regex. Rearrange dev guide to avoid nesting limit.

* Add tests for regex

* add a description to not throw off the table. Remove the heading from the paragraph snippet.

* Fix more READMEs so table renders correctly

* Update plugin list

* Remove code-exploration file, moved to plugin-list

* fix typo

* Add link to developer examples

* Update plugin list

* fix typo
2020-08-24 11:31:27 -04:00
Dmitry Lemeshko
f983e120b6
[code coverage] always download node before team assignment (#75424) 2020-08-19 18:13:29 +02:00
Spencer
cf0e287c9e
[jenkins/security-cypress] run build before the tests (#75203)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-17 20:48:22 -07:00
Spencer
1439b11fd2
[jenkins] add pipeline for hourly security solution cypress tests (#75087)
* [jenkins] add pipeline for hourly security solution cypress tests

* support customizing email for status emails

* apply review feedback

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-08-14 16:32:45 -07:00
Spencer
2129b13155
remove .kbn-optimizer-cache upload (#75086)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-14 15:30:24 -07:00
Spencer
057cab725c
[Jenkins] run CI when plugin readmes change (#74388)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-05 12:05:17 -07:00
Spencer
409779d1ed
[src/dev/build] build Kibana Platform bundles from source (#73591)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-08-04 15:34:01 -07:00
Brian Seeders
0ca8e99a9f
[CI] Add pipeline task queue framework and merge workers into one (#71268) 2020-08-04 13:13:51 -04:00
Brian Seeders
329a98c2ac
[CI] In-progress Slack notifications (#74012) 2020-07-31 20:56:39 -04:00
Brian Seeders
8648063b10
[CI] Harden Slack notifications (#73361) 2020-07-28 10:52:28 -04:00
Brian Seeders
2437db63ef
[CI] In-progress PR comments (#72211) 2020-07-21 16:51:58 -04:00
Spencer
a221e04b3c
[pipeline/commitStatus] update commit status in baseline-capture job (#72366)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-20 15:06:02 -07:00
Spencer
5a755ddb01
Add plugin list to docs that is generated from the repo (#71731)
Co-authored-by: Stacey Gammon <gammon@elastic.co>
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-07-16 12:17:39 -07:00
Tre
c918d2d355
[QA][Code Coverage] Upload a new Team Assignment on every ci run (#71175)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-07-16 10:34:52 -06:00
spalger
b1433e6317 remove unnecessary context reference from trigger job
(cherry picked from commit 817fdf9b439e85c3ddfda126b3efb4e45c36006b)
2020-07-14 15:08:29 -07:00
Spencer
ec43d45b51
[scripts/report_failed_tests] fix report_failed_tests integration on CI (#71131)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-07-13 12:29:29 -07:00
Spencer
b6a06dfb61
Revert #64011 and subsequent fixes (#71137)
* Revert "temporarily disable firefox functional tests in PRs (#71116)"

This reverts commit 54bd07f81b.

* Revert "[savedObjects field count] run in baseline job (#70999)"

This reverts commit 53ee7a762d.

* Revert "[CI] Add pipeline task queue framework and merge workers into one (#64011)"

This reverts commit 465ed21194.

* Revert revert of change to jenkins_xpack_visual_regression.sh

Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-08 13:05:12 -07:00
Spencer
54bd07f81b
temporarily disable firefox functional tests in PRs (#71116)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-08 10:41:09 -07:00
Spencer
53ee7a762d
[savedObjects field count] run in baseline job (#70999)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-07 14:32:04 -07:00
Brian Seeders
465ed21194
[CI] Add pipeline task queue framework and merge workers into one (#64011) 2020-07-07 14:14:30 -04:00
Tre
12460b456c
[QA] [Code Coverage] Add Three Dot Compare Url (#70525) 2020-07-02 10:01:54 -06:00
Tre
175bdb588f
[QA] [Code Coverage] Integrate with Team Assignment Pipeline and Add Research and Development Indexes and Cluster (#69348)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-30 17:00:45 -06:00
Sonja Krause-Harder
e91594aeb9
[Ingest Manager] Use DockerServers service in integration tests. (#69822)
* Partially disable test files.

* Use DockerServers in EPM tests.

* Only run tests when DockerServers have been set up

* Reenable ingest manager API integration tests

* Pass new test_packages to registry container

* Enable DockerServers tests in CI.

* Correctly serve filetest package for file tests.

* Add helper to skip test and log warning.

* Reenable further file tests.

* Add developer documentation about Docker in Kibana CI.

* Document use of yarn test:ftr

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-29 15:24:11 +02:00
Brian Seeders
1ad18794ef
[CI] Record Github commit statuses outside of PRs (#69432) 2020-06-23 13:32:03 -04:00
Spencer
051c93a6be
[ftr] add support for docker servers (#68173)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-06-18 15:24:16 -07:00
MadameSheema
dea2768545
fixes screenshots upload (#69392) 2020-06-18 08:22:50 +02:00
Spencer
5c327a12dd
[ci/getCheckoutInfo] retry fetching upstream changes to calculate mergeBase (#69320)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-06-16 13:45:20 -07:00
Spencer
0577f9bdcf
include ci-stats metrics in pr comment (#68563)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-12 16:37:38 -07:00
Brian Seeders
9c98ba9a9e
[CI] Add pipeline library unit tests (#68556) 2020-06-11 12:19:14 -04:00
Dmitry Lemeshko
1f99144ef6
update script to always download node (#68421)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-05 23:28:49 +02:00
Dmitry Lemeshko
77abbf257d
Fix code coverage for jest, upload merged reports (#68149)
* replace path in json files

* upload combined reports to artifacts for debug purpose
2020-06-03 22:21:28 +02:00
Brian Seeders
7f2e32475a
[CI] Add new intake worker size with 2x memory, and move workspace to memory (#67676)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-05-28 17:25:52 -05:00
Spencer
778b01b11a
[ci/stats] fix merge base detection (#67030)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-05-27 11:22:04 -07:00
Brian Seeders
c559eecd00
[CI] Change slack notifications icon to yellow heart for unstable (#66896) 2020-05-27 12:49:39 -04:00
spalger
49213bd20d Revert "[ci/stats] fix git metadata collection (#66840)"
This reverts commit 9eaf0c050a.
2020-05-19 08:16:56 -07:00
Spencer
9eaf0c050a
[ci/stats] fix git metadata collection (#66840) 2020-05-19 07:00:47 -07:00
Brian Seeders
c192dd0772
[CI] Fix Slack test failure names in Slack alerts (#66815) 2020-05-19 09:08:33 -04:00
Brian Seeders
e3f6da0416
Replace agent metrics link with the new one (#66632) 2020-05-15 10:41:02 -04:00
Brian Seeders
1c004e98d6
[CI] Add one retry to setup step (#66638) 2020-05-15 10:40:30 -04:00
Brian Seeders
58b77fcb34
[CI] Add slack alerts to tracked branch jobs, change default channel, change formatting (#66580) 2020-05-15 10:39:58 -04:00
Tre
4853f24705
Ingest code coverage (#62336) 2020-05-13 15:09:42 -06:00
Joe Reuter
b7e87c2c8b
Switch to core application service (#63443) 2020-05-13 09:19:24 +02:00
Brian Seeders
1bb1091abe
[CI] Slack alerts - Elasticsearch snapshot failures (#64724) 2020-05-05 10:06:37 -04:00
Brian Seeders
fb30a822b3
Add 2 flaky retries to es snapshot jobs (#64553) 2020-05-04 14:08:50 -04:00
Spencer
00ec971b6e
Implement basic CI metric reporting (#64263) 2020-04-27 13:24:52 -07:00
Spencer
4962fe9d8a
[jenkins] refer to sizes in most pipeline code (#62082)
* [jenkins] refer to sizes in most pipeline code

* switch back to `linux && immutable` for small instances

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-04-04 07:11:31 -07:00
Brian Seeders
42539a56eb
Only run xpack siem cypress in PRs when there are siem changes (#60661) 2020-03-23 10:30:14 -04:00
Brian Seeders
c22dbb1764
[CI] Add error steps and help links to PR comments (#60772) 2020-03-23 10:29:33 -04:00
MadameSheema
19f719ccb5
[SIEM] Cypress screenshots upload to google cloud (#60556)
* testing screenshots upload to google cloud

* testing another pattern

* fixes artifact pattern

* uploads only the .png files

* only limit uploads from kibana-siem directory

Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-03-19 19:44:54 -07:00
Brian Seeders
8d19fb05a1
Skip CI based on changes in PR (#59939) 2020-03-12 11:06:53 -04:00
Brian Seeders
c90cfe208d
[CI] Pipeline refactoring (#56447) 2020-03-02 15:04:27 -05:00
Spencer
4e8ab56497
build immutable bundles for new platform plugins (#53976)
* build immutable bundles for new platform plugins

* only inspect workers if configured to do so

* [navigation] use an index.scss file

* add yarn.lock symlink

* set pluginScanDirs in test so fixtures stay consistent

* cleanup helpers a little

* fix type error

* support KBN_OPTIMIZER_MAX_WORKERS for limiting workers via env

* test support for KBN_OPTIMIZER_MAX_WORKERS

* expand the available memory for workers when only running one or two

* add docs about KBN_OPTIMIZER_MAX_WORKERS environment variable

* fix README link

* update kbn/pm dist

* implement bundle caching/reuse

* update kbn/pm dist

* don't check for cache if --no-cache is passed

* update renovate config

* standardize on index.scss, move console styles over

* add support for --no-cache to cli

* include worker config vars in optimizer version

* ignore concatenated modules

* update integration test

* add safari to browserslist to avoid user-agent warnings in dev

* update docs, clean up optimizer message/misc naming

* always handle initialized messages, don't ignore states that are attached to specific events

* reword caching docs, add environment var to disable caching

* tweak logging and don't use optimizer.useBundleCache as that's disabled in dev

* handle change notifications

* batch changes for 1 second

* rename CompilerState type to CompilerMsg

* getChanges() no longer needs to assign changes to dirs

* remove unused deps

* split up run_worker.ts and share cacheKey generation logic

* add a couple docs

* update tests and remove unused imports

* specify files when creating bundle cache key

* remove one more unused import

* match existing dev cli output more closely

* update kbn/pm dist

* set KBN_NP_PLUGINS_BUILT to avoid warning in CI

* avoid extending global window type

* add note to keep pluginScanDirs in sync

* pass browserslistEnv in workerConfig so it is used for cache key

* load commons.bundle.js in parallel too

* emit initialized+success states if all bundles are cached

* load bootstraps as quickly as possible

* skip flaky suite

* bump

* update jest snapshots

* remove hashing from cache key generation

* remove unnecessary non-null assertion

* improve docs and break up Optimizer#run()

* remove unused import

* refactor kbn/optimizer to break up observable logic, implement more helpful cache invalidation logic with logging

* fix tests

* add initializing phase

* avoid rxjs observable constructor

* remove unnecessary rxjs helper, add tests for bundle cache

* update consumers of optimizer

* update readme with new call style

* replace "new platform" with "kibana platform"

* fix a couple more renames

* add support for several plain-text file formats

* fix naming of OptimizerMsg => OptimizerUpdate, use "store" naming too

* one more OptimizerMsg update

* ensure bundles are not cached when cache config is false

* test for initializing states and bundle cache events

* remove unnecessary timeout change

* Remove unnecessary helpers

* Add tests for BundleCache class

* Add tests for Bundle class

* test summarizeEvent$

* missing paths are no longer listed in mtimes map

* add tests for optimizer/cache_keys

* Add some extra docs

* Remove labeled loop

* add integration test for kbn-optimizer watcher components

* querystring-browser removed

* tweak logging a smidge, improve info and final message

* remove unused imports

* remove duplication of getModuleCount() method

* move type annotation that validates things

* clear up the build completion message

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-02-12 19:42:42 -07:00
Brian Seeders
ba151fea0b
Fix Github PR comment formatting (#56078) 2020-01-27 20:45:24 -05:00
Brian Seeders
99f224097c
Remove matrix build support (#54202) 2020-01-27 17:10:34 -05:00
Brian Seeders
4df1c4c9c1
[CI] Retry flaky tests (#53961) 2020-01-27 14:46:05 -05:00
Dmitry Lemeshko
26ce6104a9
Code coverage setup on CI (#49003)
* running code coverage in CI

* apply review feedback

* add custom function to upload merged coverage reports

* fix artifacts upload without coverage

* add file extension to fix validation

* Check code_coverage is set

* run oss tests via grunt task

* review fixes

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-01-08 21:08:48 +01:00
Brian Seeders
4b6c2f84e1
Elasticsearch snapshots automation (#53706) 2020-01-07 11:50:08 -05:00
Brian Seeders
f8f777b5ba
Add kibanamachine support to Github PR comments (#53852)
* Add kibanamachine support to Github PR comments

* Temporary commit for quick successful pipeline

* Only delete the last comment if it was made by kibanamachine

* Revert "Temporary commit for quick successful pipeline"

This reverts commit d31f579697.
2019-12-31 15:14:55 -05:00
Brian Seeders
1489c32a1d
Print out agent debugging links during CI (#52812) 2019-12-12 10:58:18 -05:00
Spencer
a25bf49eb8
Add failure screenshot links to JUnit failures (#52449) 2019-12-11 09:42:43 -07:00
Spencer
e17539c5da
[ci/pipeline/reportFailures] when aborted, run with --no-github-update (#52355) 2019-12-06 12:27:06 -07:00
Spencer
3c55e55b7a
[failed_tests_cli] update reports with links to github issues (#52048)
* [failed_tests_cli] update reports with links to github issues

* reorder test report hooks so that published Junit includes modified reports

* force failures and enable dry-run mode for debugging

* auto-switch to --dry-run when running in non-tracked branches/prs

* add --skip-junit-update flag to skip mutating the reports

* remove comma after URL to support auto-linking in Jenkins

* Revert "force failures and enable dry-run mode for debugging"

This reverts commit ac0c287a3f.

* fix method call

* extend TestResult to include relevence flag rather than wrapping

* fix createFailureIssue() tests

* make report messages more consistent, append when not dry-run

* rename module

* update snapshots to not contain valid xml

* don't send authorization header if no token defined

* merge with master modified fixtures
2019-12-05 08:46:27 -07:00
Brian Seeders
5d5a4ca0ab
Add PR comments to pipeline (#51504) 2019-12-03 18:06:30 -05:00
Brian Seeders
c8eef0458b
Experimenting with delay in test startup (#51459)
* Experimenting with delay in test startup

* Move firefox tests sooner becuase they take a long time to run

* Move functional test parallel process delay to a spot that should work better for flaky test runner
2019-12-02 14:21:38 -05:00
Brian Seeders
504604a4f2
Add labels to shell scripts in Jenkins (#49657) 2019-11-15 10:59:05 -05:00
Brian Seeders
a32213f849
Retry git clone up to 8 times before failing a build (#50734) 2019-11-15 10:55:57 -05:00
Brian Seeders
9da6c07059
Re-add pipeline for flaky test runner job (#48781)
* Revert "Revert "Add pipeline for flaky test runner job (#46740)""

This reverts commit 7d96a13fad.

Also reconcile changes to Jenkinsfile since original revert happened

* Fix param parsing and add missed change

* Add missing variable
2019-10-25 12:57:46 -04:00
Brian Seeders
7d96a13fad
Revert "Add pipeline for flaky test runner job (#46740)"
This reverts commit e89425552b.
2019-10-04 16:55:20 -04:00
Brian Seeders
e89425552b
Add pipeline for flaky test runner job (#46740)
* WIP Jenkinsfile for flaky test runner

* Fix syntax

* A few more jenkinsfile fixes

* A few more fixes

* Can't round numbers in Jenkins groovy sandbox apparently

* More fixes

* Only do build_kbn_tp_sample_panel_action once during flaky testing

* Fix path and try setting a different JOB value

* Keep track of flaky test failures

* Introduce flaky test for testing

* Some flaky test pipeline cleanup

* Fix a couple of issues with flaky test failure tracking

* Update flaky test runner build name/desc with metadata

* Revert "Introduce flaky test for testing"

This reverts commit 202e9d86cf130ef37aff1817781a5b694aa2aa32.

* Try adding a local shared library

* Move local library loading logic to kibana pipeline library

* Move shared groovy code to shared library

* Add missed file

* Add ability to specify multiple agents for flaky test runner

* Update kibana-pipeline-library version

* Fix bug causing early exit for oss ciGroup1
2019-10-04 13:53:46 -04:00