Commit graph

125 commits

Author SHA1 Message Date
Spencer
a221e04b3c
[pipeline/commitStatus] update commit status in baseline-capture job (#72366)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-20 15:06:02 -07:00
Spencer
b695d60516
[baseline/capture] use high-memory nodes with ramDisks (#71894)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-16 17:13:32 -07:00
Spencer
5a755ddb01
Add plugin list to docs that is generated from the repo (#71731)
Co-authored-by: Stacey Gammon <gammon@elastic.co>
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-07-16 12:17:39 -07:00
Tre
c918d2d355
[QA][Code Coverage] Upload a new Team Assignment on every ci run (#71175)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-07-16 10:34:52 -06:00
Tyler Smalley
f0b4986099
Restores task for downloading Chromium builds (#71749)
This was removed in https://github.com/elastic/kibana/pull/69165 without
realizing it was used by the packer cache. I renamed it to be more
inline with what it actually does.

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-07-15 06:53:40 -07:00
spalger
e318ea76dc fix triggered job name 2020-07-14 15:10:01 -07:00
spalger
b1433e6317 remove unnecessary context reference from trigger job
(cherry picked from commit 817fdf9b439e85c3ddfda126b3efb4e45c36006b)
2020-07-14 15:08:29 -07:00
spalger
a81d8b55ab rename visual_baseline -> baseline_capture 2020-07-14 15:01:39 -07:00
Brian Seeders
a5c9c4ec43 [CI] Add baseline trigger job 2020-07-14 15:01:32 -07:00
Tyler Smalley
afe785b43a
[build] Creates Linux aarch64 archive (#69165)
- Updates Linux Chromium builds to accept architecture argument (defaults to x64) for arm64 support.
  - Example: `python ~/chromium/build_chromium/build.py 312d84c8ce62810976feda0d3457108a6dfff9e6 arm64`
- Updates all Chromium builds to include architecture in filename. 
  - `chromium-312d84c-linux_arm64.zip` _(new)_
  - `chromium-312d84c-linux.zip` > `chromium-312d84c-linux_x64.zip`
- Moves Chromium install from data directory to `x-pack/plugins/reporting/chromium`
- Moves Chromium download cache from `x-pack/plugins/reporting/.chromium` to `.chromium`
- Installs Chromium during build (closes #53664)
- Updates build to be architecture aware (x64 and aarch64)
- Removed Chromium debug logs, they were not helpful and can not be written inside the Kibana root. If we were to keep them, we would need to write to `logging.dist`.

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-07-09 19:42:48 -07:00
spalger
8e2277a667 send slack notifications on visual baseline failures 2020-07-09 15:04:51 -07:00
Spencer
b6a06dfb61
Revert #64011 and subsequent fixes (#71137)
* Revert "temporarily disable firefox functional tests in PRs (#71116)"

This reverts commit 54bd07f81b.

* Revert "[savedObjects field count] run in baseline job (#70999)"

This reverts commit 53ee7a762d.

* Revert "[CI] Add pipeline task queue framework and merge workers into one (#64011)"

This reverts commit 465ed21194.

* Revert revert of change to jenkins_xpack_visual_regression.sh

Co-authored-by: spalger <spalger@users.noreply.github.com>
2020-07-08 13:05:12 -07:00
Brian Seeders
465ed21194
[CI] Add pipeline task queue framework and merge workers into one (#64011) 2020-07-07 14:14:30 -04:00
Victor Martinez
564e91fdec
[APM-UI] e2e speed up build (#70704) 2020-07-06 07:41:32 +01:00
liza-mae
52f8d3a58b
Build docker image for elasticsearch snapshot (#70482)
* Build docker image for elasticsearch snapshot

* Consolidate statements

* Update .ci/es-snapshots/Jenkinsfile_build_es

Co-authored-by: Brian Seeders <seeders@gmail.com>

* Update find

* Use larger worker

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Brian Seeders <seeders@gmail.com>
2020-07-02 13:41:23 -06:00
Tre
12460b456c
[QA] [Code Coverage] Add Three Dot Compare Url (#70525) 2020-07-02 10:01:54 -06:00
Tre
f428b2dabe
[QA][Code Coverage] Drop catchError and use try / catch instead, (#69198)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-30 17:07:24 -06:00
Tre
175bdb588f
[QA] [Code Coverage] Integrate with Team Assignment Pipeline and Add Research and Development Indexes and Cluster (#69348)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-30 17:00:45 -06:00
Brian Seeders
1ad18794ef
[CI] Record Github commit statuses outside of PRs (#69432) 2020-06-23 13:32:03 -04:00
Brian Seeders
beb0da1d58
[CI] Fix packer cache git branch reference value (#69207) 2020-06-16 17:03:59 -04:00
Victor Martinez
88eed9819c
[CI] GitHub check details link to test reports and errorlevel (#69157) 2020-06-16 07:23:10 +01:00
Brian Seeders
9c98ba9a9e
[CI] Add pipeline library unit tests (#68556) 2020-06-11 12:19:14 -04:00
Tre
5bfd704dd8
[QA] slack notify on failure (#68126) 2020-06-05 10:49:06 -06:00
Tim Sullivan
2f67cbfa9c
[Reporting] Move code out of Legacy (#67904)
* [Reporting] Move code out of Legacy

* Elasticsearch is not a plugin dep

* add data as plugin dependo

* diff cleanup 1

* log the browser download

* Update paths in outside code for new Reporting home

* fix download test

* add numeral typing for x-pack/test

* Fix jest tests for np migration

* Shorten import paths

* remove this file, add typings to the node module

* remove local typing that has been provided by node module

* Add optional security plugin dep

* revert conflicting apm typings removal

* fix i18n

* fix snakecase whitelist

Co-authored-by: Joel Griffith <joel.griffith@elastic.co>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-06-03 15:40:56 -07:00
Dmitry Lemeshko
77abbf257d
Fix code coverage for jest, upload merged reports (#68149)
* replace path in json files

* upload combined reports to artifacts for debug purpose
2020-06-03 22:21:28 +02:00
Brian Seeders
add5b11611
[CI] Fix packer cache node_modules references 2020-06-01 14:41:30 -04:00
Tiago Costa
d431b3cf0b
chore(NA): add support for accessibility test group on jenkins flaky test runner (#67652) 2020-05-28 18:31:42 +01:00
Brian Seeders
dc3d259f10
Revert "[CI] Fix packer cache node_modules references (#67208)"
This reverts commit b2019c1924.
2020-05-27 17:25:53 -04:00
Brian Seeders
c559eecd00
[CI] Change slack notifications icon to yellow heart for unstable (#66896) 2020-05-27 12:49:39 -04:00
Brian Seeders
b2019c1924
[CI] Fix packer cache node_modules references (#67208) 2020-05-27 10:47:47 -04:00
Victor Martinez
abcee098f1
ci(jenkins): use APM e2e in the CI (#61803) 2020-05-26 16:18:25 +01:00
Spencer
604e5c4a72
[ci-stats] track baseline job (#66440) 2020-05-13 14:10:09 -07:00
Tre
4853f24705
Ingest code coverage (#62336) 2020-05-13 15:09:42 -06:00
Brian Seeders
283b61b1d8
Increase verify es job timeout to 2.5 hours (#65313) 2020-05-05 13:59:55 -04:00
Søren Louv-Jansen
e02350cdc7
[APM] Update path to APM app after move to NP (#65034) 2020-05-05 18:22:47 +02:00
Brian Seeders
1bb1091abe
[CI] Slack alerts - Elasticsearch snapshot failures (#64724) 2020-05-05 10:06:37 -04:00
Brian Seeders
fb30a822b3
Add 2 flaky retries to es snapshot jobs (#64553) 2020-05-04 14:08:50 -04:00
Dmitry Lemeshko
bac638a37e
Update jest config for coverage (#64648)
* set files to track for coverage collection

* increase timeout to 4h

* trying to add detectOpenHandles to avoid worker stuck

* update config

* make config paths more common

* update configs

* update jest oss config

* exclude 'tests' folder for coverage
2020-04-29 20:00:14 +03:00
Spencer
4962fe9d8a
[jenkins] refer to sizes in most pipeline code (#62082)
* [jenkins] refer to sizes in most pipeline code

* switch back to `linux && immutable` for small instances

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-04-04 07:11:31 -07:00
Uladzislau Lasitsa
5d5c012f3b
Migrate test plugins ⇒ NP (kbn_tp_sample_panel_action) (#60749)
* Migrated sample_action to NP. Panel action tests returned to the test flow.

* fixed names

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-04-01 17:11:33 +03:00
Spencer
4bc9e8b4a8
Fix visual baseline job (#59348)
* Establish Percy baselines

* move Jenkinsfile changed back to `.ci` directory

* rename xpack workers

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-03-05 13:01:42 -07:00
Spencer
692c1d0713
[ci] add Jenkinsfile for visual baseline job (#52154)
* [ci] add Jenkinsfile for visual baseline job

* fixup the jenkinsfile

* update jenkinsfile syntax
2020-03-03 18:15:44 -07:00
Brian Seeders
c90cfe208d
[CI] Pipeline refactoring (#56447) 2020-03-02 15:04:27 -05:00
Manuel de la Peña
d27b6c05d3
Migrate existing Cypress tests to Cypress + Cucumber (#57299)
* chore: move gitignore to the cypress directory

* chore: ignore more test files

* fix: do not check the Loading Message

It seems not relevant to the main purpose of these tests

* chore: use cypres + webpack + cucumber scaffolding

See https://github.com/TheBrainFamily/cypress-cucumber-webpack-typescript-example

* chore: add eslint and prettier for code linting

* feat: convert existing Cypress test into BDD style

* feat: add support for using proper Node version in MacOSX

* chore: use tslint

* chore: use old layout

We are keeping cypress as rootDir to follow project's structure. On the other hand,
having a second cypress directory at the 2nd level is the default structure, as shown
in the examples:
- https://github.com/TheBrainFamily/cypress-cucumber-webpack-typescript-example
- a240054d7f/examples/preprocessors__typescript-webpack

* chore: remove prelint script meanwhile we fix TS lint

* chore: move test results to a specific directory

* chore: rename variable following old code

* chore: remove non-needed lints, as we are going to use kibana build

* chore: import snapshot function from cypress

* chore: add readFile utils back from a bad removal

* chore: change format of JSON spec file

It was automatically changed by tests

* chore: move CI directory to the proper layout in order for Jenkins to work

* chore: store test-results from proper dir on Jenkins

* chore: store artifacts properly on Jenkins

* Fix type issues

* chore: rename test application to e2e (end-to-end)

We are keeping the build system within the test application, isolating dependencies

* docs: reorganise docs for APM UI e2e tests

* fix: Use proper cypress support file

* chore: use existing NPM script for running cypress on CI

* chore: update paths in CI scripts

* docs: document how the CI runs the tests

* chore: use Node 10 for tests

* chore: Use kibana's Node version for tests

* chore: run yarn install

* docs: update docs

* fix: path was wrong

* docs: fix paths and flags used to load data

* docs: elasticsearch fix flag

* docs: Bootstrap kibana before running it

* docs: remove outdated info

* chore: move background steps to the scenario

This would avoid not reading the background when the number of scenarios grows

Co-authored-by: Dario Gieselaar <d.gieselaar@gmail.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-02-26 11:00:54 -08:00
Dmitry Lemeshko
d6aff77485
remove NODE_ENV=test (#58037)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-02-20 13:12:04 +01:00
Victor Martinez
446fda62f2
[jenkins] Notify GH Checks for the apm-ui e2e pipeline (#52900) 2020-02-18 08:25:14 +00:00
Dmitry Lemeshko
25fb555a53
Code coverage: run functional tests from repo copy (#55195)
* run functional tests from cloned folders

* do not copy kibana.yml

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-01-29 14:36:47 +01:00
Brian Seeders
99f224097c
Remove matrix build support (#54202) 2020-01-27 17:10:34 -05:00
Brian Seeders
12bfd3bf77
Fix number of executions per agent in flaky test job (#54311) 2020-01-09 09:48:22 -05:00
Dmitry Lemeshko
26ce6104a9
Code coverage setup on CI (#49003)
* running code coverage in CI

* apply review feedback

* add custom function to upload merged coverage reports

* fix artifacts upload without coverage

* add file extension to fix validation

* Check code_coverage is set

* run oss tests via grunt task

* review fixes

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-01-08 21:08:48 +01:00