Commit graph

49 commits

Author SHA1 Message Date
Tyler Smalley
9850414b92
[ci] Removes all verbose flags (#110842)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-09-01 12:05:28 -07:00
Dmitry
119199ef41
[coverage] change worker, save json files in original path (#91683)
* [coverage] write data to original path

* [coverage] change worker size
2021-02-17 19:45:06 +01:00
Dmitry
2fe0d05375
[coverage] fix jest merging (#90915)
* [coverage] fix jest merging

* fix path to functional results

* revert wrong change

* fix ingest script

* fix ingest script

* [coverage plugin] change id to camelCase

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-02-16 18:02:56 +01:00
Tyler Smalley
08c08e88d9
[CI] Combines Jest unit tests (#89948)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-02-09 10:08:46 -08:00
Jonathan Budzenski
5c709bb6cc Revert "[CI] Combines Jest test jobs (#85850)"
This reverts commit 46ac4ed7a2.
2021-01-28 12:15:45 -06:00
Tyler Smalley
46ac4ed7a2
[CI] Combines Jest test jobs (#85850)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-01-27 07:36:10 -08:00
Tiago Costa
9139ab15fd
chore(NA): remove mocha junit ci integrations (#88129)
* chore(NA): remove mocha junit ci integrations

* chore(NA): remove mocha script from xpack

* chore(NA): single rule exclusion on eslint config for mocha

* chore(NA): remove unused custom mocha integration code from kbn/test

* chore(NA): rewording packages readme

* docs(NA): remoe mocha mention from development-unit-tests
2021-01-15 21:17:25 +00:00
Jonathan Budzenski
51ba94d3e5
[dev] Replace sass-lint with stylelint (#86177)
Co-authored-by: Tyler Smalley <tylersmalley@me.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Dave Snider <dave.snider@gmail.com>
2021-01-15 11:52:29 -06:00
Dmitry
b10be9ec6f
[coverage] do not collect stats for mocha (#87859) 2021-01-11 21:00:00 +01:00
Dmitry
899f4dd2f8
[coverage] Improve stability and report stats (#86449)
* improve reporting

* ignore failing tests
2020-12-18 16:46:34 +01:00
Dmitry
2fcce0bcbc
[coverage] re-enable jest (#85946)
* [coverage] re-enable jest

* fix coverage script for x-pack

* use presets in entry configs

* set max workers

* run tests from x-pack folde

* remove duplicate 'reporters' prop

* remove reporters for x-pack config

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-12-16 20:20:55 +01:00
Tyler Smalley
504c8739de
test:jest improvements to better support our monorepo (#84848)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-12-14 14:07:50 -08:00
Tyler Smalley
9b62100428
Removes Grunt abstraction from CI tasks (#85210)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2020-12-09 08:51:32 -08:00
Dmitry
ec1666be5a
Skip jest coverage on CI (#85375)
* [coverage] skip running jest tests

* run mocha only

* skip uploading jest artifacts
2020-12-09 16:31:00 +01:00
Dmitry
2634009a5b
[code coverage] collect for oss integration tests (#83907)
* [code coverage] collect for oss integration tests

* do not run snapshot test modified with coverage

* skip failures

* remove debug msg

* update file names

* Update packages/kbn-optimizer/src/integration_tests/basic_optimization.test.ts

Co-authored-by: Spencer <email@spalger.com>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Spencer <email@spalger.com>
2020-11-24 20:32:35 +01:00
Dmitry Lemeshko
d6aff77485
remove NODE_ENV=test (#58037)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-02-20 13:12:04 +01:00
Brian Seeders
99f224097c
Remove matrix build support (#54202) 2020-01-27 17:10:34 -05:00
Dmitry Lemeshko
26ce6104a9
Code coverage setup on CI (#49003)
* running code coverage in CI

* apply review feedback

* add custom function to upload merged coverage reports

* fix artifacts upload without coverage

* add file extension to fix validation

* Check code_coverage is set

* run oss tests via grunt task

* review fixes

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-01-08 21:08:48 +01:00
Spencer
ed382bca33
remove report_failed_tests fallback for matrix jobs (#48809) 2019-10-21 16:17:32 -07:00
Spencer
9b34d6b76f
refactor failed_tests_reporter to use TS, no octokit (#46993)
* refactor failed_tests_reporter to use TS, no octokit

* update renovate config

* ensure that all kbn-test files are in ts project

* fix some type errors

* add some more tests

* [kbn-test/githubapi] cleanup and document

* collect log messages as strings instead of message objects

* ensure issue is open when updating body

* improve readability of getKibanaIssues

* expose axios helpers from dev-utils

* fix request params for fetching github issues and validate locally

* include a README for failed_tests_reporter

* improve axios error helpers
2019-10-08 13:56:07 -07:00
Brian Seeders
cafc857aba Re-split ciGroups after pipeline rollout (#46375)
* Re-split ciGroups after pipeline rollout

Revert "Revert "Revert "Revert "Revert "[ci] compress jobs for CI stab… (#45454)"

This reverts commit 9a109f2170.

Revert "set IS_PIPELINE_JOB in intake jobs (#45850)"

This reverts commit b1a01effa8.

* Split one of the slow test suites up to try to make overall CI faster

* Disable visualRegression groups, they are being handled in other work

* Revert "Split one of the slow test suites up to try to make overall CI faster"

This reverts commit 1213239545.

* Move some different xpack ciGroup8 suites around
2019-09-25 15:18:37 -07:00
Spencer
ef5c520826
Call failure reporter directly from Jenkinsfile (#45551)
* Run failed_tests/cli once per node

* force failures for testing

* Revert "force failures for testing"

This reverts commit 3ddd9240fe.
2019-09-13 11:15:38 -07:00
Spencer
9a109f2170
Revert "Revert "Revert "Revert "[ci] compress jobs for CI stab… (#45454)
* Revert "Revert "Revert "Revert "[ci] compress jobs for CI stability" (#44584)"""

This reverts commit 148b8c0f90.

* sync changes with Jenkinsfile
2019-09-11 15:27:43 -07:00
Brian Seeders
27d23c4184 Jenkins pipeline with parallel cigroups (#45285)
* Pipeline

* WIP some work for parallelization with ciGroups

* Fix xpack kibana install dir, and add some debugging

* Attempt to quick fix a few tests

* Revert "Revert "Revert "[ci] compress jobs for CI stability" (#44584)""

This reverts commit 078ac2897f.

* Recombine test groups, and try runbld again

* Mostly cleanup, and fix failed_tests reporting to hopefully work for both pipeline and non-pipeline

* Fix typo in shell script

* Remove some debug code

* Add support for changing es transport.port during testing via TEST_ES_TRANSPORT_PORT

* Fix test that uses hard-coded es transport port and add it back in to parallel groups

* Disable checks reporter again for now

* Set env var for TEST_ES_TRANSPORT_PORT in pipeline

* Update Jenkinsfile for shorter testrunner labels

* Fix another hard-coded transport port

* Fix a new test with hard-coded URLs

* Jenkinsfile cleanup and fix one of the groups

* Fix double slash

* Testing vault credentials on jenkins server

* Add a non-existent credential

* Revert "Add a non-existent credential"

This reverts commit 0dc234c465a5483b1a994cb510a182fef766e9cc.

* Try github-checks-reporter again

* github-checks-reporter should only run for elastic/kibana, forks won't work

* Clean up some debug code

* Changing names around to try to make BlueOcean UI a little better

* Add more stages

* Make some changes to stage structure to mirror a nested example from CloudBees

* Handle TODOs, and some cleanup in Jenkinsfile

* Pass GIT_BRANCH when started without GHPRB, fix branch check

* Fix mailer problem and add code that ensures all tests are in cigroups back in

* Test adding worker/job name to junit report paths

* Remove some duplication from ci_setup scripts

* Fix unit test that uses junit path

* Don't reinstall node every time setup_env is run

* Fix yarn install logic

* Fix another unit test that uses junit output dir

* Download latest ES snapshot after kibana builds

* Make sure junit reports are always processed

* Add two failing tests for testing purposes

* Add support to Jenkinsfile for kibana build e-mails

* Remove some debug code for email sending

* Change JOB env handling in junit paths and move it to a sub-directory

* Revert "Add two failing tests for testing purposes"

This reverts commit 5715203e26922a93483feb0ebb8bb3fdcc3daf8c.

* Fix junit report path in test

* Don't send kibana emails on build abort

* Address PR feedback, formatting and use built-in url formatting library

* Fix path formatting for functional test

* Add email sending back in to Jenkinsfile

* Fix another unit test with path problem
2019-09-11 11:58:28 -07:00
spalger
078ac2897f Revert "Revert "[ci] compress jobs for CI stability" (#44584)"
This reverts commit 50355d08f2.
2019-09-10 09:03:23 -07:00
Spencer
50355d08f2
Revert "[ci] compress jobs for CI stability" (#44584)
This reverts commit debf8c62b4.
2019-09-03 08:36:47 -07:00
spalger
debf8c62b4 [ci] compress jobs for CI stability 2019-08-28 22:31:40 -07:00
Spencer
3bc5595ce3
[testFailureReporting] only run on master/version jobs (#38497) 2019-06-10 07:04:32 -07:00
Spencer
06195e9d8b
Refactor ES-related environment variables (#33036)
* [ci/es] base default es version on pkg.branch value

* [ci/env] initialize $TEST_ES_FROM in checkout_sibling_es.sh

* [UA] remove TEST_ES_SNAPSHOT_VERSION override

* [ci/es] call checkout_sibling_es.sh from one location

* [ci] remove unused `--from` param

* [ci/env] always default to snapshots, switch to source when necessary

* [kbn/test] default esFrom to $TEST_ES_FROM

* [ci/setup] fix define order

* [ci/grunt] don't pass --esFrom let env pass through

* [ci/env] use branch, not version

* [ci] use same indent style as following lines

* [kbn/test] apply default values when processing args

* [kbn/test] simplify defaults, read default on each process
2019-03-13 11:51:06 -07:00
Tyler Smalley
ef1e5b4288 [ci] Use trap to generate report for non-PR build (#26829)
Since this is no longer part of a reporting task in Jenkins, we no
longer need to re-run kbn bootstrap when generating a report.

We use the PR_SOURCE_BRANCH environment variable to prevent genererating
Github issues when we are on a PR.

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2019-01-08 17:13:12 -06:00
spalger
9e94fef2ee [ci] every script needs to have set -e 2018-11-29 03:08:10 -08:00
Spencer
555036447d
[ci] simplify ci_setup scripts (#26215)
Cleanup some of the legacy bits from our ci_setup, simplify the setup necessary in child CI scripts, and unify the more generic bits of the scripts.
2018-11-28 15:37:36 -08:00
Tiago Costa
a6818b392d
Run jenkins:unit task with dev flag in order to run license check (#19832)
* chore(19674): added dev flag when calling jenkins:unit grunt task so we can check dev licenses on ours ci jobs.

* chore(NA): update yarn lock files with integrity info.
2018-11-12 19:02:48 +00:00
liza-mae
fabbfdcd12
Replace xvfb with headless browser (#24904)
* Replace xvfb with headless browser

* Update karma to run in headless chrome

Update Karma tests for an option to run chrome in headless.

* Fix lint issues

* Fix spaces
2018-11-05 10:40:42 -07:00
Jonathan Budzenski
03553dedbc [ci] Run ES snapshot when possible (#22663)
For instances where we would otherwise be running from source in a tracked elastic/elasticsearch branch, let's use a snapshot instead. This will eliminate some gradle issues we are experiencing in master.
2018-09-06 16:31:47 -07:00
Spencer
f24a725144
[mocha] remove grunt-simple-mocha (#19079)
* [mocha] run tests with mocha script, remove grunt-simple-mocha

* [ci] force colored output

* [ci] disable color when reading the yarn bin

* [dev/build/exec] support tooling log having its own chalk

* [dev/mocha] avoid changing the cwd of the process

* [dev/mocha] only match files, speed up negative matches

* [cli/serve/test] strip ansi control characters from logs

* [ci] disable color in all `yarn bin` invocations

* [dev/mocha] cleanup old runInBand check

* [dev/mocha] enable gloabl leak checks
2018-05-16 10:43:55 -07:00
Jenkins CI
fe4609647d Migrate x-pack-kibana source to kibana 2018-04-24 13:48:10 -07:00
Kim Joar Bekkelund
e5d33e992a
Move running projects tests into Grunt task (#16946) 2018-03-09 14:28:47 +01:00
CJ Cenizal
eb49a8c449
Add test-subj-selector module to packages dir. (#16623)
* Add test-subj-selector module to packages dir.
* Rename to @kbn/test-subj-selector.
* Simplify rejectRejFiles Grunt task and ignore nested node_modules.
* Update jenkins_unit script to use yarn kbn CLI.
2018-02-13 10:34:47 -08:00
spalger
f2924aa0e9 run kbn-plugin-helpers tests on ci 2018-02-08 11:57:08 -07:00
Spencer
0fde087ca2 Switch to Yarn (#15485)
* switch to yarn

* cleanup misc references to npm

* [yarn] loosen dependency ranges so yarn will merge more deps

* fix linting error now that moment uses ESM

* [licenses] font-awesome changed the format of its license id

* Use local yarn

* Misc fixes

* eslintignore built yarn file

* Remove mkdir which doesn't do what it should do

* Check build without upgrading lots of versions

* Fix license check

* too many moments

* Better description

* Review fixes

* Lock to angular@1.6.5

* More specific version locks

* Revert "More specific version locks"

This reverts commit 11ef81102e.

* Revert "Lock to angular@1.6.5"

This reverts commit 3ade68c14c.

* rm yarn.lock; yarn

* Forcing a specific version of React, Angular, Moment

* Using vendored version of yarn in ci

* Use --frozen-lockfile

* fixes
2018-01-10 13:23:43 +01:00
Spencer
999126373f
[dev/ci_setup] generalize jenkins_setup script for other CI environments (#15178)
* [dev/ci_setup] generalize jenkins_setup script for other CI environments

* [dev/ci_setup] accept more general `CACHE_DIR` env arg

* [dev/ci_setup] node.js install might not be invalid
2017-11-30 10:26:03 -07:00
Spencer
ca049508c2 [ci] only build kibana once (#11717) 2017-05-11 13:12:30 -07:00
Court Ewing
9e39956c27 build: always run build task in jenkins (#10689)
We always run the build task now in jenkins jobs rather than only in the
core builds. This ensures that the build task runs in PR builds even
though the build artifacts are not used for anything.

Ideally all the selenium tests would run against this build rather than
it just being something that gets ran and forgotten about, but this is a
first step.
2017-03-03 12:57:21 -05:00
spalger
8adaecb9be [ci] source the setup script instead of executing it 2016-07-05 12:46:53 -07:00
spalger
e98c3d4c42 [ci] tweak ci scripts to debug 2016-07-05 11:08:22 -07:00
spalger
b7c8db694a [ci] run the unit tests with xvfb-run 2016-07-01 12:22:39 -07:00
spalger
7df6040536 [ci] split unit and selenium tasks into separate jenkins scripts 2016-07-01 11:31:02 -07:00
spalger
cb0659f98d [ci] move ci setup tasks into source control
Until now, the ci setup tasks were stored in the Jenkins job configuration. This moves the setup into source control so that jenkins can be told to execute `./test/scripts/jenkins_{JOB_TYPE}.sh` no matter what branch of kibana it is dealing with.
2016-06-30 12:50:56 -07:00