Commit graph

37 commits

Author SHA1 Message Date
Tyler Smalley 7e096a0a79
[ci] Removes all verbose flags (#110842) (#111216)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-09-03 18:34:44 -04:00
Tiago Costa 7bdac0bea4
chore(NA): remove mocha junit ci integrations (#88129) (#88534)
* chore(NA): remove mocha junit ci integrations

* chore(NA): remove mocha script from xpack

* chore(NA): single rule exclusion on eslint config for mocha

* chore(NA): remove unused custom mocha integration code from kbn/test

* chore(NA): rewording packages readme

* docs(NA): remoe mocha mention from development-unit-tests
# Conflicts:
#	docs/developer/contributing/development-unit-tests.asciidoc
#	test/scripts/jenkins_unit.sh
2021-01-16 00:01:29 +00:00
Jonathan Budzenski 1dc3276e74
[7.x] [dev] Replace sass-lint with stylelint (#86177) (#88498)
Co-authored-by: Tyler Smalley <tylersmalley@me.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Dave Snider <dave.snider@gmail.com>

Co-authored-by: Tyler Smalley <tylersmalley@me.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Dave Snider <dave.snider@gmail.com>
2021-01-15 14:36:34 -06:00
Tyler Smalley 82225db0a3
test:jest improvements to better support our monorepo (#84848) (#85880)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
# Conflicts:
#	docs/developer/contributing/development-functional-tests.asciidoc
#	test/scripts/jenkins_unit.sh
#	test/scripts/jenkins_xpack.sh
#	x-pack/README.md

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-12-15 09:11:51 -08:00
Tyler Smalley 0c9a3c0979
[7.x] Removes Grunt abstraction from CI tasks (#85210) (#85448)
* Removes Grunt abstraction from CI tasks (#85210)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
# Conflicts:
#	tasks/config/run.js
#	test/scripts/jenkins_ci_group.sh
#	test/scripts/jenkins_unit.sh

* [CI] Set correct script execute permissions (#85475)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-12-09 14:54:03 -08:00
Brian Seeders 2de2658f4d
Remove matrix build support (#54202) (#56170) 2020-01-28 16:55:29 -05:00
Spencer fa543a3960
remove report_failed_tests fallback for matrix jobs (#48809) (#48846) 2019-10-22 06:31:43 -07:00
Spencer 3fadf26699
[7.x] refactor failed_tests_reporter to use TS, no octokit (#4… (#47631)
* refactor failed_tests_reporter to use TS, no octokit

* update renovate config

* ensure that all kbn-test files are in ts project

* fix some type errors

* add some more tests

* [kbn-test/githubapi] cleanup and document

* collect log messages as strings instead of message objects

* ensure issue is open when updating body

* improve readability of getKibanaIssues

* expose axios helpers from dev-utils

* fix request params for fetching github issues and validate locally

* include a README for failed_tests_reporter

* improve axios error helpers

# Conflicts:
#	packages/kbn-test/src/index.ts
#	renovate.json5
2019-10-08 15:18:34 -07:00
Spencer 2e2e1ea39b
[7.x] Re-split ciGroups after pipeline rollout (#46375) (#46643)
* Re-split ciGroups after pipeline rollout

Revert "Revert "Revert "Revert "Revert "[ci] compress jobs for CI stab… (#45454)"

This reverts commit 9a109f2170.

Revert "set IS_PIPELINE_JOB in intake jobs (#45850)"

This reverts commit b1a01effa8.

* Split one of the slow test suites up to try to make overall CI faster

* Disable visualRegression groups, they are being handled in other work

* Revert "Split one of the slow test suites up to try to make overall CI faster"

This reverts commit 1213239545.

* Move some different xpack ciGroup8 suites around
2019-09-25 17:21:47 -07:00
Spencer 65a31173c2
[7.x] Call failure reporter directly from Jenkinsfile (#45551) (#45668)
* Run failed_tests/cli once per node

* force failures for testing

* Revert "force failures for testing"

This reverts commit 3ddd9240fe.
2019-09-13 13:43:48 -07:00
Spencer 5fc3d0639f Revert "Revert "Revert "Revert "[ci] compress jobs for CI stab… (#45454)
* Revert "Revert "Revert "Revert "[ci] compress jobs for CI stability" (#44584)"""

This reverts commit 148b8c0f90.

* sync changes with Jenkinsfile

(cherry picked from commit 9a109f2170)
2019-09-11 15:28:14 -07:00
Brian Seeders 17670959dc Jenkins pipeline with parallel cigroups (#45285)
* Pipeline

* WIP some work for parallelization with ciGroups

* Fix xpack kibana install dir, and add some debugging

* Attempt to quick fix a few tests

* Revert "Revert "Revert "[ci] compress jobs for CI stability" (#44584)""

This reverts commit 078ac2897f.

* Recombine test groups, and try runbld again

* Mostly cleanup, and fix failed_tests reporting to hopefully work for both pipeline and non-pipeline

* Fix typo in shell script

* Remove some debug code

* Add support for changing es transport.port during testing via TEST_ES_TRANSPORT_PORT

* Fix test that uses hard-coded es transport port and add it back in to parallel groups

* Disable checks reporter again for now

* Set env var for TEST_ES_TRANSPORT_PORT in pipeline

* Update Jenkinsfile for shorter testrunner labels

* Fix another hard-coded transport port

* Fix a new test with hard-coded URLs

* Jenkinsfile cleanup and fix one of the groups

* Fix double slash

* Testing vault credentials on jenkins server

* Add a non-existent credential

* Revert "Add a non-existent credential"

This reverts commit 0dc234c465a5483b1a994cb510a182fef766e9cc.

* Try github-checks-reporter again

* github-checks-reporter should only run for elastic/kibana, forks won't work

* Clean up some debug code

* Changing names around to try to make BlueOcean UI a little better

* Add more stages

* Make some changes to stage structure to mirror a nested example from CloudBees

* Handle TODOs, and some cleanup in Jenkinsfile

* Pass GIT_BRANCH when started without GHPRB, fix branch check

* Fix mailer problem and add code that ensures all tests are in cigroups back in

* Test adding worker/job name to junit report paths

* Remove some duplication from ci_setup scripts

* Fix unit test that uses junit path

* Don't reinstall node every time setup_env is run

* Fix yarn install logic

* Fix another unit test that uses junit output dir

* Download latest ES snapshot after kibana builds

* Make sure junit reports are always processed

* Add two failing tests for testing purposes

* Add support to Jenkinsfile for kibana build e-mails

* Remove some debug code for email sending

* Change JOB env handling in junit paths and move it to a sub-directory

* Revert "Add two failing tests for testing purposes"

This reverts commit 5715203e26922a93483feb0ebb8bb3fdcc3daf8c.

* Fix junit report path in test

* Don't send kibana emails on build abort

* Address PR feedback, formatting and use built-in url formatting library

* Fix path formatting for functional test

* Add email sending back in to Jenkinsfile

* Fix another unit test with path problem

(cherry picked from commit 27d23c4184)

# Conflicts:
#	src/dev/ci_setup/setup.sh
#	src/dev/failed_tests/cli.js
2019-09-11 12:23:33 -07:00
spalger 65003f0cbc Revert "Revert "[ci] compress jobs for CI stability" (#44584) (#44673)"
This reverts commit 2584383be1.
2019-09-10 09:04:36 -07:00
Spencer 2584383be1
Revert "[ci] compress jobs for CI stability" (#44584) (#44673)
This reverts commit debf8c62b4.
2019-09-03 12:25:06 -07:00
Spencer 408bf82284
[ci] compress jobs for CI stability (#44353)
# Conflicts:
#	x-pack/test/functional/apps/dashboard_mode/index.js
#	x-pack/test/upgrade_assistant_integration/upgrade_assistant/index.js
2019-08-29 05:10:13 -07:00
Spencer 238d24f38e
[7.x] [testFailureReporting] only run on master/version jobs (#38497) (#38547) 2019-06-10 08:35:08 -07:00
Spencer a053a55013
Refactor ES-related environment variables (#33036) (#33169)
* [ci/es] base default es version on pkg.branch value

* [ci/env] initialize $TEST_ES_FROM in checkout_sibling_es.sh

* [UA] remove TEST_ES_SNAPSHOT_VERSION override

* [ci/es] call checkout_sibling_es.sh from one location

* [ci] remove unused `--from` param

* [ci/env] always default to snapshots, switch to source when necessary

* [kbn/test] default esFrom to $TEST_ES_FROM

* [ci/setup] fix define order

* [ci/grunt] don't pass --esFrom let env pass through

* [ci/env] use branch, not version

* [ci] use same indent style as following lines

* [kbn/test] apply default values when processing args

* [kbn/test] simplify defaults, read default on each process
2019-03-13 13:18:51 -07:00
Tyler Smalley ef1e5b4288 [ci] Use trap to generate report for non-PR build (#26829)
Since this is no longer part of a reporting task in Jenkins, we no
longer need to re-run kbn bootstrap when generating a report.

We use the PR_SOURCE_BRANCH environment variable to prevent genererating
Github issues when we are on a PR.

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2019-01-08 17:13:12 -06:00
spalger 9e94fef2ee [ci] every script needs to have set -e 2018-11-29 03:08:10 -08:00
Spencer 555036447d
[ci] simplify ci_setup scripts (#26215)
Cleanup some of the legacy bits from our ci_setup, simplify the setup necessary in child CI scripts, and unify the more generic bits of the scripts.
2018-11-28 15:37:36 -08:00
Tiago Costa a6818b392d
Run jenkins:unit task with dev flag in order to run license check (#19832)
* chore(19674): added dev flag when calling jenkins:unit grunt task so we can check dev licenses on ours ci jobs.

* chore(NA): update yarn lock files with integrity info.
2018-11-12 19:02:48 +00:00
liza-mae fabbfdcd12
Replace xvfb with headless browser (#24904)
* Replace xvfb with headless browser

* Update karma to run in headless chrome

Update Karma tests for an option to run chrome in headless.

* Fix lint issues

* Fix spaces
2018-11-05 10:40:42 -07:00
Jonathan Budzenski 03553dedbc [ci] Run ES snapshot when possible (#22663)
For instances where we would otherwise be running from source in a tracked elastic/elasticsearch branch, let's use a snapshot instead. This will eliminate some gradle issues we are experiencing in master.
2018-09-06 16:31:47 -07:00
Spencer f24a725144
[mocha] remove grunt-simple-mocha (#19079)
* [mocha] run tests with mocha script, remove grunt-simple-mocha

* [ci] force colored output

* [ci] disable color when reading the yarn bin

* [dev/build/exec] support tooling log having its own chalk

* [dev/mocha] avoid changing the cwd of the process

* [dev/mocha] only match files, speed up negative matches

* [cli/serve/test] strip ansi control characters from logs

* [ci] disable color in all `yarn bin` invocations

* [dev/mocha] cleanup old runInBand check

* [dev/mocha] enable gloabl leak checks
2018-05-16 10:43:55 -07:00
Jenkins CI fe4609647d Migrate x-pack-kibana source to kibana 2018-04-24 13:48:10 -07:00
Kim Joar Bekkelund e5d33e992a
Move running projects tests into Grunt task (#16946) 2018-03-09 14:28:47 +01:00
CJ Cenizal eb49a8c449
Add test-subj-selector module to packages dir. (#16623)
* Add test-subj-selector module to packages dir.
* Rename to @kbn/test-subj-selector.
* Simplify rejectRejFiles Grunt task and ignore nested node_modules.
* Update jenkins_unit script to use yarn kbn CLI.
2018-02-13 10:34:47 -08:00
spalger f2924aa0e9 run kbn-plugin-helpers tests on ci 2018-02-08 11:57:08 -07:00
Spencer 0fde087ca2 Switch to Yarn (#15485)
* switch to yarn

* cleanup misc references to npm

* [yarn] loosen dependency ranges so yarn will merge more deps

* fix linting error now that moment uses ESM

* [licenses] font-awesome changed the format of its license id

* Use local yarn

* Misc fixes

* eslintignore built yarn file

* Remove mkdir which doesn't do what it should do

* Check build without upgrading lots of versions

* Fix license check

* too many moments

* Better description

* Review fixes

* Lock to angular@1.6.5

* More specific version locks

* Revert "More specific version locks"

This reverts commit 11ef81102e.

* Revert "Lock to angular@1.6.5"

This reverts commit 3ade68c14c.

* rm yarn.lock; yarn

* Forcing a specific version of React, Angular, Moment

* Using vendored version of yarn in ci

* Use --frozen-lockfile

* fixes
2018-01-10 13:23:43 +01:00
Spencer 999126373f
[dev/ci_setup] generalize jenkins_setup script for other CI environments (#15178)
* [dev/ci_setup] generalize jenkins_setup script for other CI environments

* [dev/ci_setup] accept more general `CACHE_DIR` env arg

* [dev/ci_setup] node.js install might not be invalid
2017-11-30 10:26:03 -07:00
Spencer ca049508c2 [ci] only build kibana once (#11717) 2017-05-11 13:12:30 -07:00
Court Ewing 9e39956c27 build: always run build task in jenkins (#10689)
We always run the build task now in jenkins jobs rather than only in the
core builds. This ensures that the build task runs in PR builds even
though the build artifacts are not used for anything.

Ideally all the selenium tests would run against this build rather than
it just being something that gets ran and forgotten about, but this is a
first step.
2017-03-03 12:57:21 -05:00
spalger 8adaecb9be [ci] source the setup script instead of executing it 2016-07-05 12:46:53 -07:00
spalger e98c3d4c42 [ci] tweak ci scripts to debug 2016-07-05 11:08:22 -07:00
spalger b7c8db694a [ci] run the unit tests with xvfb-run 2016-07-01 12:22:39 -07:00
spalger 7df6040536 [ci] split unit and selenium tasks into separate jenkins scripts 2016-07-01 11:31:02 -07:00
spalger cb0659f98d [ci] move ci setup tasks into source control
Until now, the ci setup tasks were stored in the Jenkins job configuration. This moves the setup into source control so that jenkins can be told to execute `./test/scripts/jenkins_{JOB_TYPE}.sh` no matter what branch of kibana it is dealing with.
2016-06-30 12:50:56 -07:00