maxmustermann/kibana
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
kibana/test/scripts/jenkins_build_kibana.sh

25 lines
768 B
Bash
Raw Normal View History

Jenkins pipeline with parallel cigroups (#45285) * Pipeline * WIP some work for parallelization with ciGroups * Fix xpack kibana install dir, and add some debugging * Attempt to quick fix a few tests * Revert "Revert "Revert "[ci] compress jobs for CI stability" (#44584)"" This reverts commit 078ac2897fbb2e32db08990e3cbbd8cb65b6f536. * Recombine test groups, and try runbld again * Mostly cleanup, and fix failed_tests reporting to hopefully work for both pipeline and non-pipeline * Fix typo in shell script * Remove some debug code * Add support for changing es transport.port during testing via TEST_ES_TRANSPORT_PORT * Fix test that uses hard-coded es transport port and add it back in to parallel groups * Disable checks reporter again for now * Set env var for TEST_ES_TRANSPORT_PORT in pipeline * Update Jenkinsfile for shorter testrunner labels * Fix another hard-coded transport port * Fix a new test with hard-coded URLs * Jenkinsfile cleanup and fix one of the groups * Fix double slash * Testing vault credentials on jenkins server * Add a non-existent credential * Revert "Add a non-existent credential" This reverts commit 0dc234c465a5483b1a994cb510a182fef766e9cc. * Try github-checks-reporter again * github-checks-reporter should only run for elastic/kibana, forks won't work * Clean up some debug code * Changing names around to try to make BlueOcean UI a little better * Add more stages * Make some changes to stage structure to mirror a nested example from CloudBees * Handle TODOs, and some cleanup in Jenkinsfile * Pass GIT_BRANCH when started without GHPRB, fix branch check * Fix mailer problem and add code that ensures all tests are in cigroups back in * Test adding worker/job name to junit report paths * Remove some duplication from ci_setup scripts * Fix unit test that uses junit path * Don't reinstall node every time setup_env is run * Fix yarn install logic * Fix another unit test that uses junit output dir * Download latest ES snapshot after kibana builds * Make sure junit reports are always processed * Add two failing tests for testing purposes * Add support to Jenkinsfile for kibana build e-mails * Remove some debug code for email sending * Change JOB env handling in junit paths and move it to a sub-directory * Revert "Add two failing tests for testing purposes" This reverts commit 5715203e26922a93483feb0ebb8bb3fdcc3daf8c. * Fix junit report path in test * Don't send kibana emails on build abort * Address PR feedback, formatting and use built-in url formatting library * Fix path formatting for functional test * Add email sending back in to Jenkinsfile * Fix another unit test with path problem (cherry picked from commit 27d23c41847e79e6e1dfaef25982d7a2165a490d) # Conflicts: # src/dev/ci_setup/setup.sh # src/dev/failed_tests/cli.js
2019-09-11 20:58:28 +02:00
#!/usr/bin/env bash
source src/dev/ci_setup/setup_env.sh
[kbn-es] make custom snapshot url a feature (#45750) * [kbn-es] make custom snapshot url a feature * download es snapshot first (cherry picked from commit 510566d66b74e762a860ae3a5bb4a929b1b2763f)
2019-09-15 17:12:47 +02:00
[7.x] [CI] Add pipeline task queue framework and merge workers into one (#71268) (#74276)
2020-08-14 22:41:47 +02:00
if [[ ! "$TASK_QUEUE_PROCESS_ID" ]]; then
./test/scripts/jenkins_build_plugins.sh
fi
[7.x] build immutable bundles for new platform plugins (#53976) (#57528) * build immutable bundles for new platform plugins (#53976) * build immutable bundles for new platform plugins * only inspect workers if configured to do so * [navigation] use an index.scss file * add yarn.lock symlink * set pluginScanDirs in test so fixtures stay consistent * cleanup helpers a little * fix type error * support KBN_OPTIMIZER_MAX_WORKERS for limiting workers via env * test support for KBN_OPTIMIZER_MAX_WORKERS * expand the available memory for workers when only running one or two * add docs about KBN_OPTIMIZER_MAX_WORKERS environment variable * fix README link * update kbn/pm dist * implement bundle caching/reuse * update kbn/pm dist * don't check for cache if --no-cache is passed * update renovate config * standardize on index.scss, move console styles over * add support for --no-cache to cli * include worker config vars in optimizer version * ignore concatenated modules * update integration test * add safari to browserslist to avoid user-agent warnings in dev * update docs, clean up optimizer message/misc naming * always handle initialized messages, don't ignore states that are attached to specific events * reword caching docs, add environment var to disable caching * tweak logging and don't use optimizer.useBundleCache as that's disabled in dev * handle change notifications * batch changes for 1 second * rename CompilerState type to CompilerMsg * getChanges() no longer needs to assign changes to dirs * remove unused deps * split up run_worker.ts and share cacheKey generation logic * add a couple docs * update tests and remove unused imports * specify files when creating bundle cache key * remove one more unused import * match existing dev cli output more closely * update kbn/pm dist * set KBN_NP_PLUGINS_BUILT to avoid warning in CI * avoid extending global window type * add note to keep pluginScanDirs in sync * pass browserslistEnv in workerConfig so it is used for cache key * load commons.bundle.js in parallel too * emit initialized+success states if all bundles are cached * load bootstraps as quickly as possible * skip flaky suite * bump * update jest snapshots * remove hashing from cache key generation * remove unnecessary non-null assertion * improve docs and break up Optimizer#run() * remove unused import * refactor kbn/optimizer to break up observable logic, implement more helpful cache invalidation logic with logging * fix tests * add initializing phase * avoid rxjs observable constructor * remove unnecessary rxjs helper, add tests for bundle cache * update consumers of optimizer * update readme with new call style * replace "new platform" with "kibana platform" * fix a couple more renames * add support for several plain-text file formats * fix naming of OptimizerMsg => OptimizerUpdate, use "store" naming too * one more OptimizerMsg update * ensure bundles are not cached when cache config is false * test for initializing states and bundle cache events * remove unnecessary timeout change * Remove unnecessary helpers * Add tests for BundleCache class * Add tests for Bundle class * test summarizeEvent$ * missing paths are no longer listed in mtimes map * add tests for optimizer/cache_keys * Add some extra docs * Remove labeled loop * add integration test for kbn-optimizer watcher components * querystring-browser removed * tweak logging a smidge, improve info and final message * remove unused imports * remove duplication of getModuleCount() method * move type annotation that validates things * clear up the build completion message Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> * [kbn/optimizer] Fix windows support (#57592) * [kbn/optimizer] simplify run_workers.ts a smidge * use Path.resolve() to create windows paths from normalized ones Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> (cherry picked from commit 343bc9c30394d679791dcae56ea821552fdfeea3) * remove istanbul/code coverage references * fix webpack config syntax * removal of querystring-browser was backported to 7.x Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-02-14 19:35:24 +01:00
# doesn't persist, also set in kibanaPipeline.groovy
export KBN_NP_PLUGINS_BUILT=true
[kbn-es] make custom snapshot url a feature (#45750) * [kbn-es] make custom snapshot url a feature * download es snapshot first (cherry picked from commit 510566d66b74e762a860ae3a5bb4a929b1b2763f)
2019-09-15 17:12:47 +02:00
echo " -> Ensuring all functional tests are in a ciGroup"
[build] Migrate grunt ensureAllTestsInCIGroup to script (#85873) Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2020-12-22 16:44:47 +01:00
node scripts/ensure_all_tests_in_ci_group;
[kbn-es] make custom snapshot url a feature (#45750) * [kbn-es] make custom snapshot url a feature * download es snapshot first (cherry picked from commit 510566d66b74e762a860ae3a5bb4a929b1b2763f)
2019-09-15 17:12:47 +02:00
Revert "[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#99980)" This reverts commit be40e9680687173a3127faff21f770f62a0b63d9.
2021-05-29 02:21:51 +02:00
echo " -> building and extracting OSS Kibana distributable for use in functional tests"
node scripts/build --debug --oss
[7.x] [CI] Add pipeline task queue framework and merge workers into one (#71268) (#74276)
2020-08-14 22:41:47 +02:00
[7.x] [kbn/optimizer][ci-stats] ship metrics separate from build (#90482) (#90659) Co-authored-by: spalger <spalger@users.noreply.github.com> Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-02-09 00:40:11 +01:00
echo " -> shipping metrics from build to ci-stats"
[7.x] ship @kbn/ui-shared-deps metrics in separate step (#91504) (#91539) Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-02-16 22:01:26 +01:00
node scripts/ship_ci_stats \
--metrics target/optimizer_bundle_metrics.json \
--metrics packages/kbn-ui-shared-deps/target/metrics.json
[7.x] [kbn/optimizer][ci-stats] ship metrics separate from build (#90482) (#90659) Co-authored-by: spalger <spalger@users.noreply.github.com> Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-02-09 00:40:11 +01:00
Revert "[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#99980)" This reverts commit be40e9680687173a3127faff21f770f62a0b63d9.
2021-05-29 02:21:51 +02:00
mkdir -p "$WORKSPACE/kibana-build-oss"
cp -pR build/oss/kibana-*-SNAPSHOT-linux-x86_64/. $WORKSPACE/kibana-build-oss/
Reference in a new issue Copy permalink