Commit graph

164 commits

Author SHA1 Message Date
Julia Bardi 157a37114f
[Fleet] cypress setup (#113106)
* added cypress setup for fleet

* updated readme

* fixed types

* fix unused

* starting up fleet server in cypress

* added more fleet tests

* added package update test

* updated readme

* trying jenkins run

* trying jenkins run

* trying jenkins run

* fix types, cypress config

* example of mocked requests

* added getBySel

* fix test after refactor

* removed duplication

* fix tests

* added to buildkite

* updated tests

* starting agent with docker

* trying to fix ip address

* ifconfig

* ip address

* ip address

* ip address

* type fix

* remove extra logging

* fixed test

* fix buildkite

* cleanup

* cleanup

* using docker for fleet_server

* fix

* fix

* trying to fix

* update config

* test

* test

* test

* test

* revert changes

* test

* test

* static ip on linux

* docker version

* try again

* fixed review comments

* fixed types

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Patryk Kopycinski <contact@patrykkopycinski.com>
2021-11-02 15:14:28 +01:00
Gloria Hornero 136d322bdd
adds lists plugin to security solution cypress tests execution (#116442) 2021-10-27 20:55:55 +01:00
Gloria Hornero 252aef80dc
adds cases and timelines plugins to security solution cypress tests execution (#116245) 2021-10-26 14:07:09 +02:00
Nathan L Smith 81264f73e9
Re-enable APM E2E tests and allow server to shut down cleanly on failure (#115450)
* Re-enable APM E2E tests and allow server to shut down cleanly on failure

Calling `process.exit` in the test script made it so the FTR runner would not properly shut down the server, and cause other tests to fail because Kibana was left running on a port. Remove that and just throw
instead.

No changes were made to the tests, as I was unable to reproduce any failures locally. I'll try in CI and see if we can get anything to fail.

Fixes #115280.
2021-10-25 14:05:15 -05:00
Brian Seeders 8e3f1c4d13
Disable APM e2e tests 2021-10-15 17:35:04 -04:00
Nathan L Smith 07777b9de1
Re-enable and fix APM E2E tests (#114831)
* Re-enable previously disabled APM E2E tests.
* Round to the nearest second in `getComparisonTypes` to avoid cases where a millisecond difference can change which results get shown.
* Simplify error count alert tests to test the "happy path" (#79284 exists in order to expand to more tests for rule editing and creation.)
* Wait for alert list API request to complete before clicking "Create rule" button when running the test to create a rule from the Stack Management UI.

I ran the e2e tests 100 times locally with no failures so I'm confident the flakiness has been addressed.

Fixes #114419.
Fixes #109205.
2021-10-15 13:25:50 -05:00
Tim Sullivan c5e23b6a5b
[Reporting] Functional test structure & improvements (#114298)
* [Reporting] Functional test structure & improvements

* show the error of the report generation failure in the test failure

* update snapshot

* remove import to non-existent functional app test

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 07:37:15 -07:00
Nathan L Smith 9d498b962c
[APM] Disabling apm e2e test (#114544)
[skip-ci]

APM Cypress tests are again failing on PRs. Disable temporarily.

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-11 12:55:06 -05:00
Mikhail Shustov 62658899e9
Bump hapi to a version with aborted request fix (#114414)
* bump hapi to a version with aborted request fix

* enable apm functional tests
2021-10-11 09:12:56 +02:00
Cauê Marcondes 4f583eb16b
[APM] Disabling apm e2e test (#113618) 2021-10-01 11:25:17 -04:00
Shahzad fe9b5332e1
[Uptime] Run Sample uptime tests using @elastic/synthetics (#112128)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-09-30 13:58:38 +02:00
Brian Seeders be51f0a574
[Buildkite] Hourly CI / tracked branch pipeline (#111785) 2021-09-16 11:28:07 -04:00
Spencer de2cfd2e65
[ci] bump Jenkins worker memory and es JVM size (#111760)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-09-09 14:26:08 -04:00
Christiane (Tina) Heiligers 8a6cf06f15
[SavedObjects] Integration tests for unsupported product 404 responses (#109755)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-08-30 19:36:21 -04:00
Brian Seeders 01a599faa6
[buildkite] Move some functionality to a shared library (#102228) 2021-08-25 10:31:17 -04:00
Cauê Marcondes 6ed4b4f70c
[APM] Add new ftr_e2e to kibana CI and remove current e2e tests. (#107593) 2021-08-10 23:40:20 -04:00
Spencer 30f2289883
[perf-testing] send detailed APM data from report generation (#107592)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-08-09 13:36:02 -04:00
Luke Elmers d2690d8ac8
[migrations v2] Integration test for multi-node cluster. (#100957) 2021-06-28 12:49:38 -04:00
Brian Seeders 3ba4cff52a
[CI] For PRs, build TS refs before public api docs check (#100791) 2021-06-01 21:27:42 -04:00
Jonathan Budzenski f0e11bcd1b
Automated package testing (#88900)
Co-authored-by: Tyler Smalley <tylersmalley@me.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-05-27 13:37:43 -05:00
Dzmitry Lemechko bc3b9d694b
[QA] update code coverage to use its own script (#100199)
* do  run build script for code coverage

* fix notifyOnError call

* remove maxWorkers argument

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-05-20 10:34:44 +02:00
Tyler Smalley 537be25754
[FTR][CI] Use default distribution for all tests (#94968)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-05-12 15:24:25 -04:00
Brian Seeders 7262ac53c2
[CI] Don't do CI stats reporting/failures for feature branch PRs (#99668) 2021-05-10 16:38:32 -04:00
Brian Seeders 6dab2f157c
[CI] Always set checkoutInfo after git checkout (#99265) 2021-05-04 16:21:37 -07:00
Brian Seeders f404305eaa
[CI] Create a ciGroup just for tests that use Docker (#98535) 2021-05-03 13:53:22 -04:00
Brian Seeders 27ab4e9c65
[CI] Use a new helper library for consistently cloning the repo (#98555) 2021-04-28 11:08:51 -04:00
Spencer 6bb289368b
Revert skips added while triaging ES OOMs (#97876)
* Revert "skip flaky suite (#97382)"

This reverts commit e321f57f64.

* Revert "skip flaky suite (#97387)"

This reverts commit a89b756710.

* Revert "Skip test to try and stabilize master" (#97378)

This reverts commit 194355fdd3.

* upload heap dumps when they are created

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-04-22 11:30:27 -07:00
Spencer b7a9b84af8
Revert "Revert "[ci] skip building ts refs when not necessary (#95739)" (#95746)" (#95750)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-04-19 09:45:09 -07:00
Spencer 9d0b495a30
[ci] ship Jest unit test junit with runbld in jest worker (#97197)
Co-authored-by: Brian Seeders <seeders@gmail.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-15 17:13:38 -07:00
Stacey Gammon 503cfcf8c9
Track API stats as part of ci (#95733)
* Track stats and add extra output information

* Update api docs output

* Clean up id names

* update api docs

* Consolidate error messages and fix a bug

* Update docs

* Update get_declaration_nodes_for_plugin.ts

* Fix bug with removeBrokenLinks not being recursive

* Update docs

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-04-15 11:36:10 -04:00
Brian Seeders 65dc108575
[CI] Don't retry steps after a build has been aborted or timed out (#96600) 2021-04-08 17:33:34 -04:00
Spencer cf22394807
pass script to bash to support scripts which aren't actually executable (#96198)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-04 14:40:42 -04:00
spalger 763c0038ae Revert "stop wrapping steps in runbld (#96195)"
This reverts commit f8a6ba223a.
2021-04-04 09:34:58 -07:00
Spencer f8a6ba223a
stop wrapping steps in runbld (#96195)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-04 09:15:14 -07:00
Pierre Gayvallet cd703c0c89
Revert "[ci] skip building ts refs when not necessary (#95739)" (#95746)
This reverts commit e46a74f7
2021-03-30 01:56:29 -07:00
Spencer e46a74f757
[ci] skip building ts refs when not necessary (#95739)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-03-30 00:52:13 -04:00
Spencer 374cbf9053
[ci] disable api-docs step (#93975)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-03-08 14:28:09 -05:00
Spencer bf8417ed1a
[ci] separate checks done in bootstrap as individual tasks (#93329)
(cherry picked from commit b790f4ca1761bc1fab7818318213833a9c7d092f)

Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-03-03 08:45:55 -07:00
Yara Tercero d847958fb3
[ci] disable firefox scripts from security cypress job (#92483)
Temporarily disabling security solution Firefox tests. Seem to be race conditions present in the Firefox run specifically causing flake.
2021-02-23 15:06:46 -05:00
Brian Seeders 8ab68601e0
[CI] Convert ES Snapshots Verify job to use tasks (#92091) 2021-02-23 11:00:03 -05:00
MadameSheema af2bb0500e
[Security Solution] Cypress tests executed on Firefox (#91524)
* allows Cypress tests to be executed on Firefox

* fixes failing tests

* fixes issues

* fixes exceptions table failing test

* updates readme

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-02-22 17:48:43 +01:00
Dmitry 8fb50c926f
[coverage] speed up merging results of functional tests (#92111)
* [coverage] copy kibana to match coverage path

* bootstrap copy

* use rsync

* skip major tests

* add flags and logs

* remove pwd

* zip and copy to checkout dir

* back to checkoutDir

* fix script

* Revert "skip major tests"

This reverts commit a6fb2f5ef1.

* cleanup

* remove unused script

* cleanup
2021-02-22 18:29:29 +03:00
Brian Seeders a164411286
[CI] backportrc can skip CI (#91886) 2021-02-18 21:00:19 -05:00
Brian Seeders a82b13d147
[FTSR] Convert to tasks and add jest/api integration suites (#91770) 2021-02-18 11:52:50 -08:00
Brian Seeders 03206b688a
[CI] Build and publish storybooks (#87701) 2021-02-18 14:13:23 -05:00
Brian Seeders 96bc9e868d
[CI] Ping assignees on Github PR comments (#91871) 2021-02-18 13:42:40 -05:00
Dmitry 2fe0d05375
[coverage] fix jest merging (#90915)
* [coverage] fix jest merging

* fix path to functional results

* revert wrong change

* fix ingest script

* fix ingest script

* [coverage plugin] change id to camelCase

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-02-16 18:02:56 +01:00
Tyler Smalley 08c08e88d9
[CI] Combines Jest unit tests (#89948)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-02-09 10:08:46 -08:00
Spencer 531194baba
[ci/docsLink] hide link when 200 says "There aren't any differences!" (#90079)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-02-02 15:21:19 -07:00
Brian Seeders 2f05b513e7
[CI] Remove TeamCity code (#90041) 2021-02-02 16:31:48 -05:00