kibana/x-pack/test
Ryland Herrick 740155e214
Address intermittent test failure (#89367)
After observing the conditions when this test fails, it appears that
some (but not all) signals are available. As these signals are generated by a
rule via a bulk create, the odds of us retrieving signals in the middle
of that bulk creation is very slim (but not impossible).

The crux of the error here was: we wait for signals to be generated, but
not the ones that we need. Specifically, we are waiting for a single
signal to be available, but since we are asserting on sequences of
signals, we need several to be available to us.

While not perfect (because the signals we receive are not technically
guaranteed to be sequence signals), increasing the number of signals
that we wait for before proceeding should be sufficient to prevent this
failure state. In debugging, it was observed that every test returning
9-10 signals succeeded, while it was possible for the test to return
only one signal and fail.
2021-01-27 13:08:53 -06:00
..
accessibility Update user management page (#87133) 2021-01-25 13:51:57 +00:00
alerting_api_integration chore(NA): create new x-pack cigroups and rebalancing them all (#88366) 2021-01-20 13:47:08 +00:00
api_integration [Logs UI] Display category in anomalies table (#88677) 2021-01-27 17:58:06 +00:00
api_integration_basic chore(NA): create new x-pack cigroups and rebalancing them all (#88366) 2021-01-20 13:47:08 +00:00
apm_api_integration [APM] Optimize API test order (#88654) 2021-01-27 09:54:56 +01:00
case_api_integration [Security Solution][Case] Fix patch cases integration test with alerts (#88311) 2021-01-18 09:59:26 +02:00
common [Fleet] Move ingestManager plugin to fleet (#82886) 2020-11-09 11:07:04 -05:00
detection_engine_api_integration Address intermittent test failure (#89367) 2021-01-27 13:08:53 -06:00
encrypted_saved_objects_api_integration chore(NA): create new x-pack cigroups and rebalancing them all (#88366) 2021-01-20 13:47:08 +00:00
endpoint_api_integration_no_ingest Skip failing endgame tests (#70548) 2020-07-01 23:01:21 -07:00
fleet_api_integration [Fleet] Add updateFleetRoleIfExists() in order to update fleet_enroll permissions if role already exists (#88000) 2021-01-22 12:12:59 -05:00
functional [ML] Add embedded map to geo_point fields for Data Visualizer (#88880) 2021-01-27 11:39:50 -06:00
functional_basic [ML] Redesign index-based Data Visualizer (#85726) 2020-12-15 15:19:47 -06:00
functional_cors [functional_cors] use pre-defined unique port in CI (#88919) 2021-01-21 08:34:03 -07:00
functional_embedded [ci] run server integration tests (#81698) 2020-11-03 15:50:01 -07:00
functional_enterprise_search Fix dead links to functional testing docs (#85097) 2020-12-14 17:00:53 +01:00
functional_vis_wizard [Visualize] New visualization wizard (#79627) 2020-11-06 18:03:44 +02:00
functional_with_es_ssl [alerts] adds support for index threshold index param string type (#88540) 2021-01-25 16:43:46 -05:00
licensing_plugin chore(NA): create new x-pack cigroups and rebalancing them all (#88366) 2021-01-20 13:47:08 +00:00
lists_api_integration skip suites failing es promotion (#88302) 2021-01-13 22:03:44 -07:00
load [FTR] add custom runner and config to run load tests (#88409) 2021-01-20 13:23:10 +01:00
observability_api_integration Move Elasticsearch type definitions out of APM (#83081) 2020-11-11 16:23:34 -06:00
plugin_api_integration [Task Manager] Increment task attempts when they fail during markTaskAsRunning (#88669) 2021-01-21 14:04:42 +00:00
plugin_api_perf chore(NA): create new x-pack cigroups and rebalancing them all (#88366) 2021-01-20 13:47:08 +00:00
plugin_functional Remove tag name validation (#88800) 2021-01-25 15:29:10 +01:00
reporting_api_integration Enable v2 so migrations, disable in FTR tests (#89297) 2021-01-27 12:13:15 +01:00
saved_object_api_integration Sharing saved objects, phase 2 (#80945) 2021-01-20 17:39:21 -05:00
saved_object_tagging [Maps] allow saving maps to dashboards (#88759) 2021-01-26 10:35:57 -07:00
saved_objects_field_count [Ingest Manager] Move config from xpack.ingestManager to xpack.fleet (#79406) 2020-10-06 11:58:09 -04:00
security_api_integration Expose AnonymousAccess service through Security OSS plugin. (#87091) 2021-01-15 10:18:58 +01:00
security_functional chore(NA): create new x-pack cigroups and rebalancing them all (#88366) 2021-01-20 13:47:08 +00:00
security_solution_cypress Removes archives (#86537) 2020-12-28 08:08:04 +01:00
security_solution_endpoint [Security Solution][Endpoint][Admin] malware custom notify user message tests (#87603) 2021-01-07 13:44:51 -05:00
security_solution_endpoint_api_int [Security Solution][Resolver] Remove deprecated resolver routes (#86475) 2021-01-04 13:14:40 -05:00
send_search_to_background_integration [Search Sessions] Make search session indicator UI opt-in, refactor per-app capabilities (#88699) 2021-01-27 11:52:13 +01:00
spaces_api_integration Migrate privilege/role/user-related operations to a new Elasticsearch client. (#84641) 2020-12-04 14:24:30 +01:00
stack_functional_integration dismiss telemetry banner for ems_test (#88096) 2021-01-13 10:29:16 +01:00
ui_capabilities Cleanup feature registration (#80909) 2020-10-20 12:53:43 -04:00
upgrade_assistant_integration [Upgrade Assistant] Migrate server to new es-js client (#89207) 2021-01-27 10:22:36 -05:00
usage_collection [Telemetry] Settings Collector: redact sensitive reported values (#88675) 2021-01-27 17:57:53 +02:00
visual_regression
tsconfig.json tsconfig file for lens (#89135) 2021-01-26 16:48:47 +01:00