Commit graph

47318 commits

Author SHA1 Message Date
Georgii Gorbachev
b304c1ca0b
[Security Solution][Detections] Truncate lastFailureMessage for siem-detection-engine-rule-status documents (#112257)
**Ticket:** https://github.com/elastic/kibana/issues/109815

## Summary

**Background:** `siem-detection-engine-rule-status` documents stores the `lastFailureMessage` a string which is indexed as `type: "text"` but some failure messages are so large that these documents are up to 26MB. These large documents cause migrations to fail because a batch of 1000 documents easily exceed Elasticsearch's `http.max_content_length` which defaults to 100mb.

This PR truncates `lastFailureMessage` and `lastSuccessMessage` in the following cases:

1. When we write new or update existing status SOs:
    - The lists of errors/warnings are deduped -> truncated to max `20` items -> joined to a string
    - The resulting strings are truncated to max `10240` characters
2. When we migrate `siem-detection-engine-rule-status` SOs to 7.15.2:
    - The two message fields are truncated to max `10240` characters

### Checklist

Delete any items that are not applicable to this PR.

- [ ] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios
2021-10-14 17:40:23 +02:00
ymao1
0b2012a908
Setting displayname for alerting sos (#114916) 2021-10-14 11:34:52 -04:00
Jonathan Budzenski
3899046313 skip flaky suite. #113890 2021-10-14 09:51:46 -05:00
Tim Sullivan
c5e23b6a5b
[Reporting] Functional test structure & improvements (#114298)
* [Reporting] Functional test structure & improvements

* show the error of the report generation failure in the test failure

* update snapshot

* remove import to non-existent functional app test

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 07:37:15 -07:00
David Sánchez
55a444b17a
Small adjustments in policy page (#114957) 2021-10-14 16:25:17 +02:00
Clint Andrew Hall
864e6f1a74
[fleet] Adjust unified integration view to have better UI controls (#114692)
* [fleet] Adjust Package Cards to horizontal layout

* Fix responsive shifting

* Addressing feedback

* cleanup layout for integrations view

* i18n

* Fix type errors

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Dave Snider <dave.snider@gmail.com>
Co-authored-by: Josh Dover <1813008+joshdover@users.noreply.github.com>
2021-10-14 10:18:01 -04:00
Angela Chuang
56a2e788ca
[Security Solution] tgrid cellActions enhancement (#113419)
* Alerts cellAction enhancement

* styling

* fix types

* expandable topN

* fix types

* styling for filters

* styling

* rm getDefaultCellActions

* styling

* globalFilters for topN

* rm unused i18n keys

* unit test

* add i18n

* rename component

* fix types

* update i18n keys

* unit tests

* styling for reason row renderer

* rename file

* fix Circular Dependencies

* update wording/icons for show top N

* cell value text overflow

* reason in grid-view

* unit test

* default selected option for topN

* lint error

* configurable paddingSize and showLegend for topN

* update snapshot

* rename reason title

* fix cypress

* fix cypress

* fix unit tests

* fix default cell actions

* fix page crashing

* unit test

* add unit tests

* code review

* fix missing props

* fix expand ip button

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 15:17:28 +01:00
Ester Martí Vilaseca
cdce98c8a3
[Stack monitoring] Fix clusters functional tests when react is enabled (#114982)
* Fix test subjects for overview page

* fix pathname matching
2021-10-14 15:57:27 +02:00
Maja Grubic
586682a0c4
[Discover] Rename default column in the advanced settings (#114100)
* [Discover] Rename default column in the advanced settings

* Fix eslint

* Rename default column to an empty string

* Fix typo

* Fix default column filtering

* Update comment

* Make an empty array a default columns

* Improve functional test

* Wording change

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 15:49:35 +02:00
Marco Liberati
4db2437036
[Lens] Thresholds: when computing default static value take into account all layer metrics (#113647)
*  compute the default threshold based on data bounds

* 🐛 Fix multi layer types issue

*  Fix test

*  Fix other test

* 🐛 Fix computation bug for the initial static value

*  Add new suite of test for static value computation

* 🐛 Fix extents bug and refactor in a single function + tests

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 15:28:40 +02:00
Thomas Neirynck
f52c718f11
fix cloudwatch category assignmet (#114928) 2021-10-14 09:07:22 -04:00
Tim Roes
b21e1ebf38
Deprecate DataView.flattenHit in favor of data plugin flattenHit (#114517)
* WIP replacing indexPattern.flattenHit by tabify

* Fix jest tests

* Read metaFields from index pattern

* Remove old test code

* remove unnecessary changes

* Remove flattenHitWrapper APIs

* Fix imports

* Fix missing metaFields

* Add all meta fields to allowlist

* Improve inline comments

* Move flattenHit test to new implementation

* Add deprecation comment to implementation

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 14:43:06 +02:00
Kevin Lacabane
29d750a8c1
[Stack Monitoring] fix feature controls functional test (#114781)
* fix feature controls functional test

* target test-subj attr instead of class
2021-10-14 14:33:07 +02:00
Anton Dosov
f598cf1ffd
Update app services bundle limits (#114789) 2021-10-14 13:46:16 +02:00
Kyle Pollich
187d949685
[Fleet] Improve Functionality around Managed Package Policies (#114526)
* Enabled auto policy upgrades for APM and Synthetics

* fixup! Enabled auto policy upgrades for APM and Synthetics

* Rework preconfiguration policy upgrade flow + report errors

* Fix type error in test

* Fix type errors + tests

* wip

* Remove keep policies up to date checks

* Remove references to KEEP_POLICIES_UP_TO_DATE_PACKAGES

* Move package policy upgrade results to nonFatalErrors

* Fix types

* Fix type error

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 07:19:50 -04:00
Gloria Hornero
06e469394a
cleanup (#114902)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 13:15:02 +02:00
Mark Hopkin
5ee779c3c2
remove stray semicolon (#114969) 2021-10-14 12:42:14 +02:00
Esteban Beltran
1d3c8b7dc7
[Security Solution] Edit host isolation exception IP UI (#114279)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 11:26:49 +02:00
Walter Rafelsberger
b0daf935cf
[ML] APM Correlations: Round duration values to be used in range aggregations. (#114833)
A change in the ES range agg no longer accepts numbers with decimals if the underlying field is typed as long. This fixes the issue by rounding the values we pass on to the range agg.
2021-10-14 11:07:26 +02:00
Yulia Čech
f2f6bb5295
[Index Management] Added data-test-subj values to the index context menu buttons (#114900) 2021-10-14 10:50:26 +02:00
Ester Martí Vilaseca
32f650f9f7
[Stack monitoring] Fix logstash functional tests for react (#114819)
* update logstash pipelines test subject

* Add sorting to table options for pipelines table

* fix sorting in logstash node pipelines table

* remove commented code
2021-10-14 10:48:36 +02:00
Dmitry Shevchenko
b64604ac89
Implement hybrid approach to writing rule execution event logs (#114852) 2021-10-14 10:09:45 +02:00
Justin Ibarra
95e8595a12
[Detection Rules] Add 7.16 rules (#114939) 2021-10-13 21:49:07 -08:00
Yara Tercero
69a6cf329c
Fixing exceptions export format (#114920)
### Summary

Fixing exceptions export format and adding integration tests for it.
2021-10-13 23:32:43 -04:00
Jen Huang
86f0733e56
Clean up inaccurate comments (#114935) 2021-10-13 19:49:16 -07:00
Tiago Costa
423b0e801f
chore(NA): fixes a typo on persist_bazel_cache.sh comment (#114943) 2021-10-14 03:35:17 +01:00
Tyler Smalley
5647de3b4a
[ci] Fixes Bazel cache writes (#114915)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-10-14 02:18:06 +01:00
Devon Thomson
461f9f65cc
fix package.json: (#114936) 2021-10-13 21:12:21 -04:00
Devon Thomson
f8cbbbb99f
[Controls] Redux Toolkit and Embeddable Redux Wrapper (#114371)
Use new redux wrapper for control group management and upgrade all control group methods to use redux wrapper. Get order of controls from embeddable input, set up preconfigured story.

Co-authored-by: andreadelrio <delrio.andre@gmail.com>
2021-10-13 20:11:53 -04:00
Oliver Gupte
e5576d688d
[APM] Fixes incorrect index config names (#114901) (#114904) 2021-10-14 00:46:04 +02:00
Scotty Bollinger
493b408673
[Workplace Search] Fix button order and remove extra source name label (#114899)
* Remove extra source title from Personal dashboard

* Change button order to match other views

We typically have the right-most button the Save button and the reset button to the left

* Fix typo

* Fix failing test

EUI requires the name but we don’t want to dispaly it, so sending an empty string

* Remove Synchronization nav items from Custom Source

* Hide syncTriggerCallout for custom sources
2021-10-13 18:14:14 -04:00
Yuliia Naumenko
c737c393cf
[Actions] Fixed actions telemetry for multiple namespaces usage (#114748)
* [Actions] Fixed actions telemetry for multiple namespaces usage

* fixed tests
2021-10-13 14:22:40 -07:00
Brandon Morelli
77ad8fe991
docs: fix config names (#114903) 2021-10-13 14:21:50 -07:00
Nick Peihl
d822d6dc32
Update kibana to EMS 7.16 (#114865)
* Update kibana to EMS 7.16

* Update license override
2021-10-13 13:45:53 -07:00
Chris Roberson
fda421fab6
Always call resolve (#114670) 2021-10-13 16:34:31 -04:00
Luke Elmers
e1e1830f15
[Breaking] Remove /api/settings & the xpack_legacy plugin. (#114730) 2021-10-13 21:20:56 +01:00
Kevin Lacabane
491fcd5c36
[Stack Monitoring] fix beats pages test-subj attributes (#114835)
* fix beats pages test-subj attributes

* fix eslint errors
2021-10-13 21:45:49 +02:00
Orhan Toy
fdd72a9e80
[App Search] [Crawler] Add tooltip to explain path pattern (#114779)
7.13.0 adds a wildcard character to (non-regex) path patterns. This change updates the UI help text to explain this.
2021-10-13 21:36:03 +02:00
Davey Holler
a532ea5c05
[App Search] Static Curations History Tab (#113481) 2021-10-13 15:21:46 -04:00
Scotty Bollinger
8d1c96cd7e
[Workplace Search] Add Synchronize button to Source Overview page (#114842)
* Add sync route

* Add logic for triggering sync on server

* Add button with confirm modal and description w/links
2021-10-13 13:44:50 -05:00
Kerry Gallagher
b96f5443d6
[RAC] Change index bootstrapping strategy (#113389)
* Change index bootstrapping to cater for non-additive changes only
2021-10-13 19:39:52 +01:00
Kaarina Tungseth
877e00786d
[DOCS] Removes capitalized attributes (#114849) 2021-10-13 13:37:21 -05:00
James Gowdy
95cd74d7fa
[ML] Using data views service for loading data views (#113961)
* [ML] Using data views service for loading data views

* removing more saved object client uses

* removing IIndexPattern use

* removing IndexPattern use

* removing more depricated types

* fixing teste

* fixing index pattern loading

* tiny refactor

* fixing rollup index test

* changes based on review

* adding size to find calls

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-13 19:35:51 +01:00
Kaarina Tungseth
21f45283be
[DOCS] Documents monitoring.cluster_alerts.allowedSpaces (#114669)
* [DOCS] Documents monitoring.cluster_alerts.allowedSpaces

* Update docs/settings/spaces-settings.asciidoc

Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>

Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
2021-10-13 13:29:50 -05:00
spalger
dab5a59fc2 skip suite failing es promotion (#114885) 2021-10-13 18:25:28 +00:00
Stacey Gammon
feed7391a0
Update kibana_platform_plugin_intro with more details on packages vs plugins (#114713)
* Update kibana_platform_plugin_intro.mdx

* updates

* Update kibana_platform_plugin_intro.mdx

* Update kibana_platform_plugin_intro.mdx

* Update kibana_platform_plugin_intro.mdx

* Update dev_docs/key_concepts/kibana_platform_plugin_intro.mdx

Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>

* Update dev_docs/key_concepts/kibana_platform_plugin_intro.mdx

Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>

* Update dev_docs/key_concepts/kibana_platform_plugin_intro.mdx

Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>

* Update dev_docs/key_concepts/kibana_platform_plugin_intro.mdx

Co-authored-by: Brandon Kobel <brandon.kobel@gmail.com>

* Update dev_docs/key_concepts/kibana_platform_plugin_intro.mdx

Co-authored-by: Brandon Kobel <brandon.kobel@gmail.com>

Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>
Co-authored-by: Brandon Kobel <brandon.kobel@gmail.com>
2021-10-13 14:01:46 -04:00
Chris Cowan
6d24de9d6e
[Stack Monitoring] Fix shard size alerts (#114357)
* [Stack Monitoring] Fix shard size alerts

* Removing the source filter for source_node.*

* Removing superfluous types

* Removing superfluous nodeId and nodeName from test
2021-10-13 14:00:15 -04:00
Spencer
5de36a8229
[kbn/optimizer] fix --update-limit docs (#114840)
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-10-13 18:50:35 +01:00
Clint Andrew Hall
6d5354a99d
[fleet][integrations] Provide Deployment Details on Cloud (#114287)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-13 13:50:20 -04:00
Dario Gieselaar
eaf25d64e4
[APM] Generate breakdown metrics (#114390)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-13 19:48:01 +02:00