Go to file
Devin W. Hurley 177cda42bd
[SIEM] [Detection Engine] Incorporate large lists to rule execution. (#65372)
* introduce lists plugin for use by executor

* adds getListClient function on setup

* refactors searchAfterBulkCreate to integrate with the lists plugin so we only generate signals from events not in the list

* fixes type check issues

* fixes unit tests, adds field and other parameters for using lists in executor.

* cleaning up types and exports, updates to match new contracts with lists client from master

* prior to this commit the refactored while loop was doing more search after loops than it needed to and this fixes two bugs in the list filter function where we were returning the wrong count, and we were not accessing the right field on the event

* exception lists are optional

* use exceptions list format, this works with given sample query in scripts

* updates tests and fixes type issues

* updates README doc in detection engine with example for rule with list exception

* adds one test and removes commented out code

* fix sample rule json from 30s to 5m

* fix sample rule json from 30s to 5m

* remove unused import

* more cleanup

* e2e test for prepackaged rules was failing because lists was undefined in the siem plugin and was preventing the registration of the rule alert type. I removed this but once lists is ready for prime time we should consider adding the null check back

* can't reuse the same env var since the tests are setting the ELASTIC_XPACK_SIEM_LISTS_FEATURE env var to true without enabling the lists plugin

* fixes from pr review, still needs more TLC

* exports listspluginsetup type from top-level in lists plugin, fixes logic for empty exceptions list, updates types

* utilize type.is to remove as casting, also do null checks and throw an error when exceptionItem is malformed. This will change in the very near future once the new json format for exception lists is incorporated

* fix type issues after merging master into branch

* update mock

* remove bad null check for ml plugin before registering rule alert type in siem plugin

* prettier linting

* adds test for filter events with list

* pr comments

* adds logic for included vs excluded and updates tests

* update test cases for search after bulk create to default to included for exception lists

* filter out non-list exception items from the loop
2020-05-28 15:45:46 -04:00
.ci chore(NA): add support for accessibility test group on jenkins flaky test runner (#67652) 2020-05-28 18:31:42 +01:00
.github Migrate audit logging to KP (#67381) 2020-05-28 14:46:42 -04:00
bin Update node options Initialization on our scripts (#40302) 2019-08-15 16:09:22 +01:00
common/graphql [Uptime] Implement EuiSuperDatePicker (#28217) 2019-01-18 13:44:58 -05:00
config Fix typos (#66984) 2020-05-27 13:44:41 -06:00
data
docs Update wording (#67486) 2020-05-28 12:19:29 -04:00
examples apply prettier styles 2020-05-22 09:08:58 +02:00
licenses
packages [kbn/optimizer] exclude "cache" config from cache key, diff actually compared values (#67232) 2020-05-27 12:01:29 -07:00
rfcs [RFC] Global search API (#64284) 2020-05-18 18:05:24 +02:00
scripts apply prettier styles 2020-05-22 09:08:58 +02:00
src Populate RequestHandlerContext with start API only (#67579) 2020-05-28 19:46:09 +02:00
tasks [CI] Remove --detectOpenHandles to parallelize Jest tests again (#67413) 2020-05-27 12:44:41 -04:00
test Mark elasticsearch client exposed via request context as deprecated (#67319) 2020-05-27 19:00:16 +02:00
typings Use brotli compression for some KP assets (#64367) 2020-05-04 10:53:06 -06:00
utilities apply prettier styles 2020-05-22 09:08:58 +02:00
vars [ci/stats] fix merge base detection (#67030) 2020-05-27 11:22:04 -07:00
webpackShims Migrate Coordinate Maps to NP (#64668) 2020-05-06 15:12:38 -06:00
x-pack [SIEM] [Detection Engine] Incorporate large lists to rule execution. (#65372) 2020-05-28 15:45:46 -04:00
.backportrc.json Point 7.x to 7.9.0 in .backportrc.json 2020-05-10 22:50:43 +02:00
.browserslistrc build immutable bundles for new platform plugins (#53976) 2020-02-12 19:42:42 -07:00
.editorconfig [editorconfig] disable insert_final_newline for package.json 2019-04-18 09:44:17 -07:00
.eslintignore Add /config/apm.dev.js to .eslintignore (#67442) 2020-05-28 09:46:18 +02:00
.eslintrc.js apply prettier styles 2020-05-22 09:08:58 +02:00
.gitattributes [canvas] Color fixes + Storybook 5 (#34075) 2019-04-02 11:21:51 -05:00
.gitignore Ingest code coverage (#62336) 2020-05-13 15:09:42 -06:00
.i18nrc.json Move apm tutorial from apm plugin into apm_oss plugin (#66432) 2020-05-20 14:40:37 +03:00
.node-version Update Node.js to version 10.19.0 (#56940) 2020-02-05 21:57:43 -08:00
.nvmrc Update Node.js to version 10.19.0 (#56940) 2020-02-05 21:57:43 -08:00
.prettierrc
.sass-lint.yml [Spaces] SASS modularization (#65921) 2020-05-12 17:13:20 -04:00
.yarnrc
api-documenter.json Normalize EOL symbol in platform docs (#56021) 2020-01-27 18:42:45 +01:00
CONTRIBUTING.md fix: rum agent should work correctly on new platform (#67037) 2020-05-25 13:13:58 +02:00
FAQ.md
github_checks_reporter.json implementing github checks - second attempt (#35757) 2019-05-01 16:02:33 -05:00
Gruntfile.js apply prettier styles 2020-05-22 09:08:58 +02:00
Jenkinsfile [CI] Add 20 minutes to overall build timeout 2020-05-15 12:15:19 -04:00
kibana.d.ts Move src/legacy/server/index_patterns to data plugin (server) (Remove step) (#61618) 2020-04-02 12:53:14 +03:00
LICENSE.txt
NOTICE.txt [ui/utils/query_string]: Remove unused methods & migrate apps to querystring lib (#56957) 2020-02-12 19:51:03 +03:00
package.json Revert "[CI] Bump chromedriver and use DETECT_CHROMEDRIVER_VERSION (#67182)" 2020-05-27 17:26:23 -04:00
preinstall_check.js
README.md chore: point issue links to choose (#49616) 2019-10-29 15:54:27 +01:00
renovate.json5 bump renovate tracked branch label to 7.9 (#66620) 2020-05-26 11:34:23 -05:00
STYLEGUIDE.md Remove Kibana a11y guide in favor of EUI (#57021) 2020-02-07 10:55:29 -05:00
tsconfig.browser.json
tsconfig.json [Metric] convert mocha tests to jest (#54054) 2020-01-17 12:00:35 -06:00
tsconfig.types.json [Core] Move Saved objects files to core (#38771) 2019-06-18 13:10:23 +02:00
TYPESCRIPT.md Update deprecated React.SFC and React.StatelessComponent types (#50852) 2019-11-21 20:53:54 +01:00
yarn.lock Revert "[CI] Bump chromedriver and use DETECT_CHROMEDRIVER_VERSION (#67182)" 2020-05-27 17:26:23 -04:00

Kibana

Kibana is your window into the Elastic Stack. Specifically, it's a browser-based analytics and search dashboard for Elasticsearch.

Getting Started

If you just want to try Kibana out, check out the Elastic Stack Getting Started Page to give it a whirl.

If you're interested in diving a bit deeper and getting a taste of Kibana's capabilities, head over to the Kibana Getting Started Page.

Using a Kibana Release

If you want to use a Kibana release in production, give it a test run, or just play around:

Building and Running Kibana, and/or Contributing Code

You might want to build Kibana locally to contribute some code, test out the latest features, or try out an open PR:

Documentation

Visit Elastic.co for the full Kibana documentation.

For information about building the documentation, see the README in elastic/docs.

Version Compatibility with Elasticsearch

Ideally, you should be running Elasticsearch and Kibana with matching version numbers. If your Elasticsearch has an older version number or a newer major number than Kibana, then Kibana will fail to run. If Elasticsearch has a newer minor or patch number than Kibana, then the Kibana Server will log a warning.

Note: The version numbers below are only examples, meant to illustrate the relationships between different types of version numbers.

Situation Example Kibana version Example ES version Outcome
Versions are the same. 5.1.2 5.1.2 💚 OK
ES patch number is newer. 5.1.2 5.1.5 ⚠️ Logged warning
ES minor number is newer. 5.1.2 5.5.0 ⚠️ Logged warning
ES major number is newer. 5.1.2 6.0.0 🚫 Fatal error
ES patch number is older. 5.1.2 5.1.0 ⚠️ Logged warning
ES minor number is older. 5.1.2 5.0.0 🚫 Fatal error
ES major number is older. 5.1.2 4.0.0 🚫 Fatal error

Questions? Problems? Suggestions?

  • If you've found a bug or want to request a feature, please create a GitHub Issue. Please check to make sure someone else hasn't already created an issue for the same topic.
  • Need help using Kibana? Ask away on our Kibana Discuss Forum and a fellow community member or Elastic engineer will be glad to help you out.