kibana/x-pack/plugins
Garrett Spong 4c48993bb0
[RAC][Security Solution] Register Security Detection Rules with Rule Registry (#96015)
## Summary

This PR starts the migration of the Security Solution rules to use the rule-registry introduced in https://github.com/elastic/kibana/pull/95903. This is a pathfinding effort in porting over the existing Security Solution rules, and may include some temporary reference rules for testing out different paradigms as we move the rules over. See https://github.com/elastic/kibana/issues/95735 for details


Enable via the following feature flags in your `kibana.dev.yml`:

```
# Security Solution Rules on Rule Registry
xpack.ruleRegistry.index: '.kibana-[USERNAME]-alerts' # Only necessary to scope from other devs testing, if not specified defaults to `.alerts-security-solution`
xpack.securitySolution.enableExperimental: ['ruleRegistryEnabled']
```

> Note: if setting a custom `xpack.ruleRegistry.index`, for the time being you must also update the [DEFAULT_ALERTS_INDEX](9e213fb7a5/x-pack/plugins/security_solution/common/constants.ts (L28)) in order for the UI to display alerts within the alerts table.

---

Three reference rule types have been added (`query`, `eql`, `threshold`), along with scripts for creating them located in:

```
x-pack/plugins/security_solution/server/lib/detection_engine/reference_rules/scripts/
```

Main Detection page TGrid queries have been short-circuited to query `.alerts-security-solution*` for displaying alerts from the new alerts as data indices.

To test, checkout, enable the above feature flag(s), and run one of the scripts from the above directory, e.g.  `./create_reference_rule_query.sh` (ensure your ENV vars as set! :)


Alerts as data within the main Detection Page 🎉 
<p align="center">
  <img width="500" src="https://user-images.githubusercontent.com/2946766/119911768-39cfba00-bf17-11eb-8996-63c0b813fdcc.png" />
</p>




cc @madirey @dgieselaar @pmuellr @yctercero @dhurley14 @marshallmain
2021-05-28 12:38:49 -06:00
..
actions [Actions] Converted rejectUnauthorized config usages to verificationMode. (#100179) 2021-05-27 14:20:57 -07:00
alerting [Actions] Taking space id into account when creating email footer link (#100734) 2021-05-28 11:56:51 -04:00
apm [Alerting] Split alerting feature privilege between rules and alerts and handle subfeature privilege specification (#100127) 2021-05-27 14:59:02 -04:00
banners Do not mutate config in place during deprecations (#99629) 2021-05-11 05:41:48 -04:00
canvas [Lens] Adds dynamic table cell coloring (#95217) 2021-05-28 15:24:28 +02:00
cases [triggersActionsUi] Reduce page load bundle to under 100kB (#97770) 2021-05-25 19:00:29 -07:00
cloud Don't query for the current user on anonymous pages (#99511) 2021-05-06 17:04:56 -04:00
console_extensions
cross_cluster_replication [CCR] Replace EuiCodeEditor with EuiCodeBlock (#100122) 2021-05-20 14:05:42 -04:00
dashboard_enhanced feat: 🎸 close drilldown manager on view mode switch (#99309) 2021-05-06 00:26:13 +02:00
dashboard_mode
data_enhanced [Search Sessions] Fix display of expired session state in management (#98915) 2021-05-04 12:02:17 +02:00
discover_enhanced Disable context menu "Explore underlying data" by default (#98039) 2021-04-26 13:20:43 +02:00
drilldowns
embeddable_enhanced feat: 🎸 enable drilldown actions in "edit" mode (#96023) 2021-04-12 16:44:48 +02:00
encrypted_saved_objects Sharing saved objects phase 3 (#94383) 2021-05-14 14:46:17 -04:00
enterprise_search [Enterprise Search] Log warning for Kibana/EntSearch version mismatches (#100809) 2021-05-28 10:57:30 -07:00
event_log
features [Alerting] Split alerting feature privilege between rules and alerts and handle subfeature privilege specification (#100127) 2021-05-27 14:59:02 -04:00
file_data_visualizer [ML] Data vizualizer: add choropleth map for index and file (#99434) 2021-05-11 13:40:06 -04:00
file_upload [Maps] Add draw wizard (#100278) 2021-05-26 11:21:38 -04:00
fleet [Fleet] Improve combo box for fleet settings (#100603) 2021-05-28 11:25:20 -04:00
global_search
global_search_bar Clearing the global search bar will reset suggestions (#88637) 2021-05-13 11:35:03 -04:00
global_search_providers [Security Solution] Application register deepLinks instead of meta.searchDeepLinks (#100129) 2021-05-25 14:49:51 +02:00
graph Remove chrome.navLinks.update (#99633) 2021-05-24 13:00:45 -05:00
grokdebugger
index_lifecycle_management Reintroduce 96111: Provide guidance of "Custom" allocation behavior in ILM (#99007) 2021-05-03 12:29:57 -07:00
index_management [Index management] Add selected index count (#99652) 2021-05-11 14:10:34 +01:00
infra [Infra] Update LogStream component docs (#100795) 2021-05-28 08:42:44 -04:00
ingest_pipelines [Ingest pipelines] add support for fingerprint processor (#100541) 2021-05-26 18:29:05 +02:00
lens [Lens] Adds dynamic table cell coloring (#95217) 2021-05-28 15:24:28 +02:00
license_api_guard Fix typo in license_api_guard README name and import http server mocks from public interface (#97334) 2021-04-18 20:28:13 -07:00
license_management initial migration (#97795) 2021-04-23 17:14:54 +02:00
licensing Remove chrome.navLinks.update (#99633) 2021-05-24 13:00:45 -05:00
lists [Security Solution][Endpoint] Add event filters summary card to the fleet endpoint tab (#100668) 2021-05-28 18:07:54 +02:00
logstash migrate logstash plugin to new ES client (#98064) 2021-04-27 10:25:50 +02:00
maps [Lens] Adds dynamic table cell coloring (#95217) 2021-05-28 15:24:28 +02:00
metrics_entities [Security Solutions] (Phase 1) Adds an application cache called metrics entities and integrates it within Security Solutions behind a feature flag (#96446) 2021-04-30 12:36:06 -06:00
ml [ML] Fix categorization job view examples link when datafeed uses multiple indices (#100789) 2021-05-28 17:43:44 +01:00
monitoring [Alerting] Split alerting feature privilege between rules and alerts and handle subfeature privilege specification (#100127) 2021-05-27 14:59:02 -04:00
observability Fix bug with Observability > APM header navigation (#100845) 2021-05-28 11:10:14 -05:00
osquery Ban use of lodash.template (#100277) 2021-05-19 10:06:52 -04:00
painless_lab
remote_clusters [Remote clusters] Fixed skipped test for search bar (#97472) 2021-05-05 13:05:35 +02:00
reporting [Reporting] Use the deprecations service to advise critical config changes (#100427) 2021-05-26 17:31:55 -07:00
rollup Use doc link services in rollups (#99137) 2021-05-10 10:01:19 -07:00
rule_registry [RAC][Security Solution] Register Security Detection Rules with Rule Registry (#96015) 2021-05-28 12:38:49 -06:00
runtime_fields
saved_objects_tagging Add description as title on tag badge (#97109) 2021-04-18 20:49:35 +02:00
searchprofiler
security [Alerting] Split alerting feature privilege between rules and alerts and handle subfeature privilege specification (#100127) 2021-05-27 14:59:02 -04:00
security_solution [RAC][Security Solution] Register Security Detection Rules with Rule Registry (#96015) 2021-05-28 12:38:49 -06:00
snapshot_restore [Snapshot and Restore] Remove box shadow from panels (#98292) 2021-04-30 12:30:36 -04:00
spaces Fix spaces test flakyness (#100605) 2021-05-26 06:47:28 -04:00
stack_alerts [Alerting] Split alerting feature privilege between rules and alerts and handle subfeature privilege specification (#100127) 2021-05-27 14:59:02 -04:00
task_manager [telemetry] report config deprecations (#99887) 2021-05-26 10:57:01 +02:00
telemetry_collection_xpack Remove / Consolidate legacy usage adoption metrics (#100480) 2021-05-27 20:10:01 +01:00
timelines [plugin-generator] don't generate .eslintrc.js files for internal plugins (#96921) 2021-04-13 07:43:03 -07:00
transform [ML] Transforms: Fix handling of fields with keyword mapping available (#98882) 2021-05-04 16:21:27 +02:00
translations [Security Solution][Endpoint] Add event filters summary card to the fleet endpoint tab (#100668) 2021-05-28 18:07:54 +02:00
triggers_actions_ui [triggersActionsUi] Reduce page load bundle to under 100kB (#97770) 2021-05-25 19:00:29 -07:00
ui_actions_enhanced Enable custom time ranges for saved searches (#99180) 2021-05-05 16:35:39 +02:00
upgrade_assistant [Upgrade Assistant] Address copy feedback (#99632) 2021-05-25 14:14:08 -04:00
uptime [Alerting] Split alerting feature privilege between rules and alerts and handle subfeature privilege specification (#100127) 2021-05-27 14:59:02 -04:00
watcher Rename client integration test folders (#100119) 2021-05-20 08:54:47 -04:00
xpack_legacy Remove legacy ES client usages in home and xpack_legacy (#97359) 2021-04-18 20:42:07 +02:00