Commit graph

27038 commits

Author SHA1 Message Date
Rob Waight b3848262a8
[DOCS] Include server.cors configuration settings (#47995)
Include `server.cors` configuration settings -- back port to 7.x from https://github.com/elastic/kibana/pull/47701
2019-10-11 11:24:48 -05:00
Spencer d504a82954
[7.x] [kbn/es] use an ES_TMPDIR that is within the install pat… (#47964)
* [kbn/es] use an ES_TMPDIR that is within the install path

* support tests which don't pass installPath
2019-10-11 09:21:13 -07:00
Vadim Dalecky a133b5fb13
fix: 🐛 handle correctly basic falsy types in getType() (#47930) (#47953) 2019-10-11 18:09:07 +02:00
Jonathan Budzenski 7a6f7dcaef [deb/rpm] set default babel cache path (#47907)
* [deb/rpm] set default babel cache path

* \\n
2019-10-11 10:25:11 -05:00
Jonathan Budzenski 019a06f182 [build/deb] use older systemd StartLimitInterval (#47909)
* StartLimitIntervalSec -> StartLimitInterval

* [build/deb] use older systemd StartLimitInterval
2019-10-11 10:21:36 -05:00
Andrew Goldstein d503b7268a
[SIEM] Endgame events on the SIEM Overview page (#47774) (#47904)
## Summary

* Adds Endgame events to the SIEM Overview page, per the following screenshot:

<img width="1680" alt="overview-chrome" src="https://user-images.githubusercontent.com/4459398/66524250-26a47800-eaaf-11e9-8ff9-311c031e5d00.png">

* Adds `endgame-*` to the default SIEM index pattern, per the following screenshot:

<img width="1665" alt="siem-advanced-settings" src="https://user-images.githubusercontent.com/4459398/66524300-45a30a00-eaaf-11e9-93c3-dce74917e73a.png">

RELEASE NOTE: To view Endgame events in existing SIEM deployments, you must manually add `endgame-*` to the SIEM index pattern in `Kibana Management > Advanced Settings > SIEM > Elasticsearch indices`. Also note that the `Reset to default` feature for this setting in the Advanced Settings page now includes `endgame-*`.

* Adds the GraphQL plumbing for rendering Endgame data in the Timeline via row renderers (in an upcoming PR), with the introduction of the following fields:

```
dns.question.name
dns.question.type
dns.resolved_ip
dns.response_code
endgame.exit_code
endgame.file_name
endgame.file_path
endgame.logon_type
endgame.parent_process_name
endgame.pid
endgame.process_name
endgame.subject_domain_name
endgame.subject_logon_id
endgame.subject_user_name
endgame.target_domain_name
endgame.target_logon_id
endgame.target_user_name
event.code
file.name
process.hash.md5
process.hash.sha1
process.hash.sha256
user.domain
winlog.event_id
```

## Testing

### Cypress
The `smoke_tests/overview/overview.spec.ts` Cypress test was updated to include the new counts on the Overview page, per the screenshot below:

![cypress-overview-spec](https://user-images.githubusercontent.com/4459398/66529142-8c98fb80-eabf-11e9-800e-a0d9e1e51d6d.png)

### API Integration test

The Overview page API integration test `xpack/test/api_integration/apis/siem/overview_host.ts` was updated to include counts of mock Endgame data added to `test/functional/es_archives/auditbeat/overview/data.json.gz`

### Unit tests

Overview page unit tests were updated to include the new Endgame event counts

### Desk testing

* Desk tested by hand-editing `components/page/overview/overview_host/index.tsx` and setting the `endDate` and `startDate` values below to a fixed datetime:

```
<OverviewHostQuery endDate={endDate} sourceId="default" startDate={startDate}>
```

The counts shown on the overview page where then compared to the counts shown in the timeline in the same date period, to verify the counts match 1:1.

* The additional fields mentioned above in this PR (e.g. `dns.question.name`,`endgame.target_domain_name`) that are now being requested via GraphQL can be seen via the Timeline Inspect (query) feature:

1) Enter `event.module: endgame` in the Timeline KQL bar. (Adjust the date range if necessary.)
2) After Endgame events are displayed in the timeline, click the Inspect button in the Timeline settings gear.

The additional fields (and values) will be included in the Inspect query Request / Response tabs.

### Cross-browser dark/light testing
#### Firefox

<img width="1680" alt="overview-firefox" src="https://user-images.githubusercontent.com/4459398/66524773-9c5d1380-eab0-11e9-9383-c155872881b0.png">

#### Safari

<img width="1680" alt="overview-safari" src="https://user-images.githubusercontent.com/4459398/66524790-a54de500-eab0-11e9-9786-aa7dbe18c1bf.png">

#### IE11

This PR was *not* tested in IE11 due to the current blocker with `react-reverse-portal`

https://github.com/elastic/siem-team/issues/465
https://github.com/elastic/ecs-dev/issues/178
2019-10-11 08:42:58 -06:00
Poff Poffenberger e5b6e90fa7
[Canvas] Adding i18n for transitions (#47626) (#47894)
* Adding i18n for transitions

* removing function

* Slide copy fix
2019-10-11 09:25:26 -05:00
Pete Harverson 56be26c99e
[ML] Adds new SIEM auditbeat, winlogbeat and packetbeat modules (#47848) (#47945)
* [ML] Adds new SIEM auditbeat, winlogbeat and packetbeat modules

* [ML] Removed rare_country_for_user jobs

* [ML] Removed rare_country_for_user jobs from manifests
2019-10-11 14:20:17 +01:00
Dima Arnautov 6c577688d1
[ML] Enhance created_by check for custom rules (#47825) (#47943)
* [ML] delete created_by only for wizards

* [ML] use CREATED_BY_LABEL enum

* [ML] move processCreatedBy
2019-10-11 15:12:38 +02:00
Carlos Pérez-Aradros Herce a2b266acda
Add CouchDB Metricbeat module tutorial to Kibana home (#47811) (#47941) 2019-10-11 14:40:46 +02:00
Alexey Antonov 16efde40fd
[Automation] TSVB doesn't allow to perform basic functions showing no fields available (#47860) (#47932) 2019-10-11 12:57:13 +03:00
Matthias Wilhelm 9dd431796d
Improve kbnTableHeader directive that causes warnings in console (#47829) (#47925) 2019-10-11 11:15:51 +02:00
Liza Katz 730bff388c
Reconstruct setup\start data shim APIs (due to savedObject N/A in setup) (#47851) (#47924)
* No saved objects client in data.setup

* replace old loading of data/public/setup

* test fixes

* fix list_control_factory

* range_control_factory
2019-10-11 09:55:31 +03:00
Yulong bb92b8b8b5
[Code] replace nodegit with native git (#45491) (#47920)
* [Code]  use native git to iterate git files
* [Code] use native git to clone/update repository
* [Code] git history using native git
* [Code] use native git to read file tree and file content
* [Code] fix the 'bad file' warning from status api
* [Code] use native git to handle worktree
* [Code] use native git to resolve references
* [Code] use native git to handle blame / diff
* [Code] patch git binaries in kibana build script
* [Code] migrate unit tests to use native git
2019-10-11 12:50:06 +08:00
Thomas Neirynck 936e018172
[SIEM][Maps] Use vector tiles for rendering EMS basemap (#47867) (#47911) 2019-10-10 22:31:09 -04:00
Nathan Reese 8cb0b75485
[Maps] retrieve geo_point value from docvalue_fields instead of _source (#47389) (#47917)
* [Maps] retrieve geo_point value from docvalue_fields instead of _source

* add functional test ensuring _search request only pulls what is needed

* clean up i18n translation fiels
2019-10-10 20:15:46 -06:00
Spencer aeb1775d61
[7.x] [dev/watch] ignore chromium and sass tmp directories (#4… (#47902) 2019-10-10 16:33:14 -07:00
Spencer d2bcbb74ce
[7.x] cleanup es even if test fails (#47868) (#47906)
* cleanup es even if test fails

* use correct beforeAll/afterAll hooks for jest
2019-10-10 16:32:38 -07:00
Steph Milovic 3d9fb52cee
[SIEM] type fix (#47708) (#47828) 2019-10-10 15:19:39 -07:00
Wylie Conlon 43e8c4420c
[lens] Basic usage telemetry for total visualizations, and by type (#47597) (#47899)
* [lens] Basic usage telemetry for total visualizations, and by type

* Implement overall, 30 day, 90 day tracking for saved visualizations

* Add forgotten file

* Implement collection using scripted metrics

* Add functional test to ensure painless script is working
2019-10-10 17:55:26 -04:00
Nik Everett bc59cb9e4d
Docs: Fix for asciidoctor (#47876) (#47910)
Asciidoctor is a bit more picky about somethings. This fixes them for
it.
2019-10-10 17:47:08 -04:00
Spencer 566cd69a98
[7.x] fix indentation of failure issue bodies (#47864) (#47887) 2019-10-10 14:36:32 -07:00
Corey Robertson 09d72bb9b5
[Canvas] Translate More Expression Arguments (#47028) (#47844)
* Translate other canvas arguments

* Update Snapshot

* Fix incorrect i18n key
2019-10-10 16:54:22 -04:00
Nate Archer d4200f4c75
[DOCS][CODE]: Add GO as a supported language server (#47550) (#47870)
* [DOCS] Fix beta tag in Code Docs

* Add additional content about cloning repos

* More grammar edits

* Address Gail's feedback.

* Fix build errors

* Another build fix

* [DOCS][CODE]: Add GO as a supported language server

* Update code-install-lang-server.asciidoc
2019-10-10 15:22:42 -05:00
Ryland Herrick 2fe225009d
[Code] Export integration components (#47636) (#47880)
* Expose CodeBlockPanel component

This separates the current CodeBlock component into two:
* CodeBlock, which simply renders the code view without
padding/margin
* CodeBlockPanel which wraps the CodeBlock in an EUIPanel and allows
overrides

It seems like APM will want to use the former for their integration,
while the latter is currently used internally by Code. It's very simple,
though, and could absolutely be inlined.

* Update demo page to use CodeBlock

This has no styling, and so a header could go right against it, it
could be shown/hidden distinct from the header, etc.

* Export our current integration components from main index

Adds a 'shared' manifest that does all the reaching in; the main one
just re-exports that.

* Move shared exports to the frontend manifest

This was incorrectly placed a level too high, in the plugin itself.

* Rename to better reflect relationship

CodeBlockPanel = EuiPanel + CodeBlock

* Distinguish monaco CSS overrides with page-specific layout
2019-10-10 15:12:06 -05:00
Poff Poffenberger 297ef13e96
[7.x] [Canvas] i18n for all known canvas errors (#46945) (#47838)
* [Canvas] i18n for all known canvas errors (#46945)

* i18n for all known canvas errors

* Removing error message not seen by users

* Fixing weird merge
2019-10-10 15:10:33 -05:00
Spencer b5220c648d
[7.x] [ci/failed_tests_reporter] when Github 500s, retry up to… (#47853)
* [ci/failed_tests_reporter] when Github 500s, retry up to 5 times

* remove unused import

* properly handle non-string headers
2019-10-10 12:53:03 -07:00
Nathan L Smith 1008c9d07e
[7.x] [APM] Keywords to select legend color in TPM graph (#476… (#47874)
If the result contains "ok" or "success", use the same color we use for HTTP 200.

If the result contains "error" or "failure", use the same color we use for HTTP 500.

Fixes #18707
2019-10-10 14:15:13 -05:00
Nathan L Smith 6b57c79f11
[7.x] [APM] Experimental Service Map front end (#46497) (#47840)
Add service map tabs on the main APM screen and for individual services.

This is not yet hooked up to work with back-end data, so it always shows the same hard-coded graph.

This is experimental, so you must have x-pack.apm.serviceMapEnabled: true in your Kibana config for it to show up.

Also add "PSF" to the list of allowed licenses since a new dependency added uses this license (it's on the [green list](https://github.com/elastic/open-source/blob/master/elastic-product-policy.md#green-list).)

Fixes #44890
Fixes #44853
2019-10-10 13:02:54 -05:00
Nathan L Smith 67ce81bf53
[7.x] [APM] Correctly plurarlize view in discover link (#47618) (#47836)
Fixes #46549
2019-10-10 13:02:33 -05:00
Nathan L Smith 8e64935e9e
[7.x] [APM] Documentation and alignment for impact column (#47… (#47839)
In the traces and transactions tables, left align the impact column heading and add a tooltip explaining what it means.

Fixes #44313
Fixes #28559
2019-10-10 13:01:47 -05:00
Nathan L Smith c00d1558c3
[7.x] [APM] Add docs about running in VSCode to README (#47536) (#47833) 2019-10-10 13:01:18 -05:00
Nathan L Smith f8da8f3744
[7.x] [APM] Add User agent to trace summary (#47526) (#47837) 2019-10-10 13:00:51 -05:00
Chris Davies 3329e5f72c
[Lens] Lazy load Lens index patterns (#46785) (#47749) 2019-10-10 13:15:54 -04:00
Matthias Wilhelm 3e44aa601a
Fix homepage app sample data dashboard test failures in cloud (#47737) (#47834)
* Improve launchSampleData of HomePageProvider for cloud testing

* Migrate to typescript
2019-10-10 18:16:18 +02:00
Xavier Mouligneau ac9ace0b23
[savedObject] Index patterns race condition (#47788) (#47820)
* [savedObject] [bug] Race Condition

* Forget async

* fix raise condition

* fix unit test
2019-10-10 11:36:32 -04:00
Tiago Costa dbb8fac56c
Fix typo in run_i18n_integrate (#47561) (#47826) 2019-10-10 16:07:16 +01:00
Chris Roberson 51a7bb22be
Use fixed_interval instead of interval (#47725) (#47786) 2019-10-10 10:55:03 -04:00
Joe Reuter 06764edfc7
improve wording of save modal and listing page (#47443) (#47823) 2019-10-10 16:42:44 +02:00
Joe Reuter 4a1dc494b8
[Graph] Style fixes (#47667) (#47824) 2019-10-10 16:42:37 +02:00
Stacey Gammon 8ed19f2c42
Don't throw an error is panel is added, then removed, before embeddable finishes loading (#46788) (#47818)
* Remove this error being thrown as it can be expected in certain situations

* change test after change in logic
2019-10-10 10:03:49 -04:00
Stacey Gammon 0419844ee3
Phase 1 of search services (#46742) (#47819)
* Phase 1 of search services

* First review feedback

* Start on tests

* Add functional tests for search explorer

* Add unload and fix ts error

* Add index.test.ts files for coverage completeness

* Adding unit tests

* use internal route terminology. No reason this should be a public route, at least not yet.

* Move search service into data plugin

* App mount search context needs to be optional

* Add more unit tests for server stuff

* wip types fix

* fix types for new context container stuff

* put back all jest test coverage paths

* address review comments

* delete the two test files that just tested the instantiation of the search service

* expose search fn on StartContract... tested locally only

* update mocks to account for new startcontract
2019-10-10 09:59:36 -04:00
Liza Katz 02240b27ef
call isTimeRangeSelectorEnabled (#47809) (#47812) 2019-10-10 16:46:23 +03:00
Bhavya RM 50e107b949
Fixing gauge test in firefox (#47082) (#47731)
Unskip gauge test in firefox
2019-10-10 09:35:06 -04:00
patrykkopycinski 061c0d47c0
[SIEM] Fix GraphQL type generation fails to generate types (#47638) (#47748) 2019-10-10 15:29:40 +02:00
Aleh Zasypkin da745fad97
[7.x] Preserve URL fragment during SAML handshake. (#47742) 2019-10-10 14:36:49 +02:00
Joe Reuter bd9225fe55
fix infinite loop in vega tooltips (#47700) (#47798) 2019-10-10 14:06:54 +02:00
Joe Reuter 2405752e17
[Graph] Do not carry over diversity field when switching data source (#47560) (#47799) 2019-10-10 14:06:32 +02:00
Joe Reuter 99536d7ad9
Use correct color for circles (#47715) (#47797) 2019-10-10 14:06:13 +02:00
Søren Louv-Jansen 0d77169b64
[7.x] [APM] Use new platform for toast notifications (#47276) | [APM] Agent configuration phase 2 (#46995) (#47806)
* [APM] Use new platform for toast notifications (#47276)

* [APM] Use new platform for toast notifications

* fix more tests

* remove comment

* [APM] Agent configuration phase 2 (#46995)

* [APM] Agent Config Management Phase 2

* Add status indicator

* Extract TimestampTooltip component

* Remove unused StickyTransactionProperties component

* Fix snapshot and minor cleanup

* Minor cleanup

* Display settings conditionally by agent name

* Fix client

* Format timestamp

* Minor design feedback

* Clear cache when clicking refresh

* Fix test

* Revert t() short hand

* Fix translations

* Add support for “all” option

* Fix API tests

* Move delete button to footer

* Fix snapshots

* Add API tests

* Fix toasts

* Address feedback and ensure order when searching for configs

* Fix snapshots

* Remove timeout
2019-10-10 13:51:15 +02:00