kibana/x-pack
Tim Sullivan 8fc67c064a
Stats API: implement the "kibana status" spec from the Monitoring data model for stats (#20577) (#20956)
* [Stats API] Set API field names per spec

* fix jest tests

* fix api integration test

* trash the original metrics collector

- constantly accumulating stats over time does not align with the existing behavior, which is to reset the stats to 0 whenever they are pulled

* move some logic out of the collector types combiner into inline

- change the signature of sourceKibana

* Make a new stats collector for the API

- to not clear the data when pulling via the api
- fetching is a read-only thing

* isolate data transforms for api data and upload data

* no static methods

* remove external in bytes

* remove the _stats prefix for kibana and reporting

* update jest test snapshot

* fix collector_types_combiner test

* fix usage api

* add test suite todo comment

* reduce some loc change

* roll back mysterious change

* reduce some more loc change

* comment correction

* reduce more loc change

* whitespace

* comment question

* fix cluster_uuid

* fix stats integration test

* fix bulk uploader test, combineTypes is no longer external

* very important comments about the current nature of stats represented and long-term goals

* add stats api tests with/without authentication

* fix more fields to match data model

* fix more tests

* fix jest test

* remove TODO

* remove sockets

* use snake_case for api field names

* restore accidental removal + copy/paste error

* sourceKibana -> getKibanaInfoForStats

* skip usage test on legacy endpoint

* fix api tests

* more comment

* stop putting a field in that used to be omitted

* fix the internal type to ID the usage data for bulk uploader

* correct the kibana usage type value, which is shown as-is in the API

* more fixes for the constants identifying collector types + test against duplicates

* add a comment on a hack, and a whitespace fix
2018-07-19 12:03:57 -07:00
..
.github Migrate x-pack-kibana source to kibana 2018-04-24 13:49:26 -07:00
build_chromium Migrate x-pack-kibana source to kibana 2018-04-24 13:49:26 -07:00
common Migrate x-pack-kibana source to kibana 2018-04-24 13:49:26 -07:00
dev-tools Introducing base audit logger (#19442) (#19546) 2018-05-30 10:26:42 -04:00
docs/en/monitoring [DOCS] Moves monitoring folder to docs (#19516) 2018-05-30 09:45:30 -07:00
gulp_helpers Fix misspellings (#19981) (#20284) 2018-06-27 20:50:06 -07:00
plugins Stats API: implement the "kibana status" spec from the Monitoring data model for stats (#20577) (#20956) 2018-07-19 12:03:57 -07:00
scripts Move all reporting tests into their own folder and add chromium tests (#19330) (#19690) 2018-06-06 07:59:45 -04:00
server/lib Introducing base audit logger (#19442) (#19546) 2018-05-30 10:26:42 -04:00
test Stats API: implement the "kibana status" spec from the Monitoring data model for stats (#20577) (#20956) 2018-07-19 12:03:57 -07:00
webpackShims Migrate x-pack-kibana source to kibana 2018-04-24 13:49:26 -07:00
.gitignore [Gitignore/Test] Ignore test/functional/failure_debug (#19059) (#19076) 2018-05-15 13:47:53 -07:00
.kibana-plugin-helpers.json [6.x] [typescript] add typescript support for the server and browser (#19104) (#19223) 2018-05-21 10:42:59 -07:00
gulpfile.js Fix misspellings (#19981) (#20284) 2018-06-27 20:50:06 -07:00
index.js Add Notification Service (#19236) 2018-05-22 19:09:04 -04:00
package.json Upgrade typescript to 2.9.2 (#20757) (#20865) 2018-07-17 11:23:09 +02:00
README.md Functional test setup with kbn-test package (#18568) (#19174) 2018-05-17 13:42:43 -05:00
tsconfig.json [6.x] [typescript] add typescript support for the server and browser (#19104) (#19223) 2018-05-21 10:42:59 -07:00
tslint.yaml Backport/19383/6.x (#19487) 2018-05-28 20:24:23 -07:00
yarn.lock Upgrade typescript to 2.9.2 (#20757) (#20865) 2018-07-17 11:23:09 +02:00

Elastic License Functionality

This directory tree contains files subject to the Elastic License. The files subject to the Elastic License are grouped in this directory to clearly separate them from files licensed under the Apache License 2.0.

Development

By default, Kibana will run with X-Pack installed as mentioned in the contributing guide.

Elasticsearch will run with a basic license. To run with a trial license, including security, you can specifying that with the yarn es command.

Example: yarn es snapshot --license trial --password changeme

Testing

Running unit tests_bundle

You can run unit tests by running:

yarn test

If you want to run tests only for a specific plugin (to save some time), you can run:

yarn test --plugins <plugin>[,<plugin>]*    # where <plugin> is "reporting", etc.

Running single test file

Edit test file, changing top level describe to describe.only. Run tests with normal commands.

Running Jest Unit Tests

# from x-pack folder
node scripts/jest

Debugging browser tests

yarn test:browser:dev

Initializes an environment for debugging the browser tests. Includes an dedicated instance of the kibana server for building the test bundle, and a karma server. When running this task the build is optimized for the first time and then a karma-owned instance of the browser is opened. Click the "debug" button to open a new tab that executes the unit tests.

Run single tests by appending grep parameter to the end of the URL. For example http://localhost:9876/debug.html?grep=ML%20-%20Explorer%20Controller will only run tests with 'ML - Explorer Controller' in the describe block.

Running server unit tests

You can run server-side unit tests by running:

yarn test:server

Running functional tests

The functional UI tests, the API integration tests, and the SAML API integration tests are all run against a live browser, Kibana, and Elasticsearch install. Each set of tests is specified with a unique config that describes how to start the Elasticsearch server, the Kibana server, and what tests to run against them. The sets of tests that exist today are functional UI tests (specified by this config), API integration tests (specified by this config), and SAML API integration tests (specified by this config).

The script runs all sets of tests sequentially like so:

  • builds Elasticsearch and X-Pack
  • runs Elasticsearch with X-Pack
  • starts up the Kibana server with X-Pack
  • runs the functional UI tests against those servers
  • tears down the servers
  • repeats the same process for the API and SAML API integration test configs.

To do all of this in a single command run:

node scripts/functional_tests

Running UI tests

The functional UI tests can be run separately like so:

node scripts/functional_tests --config test/functional/config

It does the same as the previous command, except that it only does setup/test/teardown for the UI tests.

Running API integration tests

API integration tests are run with a unique setup usually without UI assets built for the Kibana server.

API integration tests are intended to test only programmatic API exposed by Kibana. There is no need to run browser and simulate user actions, which significantly reduces execution time. In addition, the configuration for API integration tests typically sets optimize.enabled=false for Kibana because UI assets are usually not needed for these tests.

The API integration tests can be run separately like so:

node scripts/functional_tests --config test/api_integration/config

Running SAML API integration tests

We also have SAML API integration tests which set up Elasticsearch and Kibana with SAML support. Run API integration tests separately with SAML support like so:

node scripts/functional_tests --config test/saml_api_integration/config

Developing functional tests

If you are developing functional tests then you probably don't want to rebuild Elasticsearch and wait for all that setup on every test run, so instead use this command to build and start just the Elasticsearch and Kibana servers:

node scripts/functional_tests_server

After the servers are started, open a new terminal and run this command to run just the tests (without tearing down Elasticsearch or Kibana):

# make sure you are in the x-pack-kibana project
cd x-pack

# invoke the functional_test_runner from kibana project. try sending --help to learn more
node ../scripts/functional_test_runner

For both of the above commands, it's crucial that you pass in --config to specify the same config file to both commands. This makes sure that the right tests will run against the right servers. Typically a set of tests and server configuration go together.

Read more about how the scripts work here.

For a deeper dive, read more about the way functional tests and servers work here.

Issues starting dev more of creating builds

You may see an error like this when you are getting started:

[14:08:15] Error: Linux x86 checksum failed
    at download_phantom.js:42:15
    at process._tickDomainCallback (node.js:407:9)

That's thanks to the binary Phantom downloads that have to happen, and Bitbucket being annoying with throttling and redirecting or... something. The real issue eludes me, but you have 2 options to resolve it.

  1. Just keep re-running the command until it passes. Eventually the downloads will work, and since they are cached, it won't ever be an issue again.
  2. Download them by hand from Bitbucket and copy them into the .phantom path. We're currently using 1.9.8, and you'll need the Window, Mac, and Linux builds.