ansible/test/integration
Michael Scherer 529950680b Disable yum test on python 3 (#17327)
Since yum is not gonna be running on python3 ever, we have to filter it.
2016-09-01 04:30:54 -07:00
..
group_vars
host_vars
library Add GPL3 header to helloworld.go 2016-05-12 12:25:09 -05:00
lookup_paths
roles Add test for specific privlege grants on database.table (#17328) 2016-08-31 14:23:40 -07:00
test_blocks Mark tasks expected to fail with EXPECTED FAILURE. 2016-05-31 11:29:04 -07:00
vars
all.yml
amazon.yml
azure.yml
bad_parsing.yml
check_mode.yml
cleanup_azure.py
cleanup_ec2.py
cleanup_gce.py
cleanup_rax.py
cloudflare.yml
cloudstack.yml
consul.yml
consul_inventory.yml
consul_running.py
credentials.template
destructive.yml Disable yum test on python 3 (#17327) 2016-09-01 04:30:54 -07:00
download_binary_modules.yml Add binary module tests to Windows CI. (#16914) 2016-08-02 10:42:07 -07:00
exoscale.yml exo_dns: new module utils and integration tests for exoscale DNS (#17230) 2016-08-30 21:48:28 +02:00
galaxy_playbook.yml
galaxy_playbook_git.yml
galaxy_roles.yml
galaxy_rolesfile
gce.yml
gce_credentials.py
good_parsing.yml
integration_config.yml
inventory Add binary module tests to Windows CI. (#16914) 2016-08-02 10:42:07 -07:00
inventory.group_by
inventory.handlers
inventory.local
inventory.remote.template Add support for OS X CI on Shippable. (#17160) 2016-08-23 10:49:46 -07:00
inventory.winrm.template Add binary module tests to Windows CI. (#16914) 2016-08-02 10:42:07 -07:00
lookup.ini
lookup.properties
Makefile exo_dns: new module utils and integration tests for exoscale DNS (#17230) 2016-08-30 21:48:28 +02:00
no_log_local.yml
non_destructive.yml fix for unspecified retries on until + test (#16963) 2016-08-04 19:20:45 -04:00
rackspace.yml
README.md Add mention of integration tests in Docker containers (#16661) 2016-09-01 01:25:53 +02:00
setup_gce.py
test_async.yml Increase async time limit on tests to 10 seconds. (#16921) 2016-08-02 13:30:26 -07:00
test_binary_modules.yml Add binary module tests to Windows CI. (#16914) 2016-08-02 10:42:07 -07:00
test_connection.inventory Add FreeBSD to Shippable CI. (#16883) 2016-08-01 13:46:37 -07:00
test_connection.yml raw now returns changed: true (#17112) 2016-08-16 20:39:23 -07:00
test_connection_winrm.yml raw now returns changed: true (#17112) 2016-08-16 20:39:23 -07:00
test_delegate_to.yml
test_environment.yml Fix YAML source and check it on Shippable (#15678) 2016-06-04 10:58:17 -07:00
test_filters.yml
test_force_handlers.yml
test_gathering_facts.yml
test_group_by.yml
test_handlers.yml
test_hash.yml fix default/main.yml to defaults/main.yml 2016-07-02 21:16:33 +09:00
test_include_vars.yml Include vars updated to work with directories (#17207) 2016-08-30 14:34:31 -07:00
test_includes.yml Use loop_control.loop_var directly 2016-07-01 07:03:42 +05:30
test_includes2.yml
test_includes3.yml Use loop_control.loop_var directly 2016-07-01 07:03:42 +05:30
test_includes4.yml Use loop_control.loop_var directly 2016-07-01 07:03:42 +05:30
test_lookup_properties.yml
test_setup.yml
test_tags.yml
test_templating_settings.yml
test_test_infra.yml Mark tasks expected to fail with EXPECTED FAILURE. 2016-05-31 11:29:04 -07:00
test_var_precedence.yml
test_vault.yml Implement vault encrypted yaml variables. (#16274) 2016-08-23 20:03:11 -04:00
test_vault_embedded.yml Implement vault encrypted yaml variables. (#16274) 2016-08-23 20:03:11 -04:00
test_win_group1.yml Add Windows integration tests to Shippable. (#16803) 2016-07-28 21:03:14 -07:00
test_win_group2.yml Add Windows integration tests to Shippable. (#16803) 2016-07-28 21:03:14 -07:00
test_win_group3.yml Add Windows integration tests to Shippable. (#16803) 2016-07-28 21:03:14 -07:00
unicode-test-script
unicode.yml
vars_file.yml
vault-password
vault-secret.txt feature/copy-vault-dataloader: Add method get_real_file(file_path) to dataloader 2016-04-14 14:12:48 -04:00

Integration tests

The ansible integration system.

Tests for playbooks, by playbooks.

Some tests may require credentials. Credentials may be specified with credentials.yml.

Tests should be run as root.

Configuration

Making your own version of integration_config.yml can allow for setting some tunable parameters to help run the tests better in your environment. Some tests (e.g. cloud) will only run when access credentials are provided. For more information about supported credentials, refer to credentials.template.

Prerequisites

The tests will assume things like hg, svn, and git are installed and in path.

(Complete list pending)

Non-destructive Tests

These tests will modify files in subdirectories, but will not do things that install or remove packages or things outside of those test subdirectories. They will also not reconfigure or bounce system services.

Run as follows:

make non_destructive

You can select specific tests with the --tags parameter.

TEST_FLAGS="--tags test_vars_blending" make

Destructive Tests

These tests are allowed to install and remove some trivial packages. You will likely want to devote these to a virtual environment. They won't reformat your filesystem, however :)

make destructive

Cloud Tests

Cloud tests exercise capabilities of cloud modules (e.g. ec2_key). These are not 'tests run in the cloud' so much as tests that leverage the cloud modules and are organized by cloud provider.

In order to run cloud tests, you must provide access credentials in a file named credentials.yml. A sample credentials file named credentials.template is available for syntax help.

Provide cloud credentials: cp credentials.template credentials.yml ${EDITOR:-vi} credentials.yml

Run the tests: make cloud

WARNING running cloud integration tests will create and destroy cloud resources. Running these tests may result in additional fees associated with your cloud account. Care is taken to ensure that created resources are removed. However, it is advisable to inspect your AWS console to ensure no unexpected resources are running.

Windows Tests

These tests exercise the winrm connection plugin and Windows modules. You'll need to define an inventory with a remote Windows 2008 or 2012 Server to use for testing, and enable PowerShell Remoting to continue.

Running these tests may result in changes to your Windows host, so don't run them against a production/critical Windows environment.

Enable PowerShell Remoting (run on the Windows host via Remote Desktop): Enable-PSRemoting -Force

Define Windows inventory: cp inventory.winrm.template inventory.winrm ${EDITOR:-vi} inventory.winrm

Run the tests: make test_winrm

Tests in Docker containers

It is possible to run tests in Docker containers.

For example, to run test test_ping from non_destructive suite on Ubuntu 14.04 container:

  • go to the repository root
  • and execute TARGET=ubuntu1404 MAKE_TARGET=non_destructive TEST_FLAGS='--tags test_ping' ./test/utils/run_tests.sh

Available targets (containers):

  • centos6
  • centos7
  • fedora-rawhide
  • fedora23
  • opensuseleap
  • ubuntu1204
  • ubuntu1404
  • ubuntu1604