ansible/test/integration
Abhijit Menon-Sen 88a20e7a20 Fix broken integration test with unicode hostnames
1. The test did "name: '{{hostnames}}.{{item}}'" inside a with_sequence
   loop, which didn't do what was intended: it expanded hostnames into
   an array, appended ".1", and set name to the resulting string. This
   can be converted to a simple with_items loop.

2. Some of the entries in hostnames contained punctuation characters,
   which I see no reason to support in inventory hostnames anyway.

3. Once the add_host failures are fixed, the playbook later fails when
   the unicode hostnames are interpolated into debug output in ssh.py
   due to an encoding error. This is only one of the many places that
   may fail when using unicode inventory hostnames; we work around it
   by providing an ansible_ssh_host setting.
2015-09-11 21:47:19 +05:30
..
group_vars
host_vars Adding an integration test for variable precedence 2014-05-09 11:42:57 -05:00
lookup_paths corrected on delete also 2015-08-13 09:58:30 -04:00
roles cloudstack: new integration test role test_cs_user 2015-09-09 22:36:19 +02:00
vars Add unicode characters to the data that we're testing that ansible-vault can decrypt 2015-08-25 15:14:43 -07:00
all.yml Add a lot of tests to verify parsing routines for scenarios that should pass. Some changes TBD, like stripping command spaces off end of expressions. 2014-07-23 22:10:58 -04:00
amazon.yml Re-enable the ec2_eip test 2014-08-05 09:20:23 -05:00
azure.yml add azure integration tests 2015-05-04 23:45:03 -04:00
bad_parsing.yml Add missing file. 2014-07-23 23:32:45 -04:00
check_mode.yml Rework the shell quoting of remote checksumming 2015-03-02 15:42:18 -08:00
cleanup_azure.py add azure integration tests 2015-05-04 23:45:03 -04:00
cleanup_ec2.py Support print() function in test/ 2015-08-27 22:15:57 +03:00
cleanup_gce.py Support print() function in test/ 2015-08-27 22:15:57 +03:00
cleanup_rax.py Fix assert statement syntax 2015-08-27 22:15:57 +03:00
cloudstack.yml cloudstack: new integration test role test_cs_user 2015-09-09 22:36:19 +02:00
consul.yml Initial commit of Ansible support for the Consul clustering framework (http://consul.io). 2015-01-24 01:09:03 +00:00
consul_inventory.yml Initial commit of Ansible support for the Consul clustering framework (http://consul.io). 2015-01-24 01:09:03 +00:00
consul_running.py Support print() function in test/ 2015-08-27 22:15:57 +03:00
credentials.template assert password or ssh key provided on new image creation 2015-07-09 13:44:09 -04:00
destructive.yml Initial test of the docker module 2015-03-17 12:32:07 -07:00
galaxy_playbook.yml Allow installation of roles from yaml roles file 2014-08-21 17:15:23 -04:00
galaxy_roles.yml galaxy fixes 2015-08-28 12:32:50 -04:00
galaxy_rolesfile Allow github style ssh repo names 2014-09-10 21:55:27 +10:00
gce.yml Adds integration tests for gce_pd module. 2014-04-13 18:38:31 -07:00
gce_credentials.py Adds support for creating GCE persistent disks from snapshots 2014-04-13 18:38:31 -07:00
good_parsing.yml Add a lot of tests to verify parsing routines for scenarios that should pass. Some changes TBD, like stripping command spaces off end of expressions. 2014-07-23 22:10:58 -04:00
integration_config.yml Fixes for WinRM/PowerShell support in v2. 2015-07-31 14:38:31 -04:00
inventory Test case for #10426 2015-03-11 20:58:21 -07:00
inventory.group_by Add integration tests for group_by module. Fixed bug introduced by ansible/ansible#7273 while also fixing issue described in ansible/ansible#6953 2014-05-06 22:30:37 -04:00
inventory.handlers Ensure handlers run when meta tasks are defined and add handler integration tests 2014-03-25 13:33:52 -04:00
inventory.winrm.template Add winrm integration tests for raw, script and ping modules. 2014-06-19 14:24:13 -05:00
lookup.ini Add documentation for the ini lookup plugin. 2015-08-05 11:09:40 +02:00
lookup.properties New lookup plugin : ini. Can handle ini file and java properties file. 2015-05-27 21:51:20 +02:00
Makefile added test for environment directive 2015-08-21 00:37:17 -04:00
non_destructive.yml Lots of fixes for integration test bugs 2015-07-10 01:53:59 -04:00
rackspace.yml Add tests for rax_scaling_group 2015-06-18 13:08:35 -05:00
README.md Add winrm integration tests for raw, script and ping modules. 2014-06-19 14:24:13 -05:00
setup_gce.py Support print() function in test/ 2015-08-27 22:15:57 +03:00
test_delegate_to.yml Fix remote_checksum with delegate_to and add tests for several ways that delegate_to works 2014-12-08 12:44:44 -08:00
test_environment.yml used stdoutlines list to avoid string mismatches 2015-08-25 10:06:24 -04:00
test_filters.yml Fixing some small bugs related to integration tests (v2) 2015-06-01 16:42:10 -05:00
test_force_handlers.yml Lots of fixes for integration test bugs 2015-07-10 01:53:59 -04:00
test_group_by.yml Lots of fixes for integration test bugs 2015-07-10 01:53:59 -04:00
test_handlers.yml tests: checks that handlers work with loops 2015-07-20 14:41:03 +02:00
test_hash.yml
test_includes.yml Verify playbook includes can take params. 2014-07-26 10:41:23 -04:00
test_includes2.yml added empty include test 2015-07-14 12:06:31 -04:00
test_lookup_properties.yml Add documentation for the ini lookup plugin. 2015-08-05 11:09:40 +02:00
test_setup.yml
test_tags.yml added tests 2015-02-13 08:27:07 -05:00
test_templating_settings.yml Proper git commit of the new integration test 2015-02-26 14:53:51 -08:00
test_var_precedence.yml fixed var file loading 2015-07-14 12:12:43 -04:00
test_vault.yml Change name of vault integration test 2014-06-10 10:07:50 -05:00
test_winrm.yml When running winrm tests against multiple hosts, fail the play when any host has a failure. 2015-05-31 23:16:45 -04:00
unicode.yml Fix broken integration test with unicode hostnames 2015-09-11 21:47:19 +05:30
vars_file.yml added tests for templating and with_items 2014-12-09 11:31:21 -05:00
vault-password Added integration tests for encrypted vars 2014-05-21 21:06:47 +02:00

Integration tests

The ansible integration system.

Tests for playbooks, by playbooks.

Some tests may require credentials. Credentials may be specified with credentials.yml.

Tests should be run as root.

Configuration

Making your own version of integration_config.yml can allow for setting some tunable parameters to help run the tests better in your environment. Some tests (e.g. cloud) will only run when access credentials are provided. For more information about supported credentials, refer to credentials.template.

Prerequisites

The tests will assume things like hg, svn, and git are installed and in path.

(Complete list pending)

Non-destructive Tests

These tests will modify files in subdirectories, but will not do things that install or remove packages or things outside of those test subdirectories. They will also not reconfigure or bounce system services.

Run as follows:

make non_destructive

You can select specific tests with the --tags parameter.

TEST_FLAGS="--tags test_vars_blending" make

Destructive Tests

These tests are allowed to install and remove some trivial packages. You will likely want to devote these to a virtual environment. They won't reformat your filesystem, however :)

make destructive

Cloud Tests

Cloud tests exercise capabilities of cloud modules (e.g. ec2_key). These are not 'tests run in the cloud' so much as tests that leverage the cloud modules and are organized by cloud provider.

In order to run cloud tests, you must provide access credentials in a file named credentials.yml. A sample credentials file named credentials.template is available for syntax help.

Provide cloud credentials: cp credentials.template credentials.yml ${EDITOR:-vi} credentials.yml

Run the tests: make cloud

WARNING running cloud integration tests will create and destroy cloud resources. Running these tests may result in additional fees associated with your cloud account. Care is taken to ensure that created resources are removed. However, it is advisable to inspect your AWS console to ensure no unexpected resources are running.

Windows Tests

These tests exercise the winrm connection plugin and Windows modules. You'll need to define an inventory with a remote Windows 2008 or 2012 Server to use for testing, and enable PowerShell Remoting to continue.

Running these tests may result in changes to your Windows host, so don't run them against a production/critical Windows environment.

Enable PowerShell Remoting (run on the Windows host via Remote Desktop): Enable-PSRemoting -Force

Define Windows inventory: cp inventory.winrm.template inventory.winrm ${EDITOR:-vi} inventory.winrm

Run the tests: make test_winrm