ansible/test/integration
Toshio Kuratomi 4b0aa1214c Ziploader
* Ziploader proof of concept (jimi-c)

* Cleanups to proof of concept ziploader branch:

* python3 compatible base64 encoding
* zipfile compression (still need to enable toggling this off for
  systems without zlib support in python)
* Allow non-wildcard imports (still need to make this recusrsive so that
  we can have module_utils code that imports other module_utils code.)
* Better tracebacks: module filename is kept and module_utils directory
  is kept so that tracebacks show the real filenames that the errors
  appear in.

* Make sure we import modules that are used into the module_utils files that they are used in.

* Set ansible version in a more pythonic way for ziploader than we were doing in module replacer

* Make it possible to set the module compression as an inventory var

This may be necessary on systems where python has been compiled without
zlib compression.

* Refactoring of module_common code:

* module replacer only replaces values that make sense for that type of
  file (example: don't attempt to replace python imports if we're in
  a powershell module).
* Implement configurable shebang support for ziploader wrapper
* Implement client-side constants (for SELINUX_SPECIAL_FS and SYSLOG)
  via environment variable.
* Remove strip_comments param as we're never going to use it (ruins line
  numbering)

* Don't repeat ourselves about detecting REPLACER

* Add an easy way to debug

* Port test-module to the ziploader-aware modify_module()

* strip comments and blank lines from the wrapper so we send less over the wire.

* Comments cleanup

* Remember to output write the module line itself in powershell modules

* for line in lines strips the newlines so we have to add them back in
2016-04-05 11:06:17 -07:00
..
group_vars
host_vars breaks testing in non virtual envs, since env var can be used in those 2015-11-12 09:40:43 -08:00
lookup_paths corrected on delete also 2015-08-13 09:58:30 -04:00
roles Ziploader 2016-04-05 11:06:17 -07:00
test_blocks Fixing PlayIterator bugs 2016-03-09 13:31:30 -05:00
vars Add unicode characters to the data that we're testing that ansible-vault can decrypt 2015-08-25 15:14:43 -07:00
all.yml
amazon.yml
azure.yml add azure integration tests 2015-05-04 23:45:03 -04:00
bad_parsing.yml
check_mode.yml Rework the shell quoting of remote checksumming 2015-03-02 15:42:18 -08:00
cleanup_azure.py add azure integration tests 2015-05-04 23:45:03 -04:00
cleanup_ec2.py Support print() function in test/ 2015-08-27 22:15:57 +03:00
cleanup_gce.py Support print() function in test/ 2015-08-27 22:15:57 +03:00
cleanup_rax.py Fix assert statement syntax 2015-08-27 22:15:57 +03:00
cloudflare.yml Add integration tests for the cloudflare_dns module 2016-03-25 21:22:29 +01:00
cloudstack.yml cloudstack: new integration tests test_cs_resourcelimit 2016-03-15 21:41:08 +01:00
consul.yml
consul_inventory.yml
consul_running.py Support print() function in test/ 2015-08-27 22:15:57 +03:00
credentials.template Add integration tests for the cloudflare_dns module 2016-03-25 21:22:29 +01:00
destructive.yml Integration tests for zypper repository 2016-03-16 19:56:56 +01:00
galaxy_playbook.yml
galaxy_playbook_git.yml [hotfix] add missed playbook file 2016-01-21 14:08:26 +02:00
galaxy_roles.yml Add tests for #10620 2015-11-18 20:47:54 +10:00
galaxy_rolesfile Add tests for #10620 2015-11-18 20:47:54 +10:00
gce.yml
gce_credentials.py
good_parsing.yml
integration_config.yml Fixes for WinRM/PowerShell support in v2. 2015-07-31 14:38:31 -04:00
inventory add a fact gathering check for the default of all 2016-03-15 11:58:23 -07:00
inventory.group_by
inventory.handlers
inventory.local re-integrate test_test_infra output checking 2016-03-18 10:14:22 -07:00
inventory.winrm.template Add connection tests for winrm connection plugin. 2016-03-31 08:32:41 -07:00
lookup.ini Add documentation for the ini lookup plugin. 2015-08-05 11:09:40 +02:00
lookup.properties New lookup plugin : ini. Can handle ini file and java properties file. 2015-05-27 21:51:20 +02:00
Makefile Merge pull request #15207 from mattclay/verbose-test 2016-03-31 22:02:19 -07:00
no_log_local.yml removed redundant tests, adjusted makefile expected count 2015-10-02 22:37:19 -04:00
non_destructive.yml fix for dynamic (add_host) hosts not available in hostvars 2015-11-16 10:53:10 -08:00
rackspace.yml Add tests for rax_scaling_group 2015-06-18 13:08:35 -05:00
README.md
setup_gce.py Support print() function in test/ 2015-08-27 22:15:57 +03:00
test_connection.inventory Run more connection tests in Docker. 2016-03-23 21:21:52 -07:00
test_connection.yml Add unicode dir to connection tests. 2016-03-11 16:55:14 -08:00
test_connection_winrm.yml Add connection tests for winrm connection plugin. 2016-03-31 08:32:41 -07:00
test_delegate_to.yml
test_environment.yml used stdoutlines list to avoid string mismatches 2015-08-25 10:06:24 -04:00
test_filters.yml Fixing some small bugs related to integration tests (v2) 2015-06-01 16:42:10 -05:00
test_force_handlers.yml Lots of fixes for integration test bugs 2015-07-10 01:53:59 -04:00
test_gathering_facts.yml Make the fact gathering give a little more information on failure 2016-03-15 12:32:27 -07:00
test_group_by.yml Lots of fixes for integration test bugs 2015-07-10 01:53:59 -04:00
test_handlers.yml tests: checks that handlers work with loops 2015-07-20 14:41:03 +02:00
test_hash.yml
test_includes.yml
test_includes2.yml added empty include test 2015-07-14 12:06:31 -04:00
test_lookup_properties.yml Add documentation for the ini lookup plugin. 2015-08-05 11:09:40 +02:00
test_setup.yml
test_tags.yml added tests 2015-02-13 08:27:07 -05:00
test_templating_settings.yml Proper git commit of the new integration test 2015-02-26 14:53:51 -08:00
test_test_infra.yml improve test_test_infra debug messaging, rc check 2016-03-18 08:51:43 -07:00
test_var_precedence.yml reformated test, changed big assert to with_items 2015-12-01 21:11:12 -08:00
test_vault.yml
test_winrm.yml adding integration tests for win_regmerge module (extras) 2015-12-09 08:57:06 +00:00
unicode-test-script Fix problems with non-ascii values passed as part of the command to connection plugins 2016-01-04 20:35:25 -08:00
unicode.yml More fixes for unicode handling in the connection plugins. 2016-01-06 15:19:40 -08:00
vars_file.yml
vault-password

Integration tests

The ansible integration system.

Tests for playbooks, by playbooks.

Some tests may require credentials. Credentials may be specified with credentials.yml.

Tests should be run as root.

Configuration

Making your own version of integration_config.yml can allow for setting some tunable parameters to help run the tests better in your environment. Some tests (e.g. cloud) will only run when access credentials are provided. For more information about supported credentials, refer to credentials.template.

Prerequisites

The tests will assume things like hg, svn, and git are installed and in path.

(Complete list pending)

Non-destructive Tests

These tests will modify files in subdirectories, but will not do things that install or remove packages or things outside of those test subdirectories. They will also not reconfigure or bounce system services.

Run as follows:

make non_destructive

You can select specific tests with the --tags parameter.

TEST_FLAGS="--tags test_vars_blending" make

Destructive Tests

These tests are allowed to install and remove some trivial packages. You will likely want to devote these to a virtual environment. They won't reformat your filesystem, however :)

make destructive

Cloud Tests

Cloud tests exercise capabilities of cloud modules (e.g. ec2_key). These are not 'tests run in the cloud' so much as tests that leverage the cloud modules and are organized by cloud provider.

In order to run cloud tests, you must provide access credentials in a file named credentials.yml. A sample credentials file named credentials.template is available for syntax help.

Provide cloud credentials: cp credentials.template credentials.yml ${EDITOR:-vi} credentials.yml

Run the tests: make cloud

WARNING running cloud integration tests will create and destroy cloud resources. Running these tests may result in additional fees associated with your cloud account. Care is taken to ensure that created resources are removed. However, it is advisable to inspect your AWS console to ensure no unexpected resources are running.

Windows Tests

These tests exercise the winrm connection plugin and Windows modules. You'll need to define an inventory with a remote Windows 2008 or 2012 Server to use for testing, and enable PowerShell Remoting to continue.

Running these tests may result in changes to your Windows host, so don't run them against a production/critical Windows environment.

Enable PowerShell Remoting (run on the Windows host via Remote Desktop): Enable-PSRemoting -Force

Define Windows inventory: cp inventory.winrm.template inventory.winrm ${EDITOR:-vi} inventory.winrm

Run the tests: make test_winrm