Matt Clay
e4e5005640
Fix ansible-test coverage path handling. ( #61528 )
...
* Fix ansible-test coverage path handling.
* Split CI unit tests into two groups.
2019-08-30 00:18:49 -07:00
Sam Doran
e5b24a68cc
Add additional group for sanity tests
...
Put validate-modules in its own group
2019-08-29 00:21:07 -07:00
Jordan Borean
81cb6f366a
Added group 7 to Windows groups - ci_complete ( #60240 )
2019-08-08 10:13:28 +10:00
Sam Doran
b9dafdbade
Move integration tests to using RHEL 8.0 GA ( #57772 )
2019-07-09 17:45:06 -04:00
Sam Doran
c1a23cd763
Add two new Azure groups to prevent timeouts
...
ci_complete
2019-07-01 10:38:24 -07:00
Sam Doran
7b9d991f78
Add Fedora 30 to test matrix ( #57713 )
...
Remove Fedora 28 from test matrix
2019-06-21 10:55:58 -04:00
Sam Doran
84075fe351
Change RHEL8 image name to match changes in ansible-test ( #57807 )
...
* Change RHEL8 image name to match changes in ansible-test
Continue to use the beta version of RHEL 8 until we fix tests that are breaking with the GA version.
* Skip ufw integration test on RHEL 8 Beta
2019-06-14 13:47:26 -07:00
Matt Clay
85ae8f5258
Add Hetzner Cloud to CI integration tests.
2019-04-09 15:41:50 -07:00
Matt Clay
9e30300034
Add 6th Windows CI group.
2019-04-02 23:41:43 -07:00
Matt Clay
c8f2becb7a
Reduce testing of Ubuntu versions.
...
Removing:
- Ubuntu 14.04 with Python 2.7
- Ubuntu 16.04 with Python 3.5
Keeping:
- Ubuntu 16.04 with Python 2.7
- Ubuntu 18.04 with Python 3.6
2019-04-02 17:30:34 -07:00
Matt Clay
906427caba
Add shippable/posix/group4/ for CI. ( #53816 )
2019-03-15 07:25:37 -07:00
Matt Clay
9ed9cfb40c
Split Windows tests into 5 groups.
2019-03-06 20:52:17 -08:00
Jordan Borean
3635c59b23
OpenSUSE - Add OpenSUSE 15 test containers ( #52793 )
...
* OpenSUSE - Add OpenSUSE 15 test containers ci_complete
* Reset matrix back to normal
* Set container version instead of latest
* Remove old Docker completion file
2019-02-25 11:38:29 +10:00
Matt Clay
6a82827ddd
Add Python 3.8 to ansible-test and CI.
2019-02-14 23:24:24 -08:00
Matt Clay
9bb1c59686
Add FreeBSD 12.0 to CI. ( #52195 )
2019-02-13 23:36:07 -08:00
Jordan Borean
0334c20630
Add Windows Server 2019 to Shippable matrix ( #51685 )
...
* Test out Server 2019 - ci_complete
* run tests and continue on error - ci_complete
* Add the full matrix back in
2019-02-08 10:38:52 +10:00
Jordan Borean
828df4b336
ansible-test: add Ubuntu 18.04 container ( #50790 )
...
* ansible-test: Add Ubuntu 18.04 to Shippable CI nodes
* re-add ubuntu1604/3 to matrix
* forgot to add environment for git kill gpg-agent
2019-01-22 10:30:35 +10:00
Jordan Borean
6a09db5131
ansible-test - swap Fedora 25 for 29 ( #49634 )
2018-12-07 12:00:23 +10:00
Jordan Borean
5392caee14
ansible-test: change Fedora 24 to 28 ( #49586 )
2018-12-06 16:30:11 +10:00
Matt Clay
a41c0405a7
Add CI platform: rhel/8.0 ( #48835 )
2018-11-16 22:06:19 -08:00
Matt Clay
e6ffc4f89a
Remove CI platform: freebsd/10.4
2018-11-16 00:46:09 -08:00
Matt Clay
6745ee7cc8
Switch tests from RHEL 7.5 to 7.6.
2018-11-15 21:42:49 -08:00
Matt Clay
6a51b5ed26
Use 4 nodes for sanity tests in CI.
2018-10-16 09:55:26 -07:00
Matt Clay
2761fe8272
Revert "Use 4 nodes for sanity tests in CI."
...
This reverts commit b887333029
.
2018-10-15 12:11:17 -07:00
Matt Clay
b887333029
Use 4 nodes for sanity tests in CI.
2018-10-15 12:03:43 -07:00
Matt Clay
40c9301b27
Use default Shippable container. ( #46703 )
2018-10-09 11:45:21 -07:00
Jordan Borean
a7d372c3ba
go back to FreeBSD 11.1 for tests due to 11.2 stability issues ( #45872 )
2018-09-20 09:24:16 +10:00
Matt Clay
c50d6f1944
Update RHEL and FreeBSD versions used for tests:
...
- RHEL 7.4 -> 7.5
- FreeBSD 11.1 -> 11.2
2018-09-11 20:57:57 -07:00
Matt Clay
debc1e229e
Split Azure tests into 8 groups.
2018-08-30 23:21:57 -07:00
Matt Clay
5461bfbf31
Split sanity tests into 3 groups.
2018-08-27 13:43:11 -07:00
Matt Clay
4e489d1be8
Update Shippable integration test groups. ( #43118 )
...
* Update Shippable integration test groups.
* Update integration test group aliases.
* Rebalance AWS and Azure tests with extra group.
* Rebalance Windows tests with another group.
2018-07-23 20:46:22 -07:00
Matt Clay
1d0fd49a33
Rebalance cloud tests into 5 groups.
2018-02-10 00:37:20 -08:00
Matt Clay
1d419c737d
Run each Windows version independently in CI.
2018-02-09 16:38:27 -08:00
Matt Clay
abbc1ed4e6
Remove EOL openSUSE Leap 42.2 from CI.
2018-01-31 21:50:21 -08:00
Matt Clay
7abdab6c9e
Convert ansible-test compile into a sanity test.
2018-01-25 09:45:36 -08:00
Matt Clay
6969d492d8
Split Windows tests into 4 groups.
2018-01-12 00:48:32 -08:00
Matt Clay
30093dc4ed
Add Python 3.7 to CI unit test matrix. ( #34680 )
...
* Add Python 3.7 to CI unit test matrix.
* Fix `os.errno` reference to be `errno`.
* Update test_aci unit test for Python 3.7.
2018-01-10 00:57:11 -08:00
Matt Clay
6f77a32b13
Run RHEL tests on Azure in 3 groups.
2017-12-13 23:21:05 -08:00
Matt Clay
6988d32da2
Update FreeBSD versions used in CI.
2017-12-05 19:45:39 -08:00
Matt Clay
2ece86fba1
Split up cloud tests to avoid 1 hour CI limit.
2017-11-23 02:33:56 -08:00
Matt Clay
cf1337ca9a
Update ansible-test sanity command. ( #31958 )
...
* Use correct pip version in ansible-test.
* Add git fallback for validate-modules.
* Run sanity tests in a docker container.
* Use correct python version for sanity tests.
* Pin docker completion images and add default.
* Split pylint execution into multiple contexts.
* Only test .py files in use-argspec-type-path test.
* Accept identical python interpeter name or binary.
* Switch cloud tests to default container.
* Remove unused extras from pip install.
* Filter out empty pip commands.
* Don't force running of pip list.
* Support delegation for windows and network tests.
* Fix ansible-test python version usage.
* Fix ansible-test python version skipping.
* Use absolute path for log in ansible-test.
* Run vyos_command test on python 3.
* Fix windows/network instance persistence.
* Add `test/cache` dir to classification.
* Enable more python versions for network tests.
* Fix cs_router test.
2017-10-26 00:21:46 -07:00
Matt Clay
b44c38930b
Run OS X tests in 3 groups in CI.
2017-10-16 09:41:50 -07:00
Matt Clay
795d19bc78
Revert "Temporarily disable OS X in CI."
...
This reverts commit b26ae1809c
.
2017-10-03 23:03:58 -07:00
Matt Clay
b26ae1809c
Temporarily disable OS X in CI.
2017-10-03 14:58:16 -07:00
Matt Clay
5a91ed0a3b
Switch CI for OS X back to a single job. ( #31265 )
...
* Update Shippable scripts for group/non-group use.
* Switch CI for OS X back to a single job.
2017-10-03 14:37:05 -07:00
Matt Clay
72237b63e7
Run OS X and FreeBSD CI tests using groups. ( #31254 )
...
* Run OS X and FreeBSD CI tests using groups.
* Improve readability of Shippable jobs.
2017-10-03 12:43:46 -07:00
Matt Clay
c00ad0868e
Update Windows CI groups from 2 to 3.
2017-09-14 23:54:28 -07:00
Matt Clay
67c7bd8745
Revert "Temporarily disable failing opensuse test jobs."
...
This reverts commit 31d2eb0828
.
2017-09-07 11:47:53 -07:00
Matt Clay
31d2eb0828
Temporarily disable failing opensuse test jobs.
2017-09-06 10:03:01 -07:00
Matt Clay
52eb5032ba
Remove unnecessary pre_ci section.
2017-09-05 22:03:22 -07:00
Matt Clay
8f4c8844c4
Divide Windows integration tests into 2 groups. ( #29029 )
...
* Divide Windows integration tests into 2 groups.
* Support `none` for `--changed-all-target`.
* Run 2 separate Windows groups on Shippable.
* Only run smoketest and minimal for the group1 job.
2017-09-05 15:32:26 -07:00
Matt Clay
55fb18b85c
Split cloud tests into two CI groups.
2017-09-01 17:33:54 -07:00
Ganesh Nalawade
8a6e1531b7
Fix config timeout issue for network modules ( #28261 )
...
* Fix config timeout issue for network modules
* Re-enable network test
* Remove unwanted persistent connection timer
* Minor changes in description
2017-08-16 10:55:39 -04:00
Matt Clay
d2065cfc0d
Temporarily disable network tests.
2017-08-15 21:31:02 -07:00
Matt Clay
a8b7f2a7e2
Skip CI for default GitHub patch/revert branches.
...
The default naming convention for patch branches created in
the GitHub UI when editing files is: {username}-patch-{number}
The default naming convention for revert branches created in
the GitHub UI when reverting a PR is: revert-{pr_number}-{pr_branch_name}
This exclusion will prevent Shippable from running on these
branches until a PR is created.
2017-08-14 00:59:02 -07:00
Matt Clay
af9b0ba47b
Replace opensuse42.1 with opensuse42.3 in CI.
2017-08-05 12:56:31 -07:00
Matt Clay
9965435b56
Switch back to FreeBSD 11.0 for CI stability.
2017-08-02 22:24:40 -07:00
Matt Clay
c2f1dff997
Update remote OS versions tested in CI.
2017-08-02 13:28:23 -07:00
Matt Clay
7931e11437
Use subset of Windows tests for "all" tests. ( #26830 )
2017-07-14 16:51:32 -07:00
Matt Clay
4a013d6d69
Add RHEL 7.3 to ansible-test and CI. ( #26550 )
...
* Add support for RHEL to ansible-test.
* Enable RHEL 7.3 on Shippable.
2017-07-07 16:52:40 -07:00
Matt Clay
c4a2deda9d
Restore disabled opensuse integration tests.
2017-05-17 17:13:27 +08:00
John R Barker
e9e2d67035
Run vyos_command Network tests in Shippable ( #24514 )
...
* Run VyOS Network tests in Shippable
* net_command no longer exists
* network/ci
* Disable other network tests
* pep8 fix
* Fix PEP 8 issue.
2017-05-12 12:49:12 +01:00
Matt Clay
e56c418d9d
Temporarily disable opensuse on Shippable.
...
The tests are timing out on most CI runs now.
2017-05-12 18:32:00 +08:00
Matt Clay
17e07a27b2
Enable cloud tests for use with ansible-test.
2017-05-05 21:46:29 +08:00
Matt Clay
0587d59266
Use Shippable image: drydock/u16pytall:master ( #23997 )
...
* Use Shippable image: drydock/u16pytall:master
* Do not install python 3.6 on Shippable.
2017-04-26 15:04:28 +08:00
Matt Clay
9810429f5b
Remove Ubuntu 12.04 from Shippable CI.
...
Ubuntu 12.04 will be end-of-life before stable-2.4 is released.
2017-03-23 11:51:38 -07:00
Matt Clay
2804d2e848
Split up unit tests on Shippable. ( #21931 )
...
* Add more verbose output to coverage combine.
* Run unit tests on CI separately by version.
2017-02-24 16:58:56 -08:00
John R Barker
54e6c9472e
Disable Network integration tests ( #21273 )
...
This will disable the integration tests for all network platforms &
modules, though the unit tests will still run.
This is needed while a large refactor of the networking code is done.
2017-02-10 20:58:00 +00:00
Matt Clay
4e19adb919
Restore FreeBSD 11.0 tests for CI.
2017-02-08 17:01:17 -08:00
Matt Clay
085865cee8
Temporarily remove FreeBSD 11.0 from CI.
2017-01-27 10:31:12 -08:00
Matt Clay
25caa67d41
Disable pull of updated Shippable docker image.
...
This should improve reliability of our jobs on Shippable.
The Shippable AMIs should already have the latest docker image,
per Shippable support, so pull doesn't provide any benefit for us.
2017-01-19 11:43:07 -08:00
Matt Clay
82bf37fc53
Add docker image output to Shippable pre_ci.
2017-01-17 17:09:45 -08:00
Matt Clay
f534573dcf
Enable first network tests on Shippable. ( #20208 )
2017-01-12 18:23:53 -08:00
Matt Clay
a1d30c853c
Enable FreeBSD 11.0 for CI.
2017-01-04 15:47:29 -08:00
Robin Roth
9f2d22425b
Run tests on opensuse42.2
...
* add to shippable
* add to completion/readme
* Fixes #18645
2017-01-03 12:20:10 -08:00
Matt Clay
68346b128f
Update Fedora tests to use releases 24 and 25.
2017-01-03 11:12:32 -08:00
Matt Clay
6bbd92e422
Initial ansible-test implementation. ( #18556 )
2016-11-29 21:21:53 -08:00
Toshio Kuratomi
c5b4369ae7
Add PRIVILEGED to freebsd because testing of mount keys off of that. ( #17803 )
2016-09-28 23:33:28 -07:00
Toshio Kuratomi
4452ee86bd
Turn mount test back on ( #17797 )
...
* Turn mount test back on
* Mount tests need PRIVILEGED so turn that back on
Revert "Revert "Set PRIVILEGED=true for non_destructive tests. (#17733 )" (#17738 )"
This reverts commit dc0fb1c212
.
* Add a needs_privileged tag so that we can skip mount tests on centos6
Some containers timeout on shippable tests when run with privileged.
Unfortunately, some tests require that in order to run. Tagging those
allows us to skip those tests on the platforms that timeout when we get
ready to run the integration test in shippable.
* Centos6 times out with PRIVILEGED set so remove that (will disable the mount tests on centos6)
* Remove false start
2016-09-28 10:52:33 -07:00
Matt Clay
dc0fb1c212
Revert "Set PRIVILEGED=true for non_destructive tests. ( #17733 )" ( #17738 )
...
This reverts commit 1384270ccd
.
2016-09-23 23:42:59 -07:00
Matt Clay
1384270ccd
Set PRIVILEGED=true for non_destructive tests. ( #17733 )
...
This should allow test_mount tests to run on Shippable.
2016-09-23 14:09:46 -07:00
Matt Clay
c81fe70fbf
Enable more integration tests for python 3. ( #17473 )
...
* Enable more integration tests for python 3.
* Split out python 3 integration tests.
Now that we're running more integration tests on python 3, the
tests are taking long enough that they warrant splitting out in
the same way the python 2 tests are split.
2016-09-08 18:55:15 -07:00
Toshio Kuratomi
b8a8027b7d
We've decided that python-3.5 is the minimum python version ( #17270 )
2016-08-29 09:12:37 -07:00
Matt Clay
106b12b369
Enable Python 3 CI for Ubuntu 16.04 on Shippable. ( #17210 )
2016-08-23 23:49:02 -07:00
Matt Clay
a695e18615
Add support for OS X CI on Shippable. ( #17160 )
2016-08-23 10:49:46 -07:00
Matt Clay
e2602e9be0
Add FreeBSD to Shippable CI. ( #16883 )
2016-08-01 13:46:37 -07:00
Matt Clay
380ed053e8
Add Windows integration tests to Shippable. ( #16803 )
...
Enable Windows integration tests on Shippable.
2016-07-28 21:03:14 -07:00
Matt Clay
e04d552bc6
Run shippable tests in unprivileged containers. ( #16481 )
...
* Run shippable tests in unprivileged containers.
2016-06-28 12:51:15 -07:00
Matt Clay
91883fb6b9
Revert "Enable Shippable email notifications. ( #16429 )"
...
This reverts commit 5fdcc2f2b0
.
2016-06-24 08:10:22 -07:00
Matt Clay
5fdcc2f2b0
Enable Shippable email notifications. ( #16429 )
2016-06-23 23:04:00 -07:00
Matt Clay
ca3aba72fc
Add Slack notifications for Shippable. ( #16428 )
2016-06-23 21:49:24 -07:00
Matt Clay
a4ceef28b8
Run slowest tests first to minimize run time.
2016-06-14 17:25:00 -07:00
Matt Clay
106dbb6441
Add IRC notifications to shippable.yml.
2016-06-04 15:51:46 -07:00
Matt Clay
6e1e86028f
Split integration tests into multiple groups.
...
This will allow tests to complete much faster.
2016-06-04 12:02:11 -07:00
Adrien Vergé
4d48711242
Fix YAML source and check it on Shippable ( #15678 )
...
Fix YAML source and check it on Shippable
2016-06-04 10:58:17 -07:00
Matt Clay
6d74f43eff
Update how shippable scripts are called.
2016-06-03 09:20:33 -07:00
Matt Clay
b0e1efbd62
Add full support for Shippable CI.
2016-06-01 22:33:38 -07:00
Matt Clay
0e8930640a
Add support for shippable.com CI tests.
...
This will allow offloading sanity tests from Travis to Shippable.
2016-05-20 14:12:42 -07:00