Commit graph

596 commits

Author SHA1 Message Date
Toshio Kuratomi
90673cf6db Refactor stat.py so that it would be more friendly for unittests. (#4462)
* Refactor stat.py so that it would be more friendly for unittests.

* PEP8ify since we're moving most of the lines in the file and there's no open PRs
2016-08-18 13:16:06 -07:00
Chris Short
013e91e9b0 find.py: Editing contains description to say regex (#4452)
find module contains argument appears to accept regex; correcting description accordingly
2016-08-17 11:53:05 -04:00
Lucas Costa Beyeler
5559e6a669 Fix #4202: Can't unarchive remote files (#4244)
When you try to remote unarchive files with the option copy=no the code always fail, as evidenced in issue #4202. That happens because the conditional to check "if remote_src=no or copy=yes" will always be true since the default value of them is remote_src=no and copy=yes.
My modification is only to change the condition from or to and, that way only if both the vars stay with the default value will be true, otherwise you can unarchive remote files.
2016-08-11 11:23:29 -07:00
Dag Wieers
4fddb21980 Improve the documentation (#4385)
Improvements to make it more clear that pure compressed files (.gz, .bz2 and .xz) files are not supported.

This improves on #3241.
2016-08-11 08:53:37 -04:00
Sam Doran
06e9dc5236 Improve regexp for matching file permissions (#4306)
A capital "S" appears when the the setuid or setgid bit are set but have no effect. Likewise, a capital "T" appears when the sticky bit is set but it has no effect.
2016-08-10 23:54:29 +02:00
Brian Coca
9dde201d87 unsafe writes! (#4314)
* unsafe writes!

* moved unsafe_write docs and args to file common

* added unsafe_writes option handling
2016-08-09 12:39:25 -04:00
Toshio Kuratomi
5d7b46e0dd Be explicit about specifying the ssh port if it was user specified (#4302)
Previously, if the port specified by the user or inventory was 22, then
the ssh client port would be used instead.

Fixes #3895
2016-08-08 08:59:25 -07:00
peter.jang
caaa8e282e fix for rsync protocol (#4211) 2016-08-02 14:34:41 -04:00
David Chwalisz
afff84321d file module: add clarification on state=absent re files that do not exist. 2016-08-01 15:16:52 -04:00
Brian Coca
7de287237f stop trying to set permissions in check mode
fixes #4195
2016-07-15 11:43:05 -04:00
Ryan S. Brown
3a04ec5a70 Indent unarchive module documentation to fix parsing error. 2016-07-14 14:05:00 -04:00
James Cammarata
bfeab3ae1a Merge branch 'feature_10218' into devel 2016-07-14 12:14:54 -05:00
tobixx
3139b90f7e added read-/write-/executeable flags for invoking user (#4130) 2016-07-14 19:11:35 +02:00
James Cammarata
467516e5da Add remote_src param for unarchive to deprecate copy param
From ansible/ansible#10218
2016-07-14 11:24:23 -05:00
Dag Wieers
37b7708c5d Fix a problem where the newly provided mode is a string (#3769)
* Fix a problem where the newly provided mode is a string

This fixes #3597

* Implement python3-compatible get_exception() handling
2016-07-06 15:16:51 -07:00
Dag Wieers
b66bf8e7a4 Revert PR #3575 since it causes problems related to exclude patterns (#3767)
* Revert PR #3575 since it causes problems related to exclude patterns

By using a different method for getting archive filelists, and extracting we introduced new problems related to excluding based on gtar patterns.

As a result files that would be excluded by gtar, would still be in the filelist. Implementing our own gtar compatible pattern exclusion mechanism is near to impossible (believe me, we looked at it...). The best way is to look at the original problem and deal with that, and ensure that extraction and filelists are done with the exact same tool and exact same options.

The solution is to decode the octal unicode representation in gtar's output back to unicode. Since gtar has no problem extracting these files in LANG=C, we simply has to compensate for it.

This reverts #3575 and fixes #11348.

* Implement codecs.escape_decode() instead of decode("string_escape") for python3
2016-07-06 14:40:48 -07:00
Lukas Grossar
49bf8de27c also match on tabs in ini_file (fixes #106) (#4067)
also match on tabs in ini_file
2016-06-30 18:15:49 -04:00
Toshio Kuratomi
41adb78cab A few more sanity checks for detecting unzip output that's not a file entry (#3982)
* A few more sanity checks for detecting unzip output that's not a file entry

Also note that there's a rounding error somewhere in the mtime
comparison code.

* Fix reference to sub-array
2016-06-27 13:18:12 -07:00
Keisuke Kamada
74864c2d85 Do not copy file if running on check mode 2016-06-17 02:19:52 +09:00
Brian Coca
949916a155 restored incorrectly removed docs, jinja2 override 2016-06-15 17:01:46 -04:00
neo
606598a857 fix unarchive doesn't extract changed tar file #3901 2016-06-10 17:35:08 -04:00
Matt Fischer
1f5335d5e0 Update delete notes for Synrhconize docs (#3723)
The example for delete=yes does not specify recursive although it is
required. In addition, the wording for the delete option is confusing
about from where files are really deleted. This should clarify that.
2016-06-10 15:11:24 -04:00
Dag Wieers
3f7a935932 Improve the unzip output scraping (#3819)
* Improve the unzip output scraping

Ensure we capture the complete file (also when it includes spaces).
Drop lines that do not conform (in length) to what we expect (e.g. header/footer).

This fixes #3813

* Fix how split() works
2016-06-10 11:05:22 -04:00
Brendan Jurd
6448204271 Fix grammar in docs for fetch 'fail_on_missing' (#3872) 2016-06-06 15:27:18 -04:00
Brian Coca
b8598748bc Revert "Add prefixing and suffixing fuctionality to assemble"
This reverts commit 4c386dba56.
keeping in sync with main repo revert
2016-06-01 15:10:08 -04:00
Matthias Frey
d3a9a90d2d Fixed error in assemble module when validation failed. (#3814)
Error was: TypeError: fail_json() takes exactly 1 argument (2 given)
2016-06-01 09:19:58 -04:00
Chris Houseknecht
ca4365b644 Merge pull request #901 from underyx/assemble-with-prefix-and-suffix
Add prefixing and suffixing fuctionality to assemble module
2016-05-31 18:15:57 -04:00
Bence Nagy
4c386dba56 Add prefixing and suffixing fuctionality to assemble 2016-05-31 14:47:20 -07:00
Jan Fader
7c08f10900 fix for #3706 (#3778) 2016-05-29 06:52:18 -07:00
Dag Wieers
9f973aefb1 Add unpack results to error output, for debugging purposes on failure
This may help understand what is going on with #3631
2016-05-26 18:43:22 -07:00
Toshio Kuratomi
ca4140134d Python2.4's zipfile library cannot handle zip 64bit extensions which are needed for > 64K files (#3754)
Fallback to unzip if zipfile fails and hope that unzip can deal with it
(sites have an easier time upgrading the unzip utility than all of
python).

https://bugs.python.org/issue3997

Fixes #3560
2016-05-26 16:40:50 -07:00
Marcos Diez
9e197a5f78 The documentation of lineinfile now makes reference to blockinfile (#3639) 2016-05-24 14:49:09 +02:00
Michael Scherer
69ea617093 Convert the whole files/ directory to py3 syntax (#3685) 2016-05-18 07:01:53 -07:00
Michael Scherer
de6cdeeba6 Testing the module on freebsd fail, since module is not assigned yet 2016-05-17 00:22:08 +02:00
Michael Scherer
2449267d42 Fix the argument for acl module (#3653) 2016-05-16 14:00:15 -04:00
Dag Wieers
83a3c45a7d Fix small typo (#3642) 2016-05-13 13:10:35 -04:00
Veaceslav Mindru
430e3eeebd add vlidate_certs option for unarchive module (#2635) 2016-05-05 11:25:40 +02:00
Toshio Kuratomi
4a8a292793 bytearray isn't available in python2.4 (#3583)
* Detection of handler depends on the wrong handler failing to list the contents of the tarfile.

Use explicit compression types with the python tarfile library to
achieve that.

* bytearray isn't available in python2.4
2016-05-02 11:29:04 -07:00
Toshio Kuratomi
0ec3b06208 Detection of handler depends on the wrong handler failing to list the contents of the tarfile. (#3584)
Use explicit compression types with the python tarfile library to
achieve that.
2016-05-02 11:27:44 -07:00
Virgil Dupras
82aeaed45d unarchive: use Python's tarfile module for tar listing (#3575)
* unarchive: use Python's tarfile module for tar listing

fixes https://github.com/ansible/ansible/issues/11348

Depending on the current active locale, `tar`'s file listing can end up
spitting backslash-escaped characters. Unfortunately, when that happens,
we end up with double-escaped backslashes, giving us a wrong path,
making our action fail.

We could try un-double-escaping our paths, but that would be complicated
and, I think, error-prone. The easiest way forward seemed to simply use
the `tarfile` module.

Why use it only for listing? Because the `unarchive` option also
supports the `extra_opts` option, and that supporting this would require
us to mimick `tar`'s interface.

For listing files, however, I don't think that the loss of `extra_opts`
support causes problems (well, I hope so).

* unarchive: re-add xz decompression support

Following previous change to use Python's `tarfile` module for tar file
listing, we lost `xz` decompression support. This commits re-add it by
adding a special case in `TarXzArchive` that pre-decompresses the source
file.
2016-05-01 17:34:43 -07:00
Dag Wieers
b11f4a51d1 Replace ansible_hostname with inventory_hostname (#3559)
This way these examples can be re-used using the ansible command (and don't require facts gathering).
2016-04-27 11:31:04 -04:00
Michael Scherer
0300b2add1 Remove old test on SELinux (#3510)
since all is done in modules_utils/basic.py, no need to make
the same test here, especially since that's unused later
2016-04-21 10:44:11 -04:00
Dag Wieers
983cdd00bc Making unarchive idempotent (#3307)
* WIP: Making unarchive idempotent

Currently unarchive is not idempotent and has many rough edges and bugs.
The current release is a workable improvement on many fronts:

- zip support is now idempotent (but gtar lacks check-mode)
- New option `exclude` to exclude specific paths/files
- New option `keep_newer` to exclude newer files on target
- New option `extra_opts` to influence unzip/gtar (like synchronize module)

The following items are still ongoing:

- Implement CRC32 support for .zip files
- Re-implement the zip support using native zipfile module
- Re-implement the gtar support using native tarfile/gzip/bz2 modules (lzma external)
- Implement check-mode (works in gzip, but fails using gtar)
- Implement diff-mode (discuss an appropriate output model, like synchronize module)

The re-implementation of unzip/gtar support using native python modules will not only simplify the codebase, additional functionality can be implemented correctly and identically, which is currently not possible. (Other archives could be implemented using native modules equally, incl. options)

* Assorted fixes to zip support (during quality checks)

- Support both rw---- and rwx--- permstr
- Better file type support (more qa needed)
- Symlink support
- Include fix from #3229

* Implement zip diff-mode (itemized change) and avoid changes permissions every time (!)

This commit implements:
- rsync-compatible itemized-change output in diff-mode (using zip)
- no longer changing permissions unconditionally (when idempotent)

* Small fixes to itemized change output

* Fixes to user/group ownership changes

- The implementation of user/group ownership is a bit more complex for idempotency
- We report when a ZIP file incorrectly tags a directory as a file/link
- We only offer diff output when there is a change

* Fix the handling of includes and excludes for unzip

* Remove test output from output (confuses easily)

* Logic and performance improvements to ownership handling, and umask fix

* Handle special files (type '?')

* Make exceptions compatible with python 2.4

* Implement CRC32 support

* Revert some unintended/unknown changes ?

* Taking over maintenance as offered by current maintainer

* Fix support for white-spaces in filenames

* Remove/rename incorrect regex

* Ensure that fat executables end up with execute permission

* Remove check_result from output when unchanged

* When unarchiving as a user, or when owner/group/mode is supplied --diff is insufficient

Only way to be sure is to check request with what is on disk (as we do for zip).
Leave this up to set_fs_attributes_if_different() instead of inducing a (false) change

* By default, don't send confusing check_results in verbose output

This fixes #74.
2016-04-18 16:31:06 -04:00
yarick123
bf2f09e37c ini_file: added option 'noextraspaces' to turn off inserting extra spaces around '=' symbol
* ini_file: added option 'noextraspaces' to turn off inserting extra spaces around '=' symbol

* ini_file: noextraspaces, python 2.4 compatibility

* ini_file: noextraspaces - yes/no => true/false

* ini_file: noextraspaces - added 'version_added' option

* ini_file: noextraspaces => no_extra_spaces
2016-04-13 15:50:44 +02:00
Mengdi Gao
4ff5218903 Improve doc accuracy of template module 2016-04-13 10:04:06 +08:00
peter.jang
c52f475c64 added rsync protocol support (#1999)
* added rsync protocol support

* correction for example document(add example for push on delegate)

* use startswith method for safety
2016-04-08 11:41:53 -04:00
Brian Coca
a268e5a119 Merge pull request #2647 from bertvv/issue_2498
Also show stdout when validation fails. This fixes #2498
2016-03-17 08:49:39 -07:00
Brian Coca
c86a0ef84a fixed exit json 2016-03-09 15:42:30 -05:00
Matt Martz
07f29ecd7f Fix synchronize docs to indicate the correct default for use_ssh_args 2016-03-09 11:12:21 -06:00
Toshio Kuratomi
80543ee6f8 Merge pull request #3197 from dagwieers/unarchive-download-error-fix
unarchive: Ensure that download failure is properly raised before read fails
2016-03-08 12:23:53 -08:00