maxmustermann/minio
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
2937 commits 18 branches 277 tags 146 MiB
Commit graph

2937 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krishna Srinivas 39865c0d2e XL/Multipart: Fix list multipart output. (#1661) 
Fixes #1541
 2016-05-17 11:44:32 -07:00
Harshavardhana 1760687c83 XL: Make sure to create proper temporary files for renames to succeed. (#1654) 
Renames work in a special manner, temporary location files should
be created properly.

Fixes #1653
Fixes #1651
 2016-05-16 15:40:57 -07:00
Harshavardhana 9472299308 logging: Log only for unhandled errors, remove all the debug logging. (#1652) 
This patch brings in the removal of debug logging altogether, instead
we bring in the functionality of being able to trace the errors properly
pointing back to the origination of the problem.

To enable tracing you need to enable "MINIO_TRACE" set to "1" or "true"
environment variable which would print back traces whenever there is an
error which is unhandled or at the handler layer.

By default this tracing is turned off and only user level logging is
provided.
 2016-05-16 14:31:28 -07:00
Harshavardhana 8828fd1e5c vendor: Remove unused packages. 2016-05-15 00:04:56 -07:00
Harshavardhana 7de206cb85 XL: ListVols should provide consistent view. (#1648) 
Additionally get list of all volumes in parallel for aggregation
and quorum verification.

Fixes #1647
 2016-05-14 23:57:57 -07:00
Harshavardhana 498ce1e9bb handler: Add a waitgroup to avoid expect100Continue crash. (#1623) 
This waitgroup allows for safe blocking operation where we can cleanly
control the flow of the writes and the underlying pipe altogether.

Fixes #1553
 2016-05-14 17:18:00 -07:00
Harshavardhana 5b29cefd40 api: DeleteObject should always return 204. (#1645) 
Fixes #1643
 2016-05-14 15:47:19 -07:00
Hori Ryota e03ebfd13b Add default cmd (#1625) 2016-05-14 02:58:50 -07:00
Harshavardhana 74c23a3544 docs: Move developer docs from top-level to its own directory. (#1642) 2016-05-14 02:47:16 -07:00
Harshavardhana 025054fb36 XL: CreateFile/ReadFile should write and read from all disks in parallel. (#1612) 
* XL: CreateFile should write to all disks in parallel.

* XL: ReadFile should read from all disks in parallel.
 2016-05-14 01:57:04 -07:00
Bala FA 7264cd2ab3 Fix error message when wrong set of disks are passed (#1634) 
Previously when wrong set of disks are given with last minio server
run, it throws unclear error message.  This is fixed by returning
appropriate errors.

Fixes #1591
 2016-05-13 23:04:10 -07:00
Harshavardhana 0e4e9c4bc1 XL: ListDir should return each List from a random disk in the set. (#1613) 
Fixes #1609
 2016-05-13 18:12:26 -07:00
Krishna Srinivas 8099396ff0 xl/putObject: Should take care of the situation if an object already exists at the location. (#1606) 
Fixes  #1598 #1594 #1595
 2016-05-13 11:52:36 -07:00
Krishna Srinivas d267696110 Validation: Reject object names with trailing "/". (#1619) 
Fixes #1616
 2016-05-13 11:43:06 -07:00
Bala FA 43539a0c86 posix: parseDirents() should follow symlink and get values. (#1631) 
Previously parseDirents() ignores symbolic links.  This patch fixes
the issue by following the symlink using os.Stat().

Fixes #1545
 2016-05-13 11:39:48 -07:00
Krishnan Parthasarathi 9e45d138cc Closed readCloser for each multipart in xl.GetObject (#1629) 
* Closed readCloser for each multipart in xl.GetObject
 2016-05-13 04:50:13 -07:00
karthic rao ee8605e333 Make bucket failure fix with high concurrent load (#1630) 2016-05-13 04:03:38 -07:00
karthic rao e4958f9757 Removing regexp check and adding string based check, regexp check was unnecessary here (#1627) 2016-05-13 03:33:53 -07:00
Harshavardhana b62774d32f storage/xl: Return errVolumeAccessDenied if disks cannot be accessed. (#1621) 
Fixes #1614
 2016-05-12 21:01:11 -07:00
koolhead17 d6e0f3ab33 added awscli commands & minor typo fix. (#1578) 2016-05-12 16:35:11 -07:00
Bala FA 3ff0a56e62 XL: Ignore errDiskNotFound in certain situations (#1610) 
When a disk is removed while an operation is going on
(eg. single/multipart put object, list/multipart list objects etc),
its required to ignore errDiskNotFound error and continue the
operation.

Fixes #1552
 2016-05-11 23:42:14 -07:00
Harshavardhana 50431e91a6 erasure: Handle failed disks so that we initialize properly if they are missing. (#1607) 
Fixes #1592
Fixes #1579
 2016-05-11 18:58:32 -07:00
Harshavardhana d4745c7d6a object: PutObjectHandler should set the md5Sum properly. (#1604) 
Additionally add a test case as well for validating for us
to reply BadDigest properly.

Fixes #1603
 2016-05-11 16:13:37 -07:00
Bala FA adbcafefad xl/CreateFile: handle errFileNameTooLong error properly (#1523) 
When errFileNameTooLong error is returned from posix, xl.CreateFile()
treats the error specially by returning the same error immediately.

Fixes #1501
 2016-05-11 12:55:02 -07:00
Harshavardhana 86e5d71519 erasure: MakeVol, DeleteVol and StatVol should hold locks. (#1597) 
Since there is a good amount of overlap, each code has to lock
properly for the operation they are going to perform.

- MakeVol create vols in a routine on all disks, hold locks.
- DeleteVol delete vols in a routine on all disks, hold locks.
- StatVol stat vols in a routine on all disks, hold locks.

Fixes #1588
 2016-05-11 12:54:21 -07:00
Harshavardhana 72748d2073 erasure: healVolume err should be different from shadowed version. (#1590) 
Multiple go-routines updating the same shadowed variable can
cause a data race, avoid it by using its own err variable.

Fixes #1589
 2016-05-11 01:36:09 -07:00
Harshavardhana 49141eb3e4 http: Remove minhttp package and use standard Golang http. (#1587) 
The functionality provided by minhttp will be implemented
cleanly through our own APIs. Since we are not going to
send SIGUSR2 and manage configuration in that manner, it
doesn't make sense to use minhttp.

Fixes #1586
 2016-05-10 18:03:00 -07:00
Harshavardhana d1fa1d9352 Remove binary files from previous commit. 2016-05-10 15:49:17 -07:00
karthic rao 26e2c4bf4d Replacing fastsha256 with crypto/sha256 package from golang standard package (#1584) 2016-05-10 14:20:11 -07:00
Krishna Srinivas b044336329 XL/GetObject: If the offset does not fall in the first "dataBlock" it gives incorrect data. (#1583) 
Fixes #1582
 2016-05-10 11:38:49 -07:00
Krishna Srinivas e99cb05516 XL/GetObject: offset should be reset to 0 after reading first part. (#1580) (#1581) 2016-05-10 10:38:12 -07:00
Krishna Srinivas 409e09c1e5 XL/Selfheal: skip reading from disk if ReadFile had returned error. (#1575) 2016-05-10 01:24:58 -07:00
Krishna Srinivas c314a98c1a XL/list: fix panic on list when a disk is down. (#1562) 2016-05-10 00:35:29 -07:00
Harshavardhana 5f0ca64346 erasure: listOnlineDisks should return errFileNotFound for errReadQuorum. (#1573) 
Fixes #1571
 2016-05-10 00:10:34 -07:00
Harshavardhana 0db3218d5d xl: getPartsMetadata fetch parts and decode in go-routine. (#1569) 
Ref #1516
 2016-05-09 23:51:05 -07:00
Harshavardhana eec41c369c posix: Return diskNotFound error rather than errVolumeNotFound (#1568) 
Fixes #1559
 2016-05-09 18:57:39 -07:00
Harshavardhana b66c3bf35e server: Enable server profiling as needed. (#1565) 2016-05-09 16:18:56 -07:00
Harshavardhana f733120d3d xl: CompleteMultipartUpload make sure to delete uploads.json (#1539) 
Fixes #1537

Ref #1540 - for missing functionality in this patch.
 2016-05-09 12:09:48 -07:00
Krishna Srinivas 6627388dc3 posix: remove dead code related to posix reserved suffixes. (#1555) 2016-05-09 11:40:30 -07:00
Harshavardhana 9d41414fb5 posix: reserved files should be filtered out at posix not object layer. (#1554) 2016-05-09 02:53:08 -07:00
Harshavardhana 722abe2d0f xl/fs: pathJoin now takes variadic inputs. (#1550) 
Retains slash for the last element.

Fixes #1546
 2016-05-09 00:46:54 -07:00
Krishna Srinivas 04a5b25929 Multipart: Minimum part size limit does not apply to the last part during CompleteMultipartUpload. (#1518) (#1538) 2016-05-08 23:49:49 -07:00
Harshavardhana 90ea494338 erasure: waitCloser should implement CloseWithError. (#1543) 
This is needed so that the other end of the pipe receives
and error, cleanups temporary files.
 2016-05-08 16:26:10 -07:00
Harshavardhana a8fdd04e62 erasure: ReadFile should honor proper offsets. (#1542) 
Fixes #1535
 2016-05-08 15:39:24 -07:00
Harshavardhana 76c511c9fe api: Extend S3 errors with Minio errors. (#1533) 
Fixes #1530
 2016-05-08 12:36:16 -07:00
Krishna Srinivas 75320f70d0 multipart: reject part upload if size is less than 5MB. (#1518) 2016-05-08 12:06:05 -07:00
Krishna Srinivas 88e1c04259 XL/ListDir: break out of loop if list on one disk is a success. (#1534) 2016-05-08 12:05:19 -07:00
Krishna Srinivas a205aca6d2 init: Cleanup .minio/tmp directories recursively. Also takes care of cleaning up of parts directory during abortMultipartUpload. (#1532) 2016-05-08 10:15:34 -07:00
Harshavardhana 3f51dd4fd4 xl: CompleteMultipartUpload should rename files in a routine. (#1527) 
This solves the client timeout while renaming 9000+ parts.

Fixes #1526
 2016-05-08 02:38:35 -07:00
Harshavardhana 56b7df90e1 xl/fs: ListObjectParts should set nextPartNumberMarker properly. (#1528) 
For list requests on parts more than 1000, would lead to an infinite
loop.

Fixes #1522
 2016-05-08 02:21:12 -07:00