maxmustermann/minio
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
8867 commits 18 branches 277 tags 146 MiB
Commit graph

1088 commits

Author SHA1 Message Date
Romain Bouyé 447fdd4097 docs: Fix typo in docs/config/README.md (#4009) 2017-03-30 11:09:15 -07:00
Aditya Manthramurthy 61b08137b0 Add access format support for Redis notification target (#3989) 
This change adds `access` format support for notifications to a Redis
server, and it refactors `namespace` format support.

In the case of `access` format, a list is used to store Minio
operations in Redis. Each entry in the list is a JSON encoded list of
two items - the first is the Minio server timestamp of the event, and
the second is an object describing the operation that created/replaced
the object in the server.

In the case of `namespace` format, a hash is used. Entries in the hash
may be updated or removed if objects in Minio are updated or deleted
respectively. The field values in the Redis hash are JSON encoded.

Also updates documentation on Redis notification target usage.

Towards resolving #3928
 2017-03-29 08:55:53 -07:00
Nitish Tiwari d99efa2c93 Update filename (#3995) 2017-03-28 23:14:28 -07:00
Nitish Tiwari a8cb43926a Docker guide fix (#3992) 
* Update Docker quick start guide

- Add Compose to orchestration section.

- Refer Swarm from Docker quick start guide.

- Add common Docker commands to quick start guide.

* Paragraph cleanup
 2017-03-28 13:54:19 -07:00
Nitish Tiwari a9c0f1e0a4 Added kernel tuning docs (#3921) 2017-03-27 11:29:04 -07:00
Aditya Manthramurthy a099319e66 Support access format for database notification targets (#3953) 
* Add configuration parameter "format" for db targets and perform
  configuration migration.
* Add PostgreSQL `access` format: This causes Minio to append all events
  to the configured table. Prefix, suffix and event filters continue
  to be supported for this mode too.
* Update documentation for PostgreSQL notification target.
* Add MySQL `access` format: It is very similar to the same format for
  PostgreSQL.
* Update MySQL notification documentation.
 2017-03-27 11:27:25 -07:00
Harshavardhana a4ecd8bca2 docs: Add config directory documentation/guide. (#3889) 2017-03-25 02:34:04 -07:00
koolhead17 80b83a51a3 Docs: Fix for Self signed certificate. (#3957) 2017-03-23 08:20:39 -07:00
Pawan Rawal 1396e91dd1 Update link for downloading minio server. (#3934) 
This and the link for downloading Minio server at other places in the docs seems to be broken. I suppose this happened while updating the name of the page (which updated the url) in Doctor docs. 
Might be nice for Doctor to update internal links if the name of a page is changed in a background job.
 2017-03-19 18:26:23 -07:00
Aditya Manthramurthy 2463ae243a Add support for MySQL notifications (fixes #3818) (#3907) 
As a new configuration parameter is added, configuration version is
bumped up from 14 to 15.

The MySQL target's behaviour is identical to the PostgreSQL: rows are
deleted from the MySQL table on delete-object events, and are
created/updated on create/over-write events.
 2017-03-17 09:29:17 -07:00
Nitish Tiwari d4eea224d4 Remove white spaces (#3922) 2017-03-17 09:23:22 -07:00
Nitish Tiwari e55421ebdd Fixed Docker compose link (#3920) 2017-03-17 01:06:11 -07:00
Dee Koder 0a5d57a91e docs: Update gateway doc with roadmap section. (#3918) 2017-03-16 18:25:01 -07:00
Krishna Srinivas cea4cfa3a8 Implement S3 Gateway to third party cloud storage providers. (#3756) 
Currently supported backend is Azure Blob Storage.

```
export MINIO_ACCESS_KEY=azureaccountname
export MINIO_SECRET_KEY=azureaccountkey
minio gateway azure
```
 2017-03-16 12:21:58 -07:00
Nitish Tiwari ba0c11757e Added that no special config changes reqd (#3906) 
Added a line saying no special config changes are required for Shared mode. Also the previous `Why Shared Backend` and current `Use cases` are already merged. This fixes the comment: https://github.com/minio/minio/pull/3888#discussion_r105573494
 2017-03-15 08:22:03 -07:00
Nitish Tiwari 3314501f19 Simplify shared mode document (#3888) 2017-03-12 16:17:03 -07:00
Harshavardhana 9d53a646a1 Simplify the title for orchestration and some words. (#3887) 2017-03-11 02:17:03 -08:00
Nitish Tiwari 5e0032e165 Update links (#3886) 2017-03-11 00:11:07 -08:00
Nitish Tiwari 2410eb281e Update kafkacat command with consumer flag (#3882) 2017-03-10 09:01:59 -08:00
Nitish Tiwari 03937e7554 Added documentation for orchestration platforms (#3684) 2017-03-09 14:06:51 -08:00
Nitish Tiwari d8950ba7c5 Added server times note and fix Notes rendering for Doctor. (#3787) 2017-02-22 02:12:03 -08:00
Nitish Tiwari 097dd7418a Remove unused erasure diagram (#3783) 2017-02-20 21:01:08 -08:00
Nitish Tiwari a7d3ea8c15 Update erasure code image (#3782) 2017-02-20 20:12:21 -08:00
Anis Elleuch 70d825c608 doc: Small rewrite of bucket events notif intro (#3775) 2017-02-20 12:07:27 -08:00
Harshavardhana 8816b08aae Fix the systemd config path to the new URL 2017-02-15 21:28:06 -08:00
Dee Koder c6e76160ad Update README.md 2017-02-14 14:20:29 -08:00
Nitish Tiwari 8f66cfa316 Fix https://github.com/minio/minio/issues/3453 (#3733) 2017-02-10 22:53:17 -08:00
Harshavardhana 9df01035da Remove XL references in public docs to Erasure. (#3725) 
Ref #3722
 2017-02-09 23:26:44 -08:00
Nitish Tiwari 0c7694894b Added spaces for formatting (#3717) 2017-02-08 00:51:08 -08:00
Nitish Tiwari 7547f3c8a3 Added Webhook notification details (#3706) 2017-02-07 23:19:32 -08:00
Harshavardhana 6717a0b68c Add consistency guarantees 2017-02-05 18:31:48 -08:00
Krishnan Parthasarathi 0472e5c1e1 Change query param name to duration in list/clear locks API (#3664) 
Following is a sample list lock API request schematic,

  /?lock&bucket=mybucket&prefix=myprefix&duration=holdDuration
  x-minio-operation: list

The response would contain the list of locks held on mybucket matching
myprefix for a duration longer than holdDuration.
 2017-02-01 11:17:30 -08:00
Harshavardhana a9ab01731f docs: Remove reference word from notification title 2017-01-31 18:17:31 -08:00
Harshavardhana cd80e6df29 docs: Move the notifications into docs/bucket 
Cleanup some formatting issues.
 2017-01-31 18:07:39 -08:00
koolhead17 4dea4f3b89 docs: added event-notification back end doc. (#3510) 2017-01-31 17:04:36 -08:00
Harshavardhana 77a192a7b5 Implement CopyObjectPart API (#3663) 
This API is implemented to allow copying data from an
existing source object to an ongoing multipart operation

http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadUploadPartCopy.html

Fixes #3662
 2017-01-31 09:38:34 -08:00
Krishnan Parthasarathi b408d0e87d Add aws:Referer condition key support. (#3641) 
This change implements bucket policy enhancements required to restrict access based on HTTP referer.
See https://docs.aws.amazon.com/AmazonS3/latest/dev/example-bucket-policies.html#example-bucket-policies-use-case-4 for more information.

Fixes #3540
 2017-01-29 19:45:11 -08:00
Nitish Tiwari 69b81af93e Fix Minio quick start guide URL (#3655) 2017-01-29 07:21:30 -08:00
Harshavardhana cf558ff6d1 docs: Fix TLS doc to be docs.minio.io compatible 2017-01-28 22:46:29 -08:00
Harshavardhana 5af7bd6a01 docs: Fix a typo in TLS doc description 2017-01-28 22:41:52 -08:00
Harshavardhana 73f4f29110 docs: Restructure docs, move the files to their relevant location. (#3648) 
Also combines windows TLS docs with single doc with Linux.
 2017-01-28 19:45:30 -08:00
Anis Elleuch d1d89116f1 admin: Add version to service Status API response (#3605) 
Add server's version field to service status API:

"version":{
	"version":"DEVELOPMENT.GOGET",
	"commitID":"DEVELOPMENT.GOGET"
}
 2017-01-23 08:56:06 -08:00
Anis Elleuch 0715032598 heal: Add ListBucketsHeal object API (#3563) 
ListBucketsHeal will list which buckets that need to be healed:
  * ListBucketsHeal() (buckets []BucketInfo, err error)
 2017-01-19 09:34:18 -08:00
Anis Elleuch f803bb4b3d admin: Add service Set Credentials API (#3580) 2017-01-17 14:25:59 -08:00
Harshavardhana 1c699d8d3f fs: Re-implement object layer to remember the fd (#3509) 
This patch re-writes FS backend to support shared backend sharing locks for safe concurrent access across multiple servers.
 2017-01-16 17:05:00 -08:00
Harshavardhana a054c73e22 Add slack replace gitter (#3584) 2017-01-16 15:26:26 -08:00
Harshavardhana a091fe3ed6 docs: Fix caching docs to comply with current features. 2017-01-08 11:17:02 -08:00
koolhead17 f37f56ac15 docs: Added guide for distributed minio on Windows (#3507) 2017-01-07 18:35:12 -08:00
Krishnan Parthasarathi c8f57133a4 Implement list, clear locks REST API w/ pkg/madmin support (#3491) 
* Filter lock info based on bucket, prefix and time since lock was held
* Implement list and clear locks REST API
* madmin: Add list and clear locks API
* locks: Clear locks matching bucket, prefix, relTime.
* Gather lock information across nodes for both list and clear locks admin REST API.
* docs: Add lock API to management APIs
 2017-01-03 23:39:22 -08:00
koolhead17 cdc6c2d578 docs: Removed unmaintained docs. (#3493) 
* docs: Removed unmaintained docs.

* docs: removed associated screenshots with the older docs.
 2016-12-23 22:06:01 -08:00
Harshavardhana 4309727354 docs: Add docs for minio limitations. (#3477) 2016-12-20 14:42:13 -08:00
Krishnan Parthasarathi b2f920a868 Add service API handler stubs for status, stop and restart (#3417) 2016-12-15 22:26:15 -08:00
dcharbonnier 5c481fbf6e Fix Minio Quickstart Guide link (#3457) 2016-12-15 11:59:16 -08:00
koolhead17 d9fd6f9a96 docs: Removed $/# from code block to make code copy easier. (#3448) 2016-12-14 17:45:47 -08:00
koolhead17 f3b346cbb3 docs: removed the Edge tag reference. (#3366) 2016-12-02 10:47:18 -08:00
Anand Babu (AB) Periasamy bc9509bc8a edits on Limits 2016-11-30 01:58:31 -08:00
koolhead17 694bad434c docs: Modified the Docker doc to reflect distributed release image & (#3362) 
modification.
 2016-11-28 12:45:35 -08:00
Remco Verhoef 752ed7915b Add windows services docs with nssm instead of sc. 2016-11-24 16:53:10 -08:00
Aditya Manthramurthy a822b8e782 docs: Fix command sample to be copy-pastable (#3345) 2016-11-24 11:38:19 -08:00
Harshavardhana a6922f94ee docs: Fix more formatting issues. 2016-11-23 20:25:05 -08:00
Harshavardhana b4d57bf4c4 docs: Fix some formatting issues for rendering 2016-11-23 20:20:12 -08:00
Nitish Tiwari 4ef2d8940c Rename quick-start-guide.md to README.md (#3344) 2016-11-23 20:04:29 -08:00
Nitish Tiwari 96099a1e97 Added distributed Minio architecture images and quick start guide (#3342) 2016-11-23 19:30:23 -08:00
Nitish Tiwari 1983925dcf Added distributed Minio architecture files. (#3330) 2016-11-23 11:36:52 -08:00
koolhead17 11faf3f16d docs: Modified FreeBSD guide with official how to install golang link, (#3293) 2016-11-23 02:35:19 -08:00
Remco Verhoef d3df6c711a How to run Minio as a service on Windows (#3327) 2016-11-23 02:27:54 -08:00
Krishnan Parthasarathi 81eb7c0301 Have separate directory names for docker-compose and Dockerfile (#3292) 2016-11-19 10:42:22 -08:00
Anis Elleuch 4a926d19a7 Add GnuTLS config documentation for Windows (#3285) 2016-11-18 12:03:23 -08:00
Harshavardhana 1b85302161 Fix spelling and golint errors. (#3266) 
Fixes #3263
 2016-11-15 18:14:23 -08:00
Anis Elleuch 6512d9978e Add support of user self signed certificates 
Additionally add documentation about how to configure TLS with Minio
 2016-11-15 16:15:23 -08:00
koolhead17 3bcf7b7593 Docs: Modified Docker instruction adding distributed image tag. (#3250) 2016-11-13 13:40:56 -08:00
Harshavardhana 716316f711 Reduce number of envs and options from command line. (#3230) 
Ref #3229

After review with @abperiasamy we decided to remove all the unnecessary options

- MINIO_BROWSER (Implemented as a security feature but now deemed obsolete
  since even if blocking access to MINIO_BROWSER, s3 API port is open)
- MINIO_CACHE_EXPIRY (Defaults to 72h)
- MINIO_MAXCONN (No one used this option and we don't test this)
- MINIO_ENABLE_FSMETA (Enable FSMETA all the time)

Remove --ignore-disks option - this option was implemented when XL layer
 would initialize the backend disks and heal them automatically to disallow
 XL accidentally using the root partition itself this option was introduced.

This behavior has been changed XL no longer automatically initializes
`format.json`  a HEAL is controlled activity, so ignore-disks is not
useful anymore. This change also addresses the problems of our documentation
going forward and keeps things simple. This patch brings in reduction of
options and defaulting them to a valid known inputs.  This patch also
serves as a guideline of limiting many ways to do the same thing.
 2016-11-11 16:40:55 -08:00
Harshavardhana 2f7fb78692 rpc: Our rpcClient should make an attempt to reconnect. (#3221) 
rpcClient should attempt a reconnect if the call fails
with 'rpc.ErrShutdown' this is needed since at times when
the servers are taken down and brought back up.

The hijacked connection from net.Dial is usually closed.

So upon first attempt rpcClient might falsely indicate that
disk to be down, to avoid this state make another dial attempt
to really fail.

Fixes #3206
Fixes #3205
 2016-11-10 07:44:41 -08:00
Harshavardhana 2f373684f5 Fix the server startup messages and help text. (#3211) 2016-11-09 23:37:12 -08:00
koolhead17 4503491a0a docs:Browser/added storageInfo content to the doc. (#3146) 2016-11-03 01:58:55 -07:00
koolhead17 f024deb1f8 docs: Fixed path for docker compose (#3156) 2016-11-02 08:54:20 -07:00
Harshavardhana 490159ea89 docker: Move the docker document and compose to a separate dir. (#3135) 2016-10-31 02:08:16 -07:00
Harshavardhana 5e86352464 doc: Fix docker.md instructions and words. 2016-10-13 21:34:03 -07:00
Harshavardhana 92858c7db2 Fix docker documentation. 2016-10-12 18:31:23 -07:00
Harshavardhana fdaa129a5b Fix dockerfile container image. (#2892) 2016-10-12 18:09:08 -07:00
Krishna Srinivas c6d2967b84 Doc: Document list of supported environmental varaibles. (#2864) 
fixes #2773
 2016-10-06 09:30:08 -07:00
Aditya Manthramurthy a1f922315b Add docker-compose file to run Minio in distributed mode (#2606) 
Serves as a starting point to run a Minio cluster using Docker. The
file can be used as configuration for the docker-compose tool to start
4 Minio servers in distributed mode.

* Add a docker-compose.yml file to run 4 minio server instances in
  distributed mode

* Update Docker.md with command to use the file
 2016-09-13 21:18:30 -07:00
Anis Elleuch 5c4dbc966f Add Howto setup minio distributed with Docker 2016-09-13 21:18:30 -07:00
Harshavardhana bf62ba57cf docs: Update minimum drives in erasure docs. 2016-09-01 11:35:53 -07:00
Dee Koder 4722c94653 typo: Fix capitalization in heading. (#2529) 2016-08-22 12:01:21 -07:00
koolhead17 a3c509fd23 Doc: Modified examples in how-to-run-multiple-minio-server-instances-on-single-machine.md (#2497) 2016-08-19 16:09:21 -07:00
Harshavardhana 76d56c6ff2 typo: Fix typos across the codebase. (#2442) 2016-08-15 02:44:48 -07:00
Yurii Rashkovskii 7829ccea2c Routing key was misspelled as routine key (#2430) 2016-08-12 22:23:06 -07:00
koolhead17 0dc5662f9b Doc: Fixed screenshot path for modified docs. (#2390) 2016-08-09 15:04:44 -07:00
koolhead17 0c125f3596 Doc: This patch new guides with titles mentioned below (#2382) 2016-08-08 19:39:01 -07:00
GarimaKapoor a1f3bf57c7 Update README.md 2016-08-07 11:08:42 -07:00
GarimaKapoor 62c0612eac Update README.md 2016-08-05 11:35:03 -07:00
koolhead17 7d42d09da8 Doc: Replaced README & FreeBSD docs with updated minio server splash (#2298) 
screen.
 2016-07-26 15:46:41 -07:00
Harshavardhana f253dfc922 docs: Fix erasure code image embedding issue. 2016-07-26 00:09:57 -07:00
Harshavardhana 6c2fb19ed7 docs: Removed and purged uneeded docs. (#2273) 2016-07-24 03:32:45 -07:00
koolhead17 7e076577de Update Minio-erasure-code-quickStart-guide.md (#2269) 
Minor update to link the URL.
 2016-07-22 13:35:27 -07:00
koolhead17 a7b5b8e63f Doc: Modified the contents for Doctor. (#2262) 2016-07-21 14:58:16 -07:00
Dee Koder 2a972ef1fd images: Move screenshot for docs inside docs/screenshots directory. (#2248) 
* images: Move screenshot for docs inside docs/screenshots directory. Use optimized images.

* images: This fix optimizes the images for the Erasure Code Quick Start Guide
 2016-07-20 13:52:30 -07:00
Dee Koder f67c930731 doc: Fixed spacing with respect to code blocks. (#2241) 2016-07-19 19:08:43 -07:00
GarimaKapoor 3589a58179 Update Minio-erasure-code-quickStart-guide.md 2016-07-19 17:59:05 -07:00
Dee Koder 2e8360120d headings: We need to add a consistent heading for all docs. Adding Minio FreeBSD QuickStart Guide in the title. (#2233) 2016-07-19 14:56:34 -07:00
Dee Koder 02b191222c headings: Added standardized heading for this document. (#2234) 2016-07-19 14:56:20 -07:00
Dee Koder b699795901 docs: Remove additional headings. Added standard heading. Include numbering. (#2235) 2016-07-19 14:30:32 -07:00
Harshavardhana d0636d633d doc: Move FreeBSD.md to docs. 2016-07-15 16:09:01 -07:00
koolhead17 204ec2c6c0 doc:README.md/Updated to sync with docs.minio.io (#2210) 
* doc:README.md/Updated to sync with docs.minio.io

* doc:README.me/Modified the minio server output terminal to reflect new release changes.

* docs:README.md/Modified and changed location of other markdown files.
 2016-07-15 15:03:59 -07:00
Harshavardhana 623e0f9243 XL: listOnlineDisks should use modTime instead of version. (#2166) 
This change is needed to make reading from objects future proof
in-terms of handling online disks. Our current counter is not
based on affirmative knowledge and relies on arithmetic sequence
which can lead to bugs.

Using modTime simplifies the understanding of `xl.json` and future
tooling / debugging of the format.
 2016-07-12 15:20:31 -07:00
Harshavardhana c0c8a8430e XL/PutObject: Add single putObject and multipart caching. (#2115) 
- Additionally adds test cases as well for object cache.
- Adds auto-expiry with expiration and cleanup time interval.

Fixes #2080
Fixes #2091
 2016-07-08 20:34:27 -07:00
Harshavardhana 4db2b03312 XL: Rename objectN to part.N (#2019) 
Fixes #2015
 2016-06-27 21:42:33 -07:00
Harshavardhana e10934a88e bitrot: Start using blake2b algorithm and remove sha512 usage. (#1957) 
Fixes #1952
 2016-06-22 17:13:26 -07:00
Harshavardhana b2293c2bf4 XL: Rename, cleanup and add more comments. (#1769) 
- xl-v1-bucket.go - removes a whole bunch of code.
- {xl-v1,fs-v1}-metadata.go - add a lot of comments and rename functions
   appropriately.
 2016-05-28 15:15:53 -07:00
Harshavardhana ee6645f421 XL: Add additional PartNumber variable as part of xl.json (#1750) 
This is needed for verification of incoming parts and to
support variadic part uploads. Which should be sorted
properly.

Fixes #1740
 2016-05-28 15:15:53 -07:00
Harshavardhana 1e393c6c5b XL: Add new metadata for checksum. (#1743) 2016-05-28 15:15:53 -07:00
Krishna Srinivas 6d84e84b3c XL/mutltipart: fix partnumber to partname association. (#1739) 
Fixes #1738
 2016-05-28 15:15:53 -07:00
Harshavardhana 293d246f95 XL/FS: Rewrite in new format. 2016-05-28 15:15:53 -07:00
Harshavardhana 9472299308 logging: Log only for unhandled errors, remove all the debug logging. (#1652) 
This patch brings in the removal of debug logging altogether, instead
we bring in the functionality of being able to trace the errors properly
pointing back to the origination of the problem.

To enable tracing you need to enable "MINIO_TRACE" set to "1" or "true"
environment variable which would print back traces whenever there is an
error which is unhandled or at the handler layer.

By default this tracing is turned off and only user level logging is
provided.
 2016-05-16 14:31:28 -07:00
Harshavardhana 74c23a3544 docs: Move developer docs from top-level to its own directory. (#1642) 2016-05-14 02:47:16 -07:00
Harshavardhana c63bdf79fa Remove docs, minimal docs going to be at minio.io instead and rest amazon docs 2015-04-10 21:21:59 -07:00
Harshavardhana 2696d2f4e7 Add new error response 2015-02-16 20:44:25 -08:00
Harshavardhana f07ccb035d Reorg docs and cleanup 2015-02-13 19:06:47 -08:00
Harshavardhana bd56b6e571 Update docs 2015-02-13 15:26:26 -08:00
Harshavardhana 5a0a700a45 Write Error Responses documentation 2015-02-13 15:20:58 -08:00
Harshavardhana 0ac611e452 Update contributors document 2015-02-09 13:34:19 -08:00
Harshavardhana b12a493db8 Update Docs 2015-02-08 17:50:18 -08:00
Harshavardhana d036bf3a2a Restructure docs and move mkdocs.yml to top-level 2015-02-08 17:40:39 -08:00
Frederick F. Kautz IV d44e42f809 Removing xml header from response in docs 2015-02-04 16:40:02 -08:00
Frederick F. Kautz IV f1bf2cb5d7 Adding JSON Example for GET / 2015-02-04 14:04:41 -08:00
Frederick F. Kautz IV eded653fd2 Adding additional entry into bucket list in docs 2015-02-03 17:36:14 -08:00
Frederick F. Kautz IV 60551dffca Minor header update, renaming '/' to 'GET /' 2015-02-02 16:23:18 -08:00
Frederick F. Kautz IV a79a5c10e0 Adding mkdocs to gogenerate. 2015-02-02 16:14:55 -08:00
Frederick F. Kautz IV 9d4e7a50fc Adding minio api documentation 2015-02-02 15:41:21 -08:00
Frederick F. Kautz IV ba1b7f79ba Initial mkdocs configuration 2015-02-02 13:50:07 -08:00
Frederick F. Kautz IV 42f5b3dc1d Removing docs 2015-02-02 13:50:07 -08:00
Harshavardhana fcd768a88f Remove stale docs 2015-01-06 02:01:48 -08:00
Frederick F. Kautz IV ab97179323 Adding markdown manpages 2014-12-19 20:27:15 +13:00
Frederick F. Kautz IV e219c65c9d Command list 2014-12-19 09:27:58 +13:00
Frederick F. Kautz IV 338a8bcb4d Renaming documents 2014-12-18 09:36:04 +13:00
Frederick F. Kautz IV 9275afa173 Changing minios to minio 2014-11-07 22:23:52 -08:00
Harshavardhana 397b887a87 Initial commit 2014-10-30 21:51:52 -07:00