2015-10-16 20:26:01 +02:00
## Minio [![Gitter](https://badges.gitter.im/Join%20Chat.svg)](https://gitter.im/minio/minio?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)
2015-05-28 03:34:42 +02:00
2016-02-25 04:57:11 +01:00
Minio is an object storage server compatible with Amazon S3 and licensed under [Apache license 2.0 ](./LICENSE ).
2015-10-16 20:40:47 +02:00
## Description
2016-03-02 20:07:23 +01:00
Minio is an open source object storage server released under Apache License V2. It is compatible with Amazon S3 cloud storage service. Minio follows a minimalist design philosophy.
2016-04-07 05:54:06 +02:00
Minio is light enough to be bundled with the application stack. It sits on the side of NodeJS, Redis, MySQL and the likes. Unlike databases, Minio stores objects such as photos, videos, log files, backups, container / VM images and so on. Minio is best suited for storing blobs of information ranging from KBs to 5 TBs each. In a simplistic sense, it is like a FTP server with a simple get / put API over HTTP.
2015-05-28 03:34:42 +02:00
2016-02-15 21:45:02 +01:00
Minio currently implements two backends
2016-03-02 20:07:23 +01:00
- Filesystem (FS) - is available and ready for general purpose use. This version of the Minio binary is built using Filesystem storage backend for magnetic and solid state disks.
2016-02-15 21:45:02 +01:00
- ErasureCoded (XL) - is work in progress and not ready for general purpose use.
2015-07-14 20:58:37 +02:00
## Minio Client
2015-07-14 19:57:53 +02:00
2015-07-25 03:09:53 +02:00
[Minio Client (mc) ](https://github.com/minio/mc#minio-client-mc- ) provides a modern alternative to Unix commands like ``ls``, ``cat``, ``cp``, ``sync``, and ``diff``. It supports POSIX compatible filesystems and Amazon S3 compatible cloud storage systems. It is entirely written in Golang.
2015-07-14 19:57:53 +02:00
## Amazon S3 Compatible Client Libraries
- [Golang Library ](https://github.com/minio/minio-go )
- [Java Library ](https://github.com/minio/minio-java )
- [Nodejs Library ](https://github.com/minio/minio-js )
- [Python Library ](https://github.com/minio/minio-py )
2015-10-16 20:26:01 +02:00
- [.Net Library ](https://github.com/minio/minio-dotnet )
2015-10-16 20:56:53 +02:00
### Install [![Build Status](https://travis-ci.org/minio/minio.svg?branch=master)](https://travis-ci.org/minio/minio)[![Build status](https://ci.appveyor.com/api/projects/status/royh137dni8yevep/branch/master?svg=true)](https://ci.appveyor.com/project/harshavardhana/minio-qxbjq/branch/master)
2015-10-16 20:26:01 +02:00
2015-11-14 11:39:02 +01:00
#### GNU/Linux
Download ``minio`` for:
2015-12-13 22:57:47 +01:00
- ``64-bit Intel`` from https://dl.minio.io/server/minio/release/linux-amd64/minio
- ``32-bit Intel`` from https://dl.minio.io/server/minio/release/linux-386/minio
- ``32-bit ARM`` from https://dl.minio.io/server/minio/release/linux-arm/minio
2015-07-14 19:57:53 +02:00
2015-05-28 03:34:42 +02:00
~~~
2015-11-14 11:39:02 +01:00
$ chmod +x minio
2016-01-08 19:17:08 +01:00
$ ./minio --help
2015-11-14 11:39:02 +01:00
~~~
#### OS X
2015-12-13 22:57:47 +01:00
Download ``minio`` from https://dl.minio.io/server/minio/release/darwin-amd64/minio
2015-11-14 11:39:02 +01:00
~~~
$ chmod 755 minio
2016-01-08 19:17:08 +01:00
$ ./minio --help
2015-05-28 03:34:42 +02:00
~~~
2015-11-14 11:39:02 +01:00
#### Microsoft Windows
Download ``minio`` for:
2015-12-13 22:57:47 +01:00
- ``64-bit`` from https://dl.minio.io/server/minio/release/windows-amd64/minio.exe
- ``32-bit`` from https://dl.minio.io/server/minio/release/windows-386/minio.exe
2015-11-14 11:39:02 +01:00
~~~
2016-01-08 19:17:08 +01:00
C:\Users\Username\Downloads> minio.exe --help
2015-11-14 11:39:02 +01:00
~~~
2016-04-15 02:22:47 +02:00
#### FreeBSD
Download ``minio`` from https://dl.minio.io/server/minio/release/freebsd-amd64/minio
~~~
$ chmod 755 minio
$ ./minio --help
~~~
2016-04-26 19:17:02 +02:00
Read more here on [How to configure Minio on FreeBSD with ZFS backend. ](./FreeBSD.md )
2016-04-15 02:22:47 +02:00
2016-01-13 18:40:20 +01:00
#### Docker container
2015-12-05 01:26:09 +01:00
2016-01-13 18:40:20 +01:00
Download ``minio`` for docker.
2015-12-05 01:26:09 +01:00
~~~
$ docker pull minio/minio
~~~
Read more here on [How to configure data volume containers for Minio? ](./Docker.md )
2015-11-14 11:39:02 +01:00
#### Source
< blockquote >
2016-01-31 12:48:33 +01:00
NOTE: Source installation is intended for only developers and advanced users. For general use, please download official releases from https://minio.io/download.
2015-11-14 11:39:02 +01:00
< / blockquote >
If you do not have a working Golang environment, please follow [Install Golang ](./INSTALLGO.md ).
2016-01-31 12:48:33 +01:00
~~~
$ go get -d github.com/minio/minio
$ cd $GOPATH/src/github.com/minio/minio
$ make
~~~
2015-11-14 11:39:02 +01:00
2015-10-16 20:26:01 +02:00
### How to use Minio?
2015-09-18 00:16:28 +02:00
config: Migrate to the new version. Remove backend details.
Migrate to new config format v4.
```
{
"version": "4",
"credential": {
"accessKey": "WLGDGYAQYIGI833EV05A",
"secretKey": "BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF"
},
"region": "us-east-1",
"logger": {
"console": {
"enable": true,
"level": "fatal"
},
"file": {
"enable": false,
"fileName": "",
"level": "error"
},
"syslog": {
"enable": false,
"address": "",
"level": "debug"
}
}
}
```
This patch also updates [minio cli spec](./minio.md)
2016-04-02 04:19:44 +02:00
Start minio server.
2015-10-16 20:26:01 +02:00
2015-06-17 01:03:17 +02:00
~~~
config: Migrate to the new version. Remove backend details.
Migrate to new config format v4.
```
{
"version": "4",
"credential": {
"accessKey": "WLGDGYAQYIGI833EV05A",
"secretKey": "BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF"
},
"region": "us-east-1",
"logger": {
"console": {
"enable": true,
"level": "fatal"
},
"file": {
"enable": false,
"fileName": "",
"level": "error"
},
"syslog": {
"enable": false,
"address": "",
"level": "debug"
}
}
}
```
This patch also updates [minio cli spec](./minio.md)
2016-04-02 04:19:44 +02:00
$ minio server ~/Photos
config/main: Re-write config files - add to new config v3
- New config format.
```
{
"version": "3",
"address": ":9000",
"backend": {
"type": "fs",
"disk": "/path"
},
"credential": {
"accessKey": "WLGDGYAQYIGI833EV05A",
"secretKey": "BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF"
},
"region": "us-east-1",
"logger": {
"file": {
"enable": false,
"fileName": "",
"level": "error"
},
"syslog": {
"enable": false,
"address": "",
"level": "debug"
},
"console": {
"enable": true,
"level": "fatal"
}
}
}
```
New command lines in lieu of supporting XL.
Minio initialize filesystem backend.
~~~
$ minio init fs <path>
~~~
Minio initialize XL backend.
~~~
$ minio init xl <url1>...<url16>
~~~
For 'fs' backend it starts the server.
~~~
$ minio server
~~~
For 'xl' backend it waits for servers to join.
~~~
$ minio server
... [PROGRESS BAR] of servers connecting
~~~
Now on other servers execute 'join' and they connect.
~~~
....
minio join <url1> -- from <url2> && minio server
minio join <url1> -- from <url3> && minio server
...
...
minio join <url1> -- from <url16> && minio server
~~~
2016-02-13 00:27:10 +01:00
2016-01-31 12:48:33 +01:00
AccessKey: WLGDGYAQYIGI833EV05A SecretKey: BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF Region: us-east-1
2015-09-18 00:16:28 +02:00
2016-01-31 12:48:33 +01:00
Minio Object Storage:
http://127.0.0.1:9000
config/main: Re-write config files - add to new config v3
- New config format.
```
{
"version": "3",
"address": ":9000",
"backend": {
"type": "fs",
"disk": "/path"
},
"credential": {
"accessKey": "WLGDGYAQYIGI833EV05A",
"secretKey": "BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF"
},
"region": "us-east-1",
"logger": {
"file": {
"enable": false,
"fileName": "",
"level": "error"
},
"syslog": {
"enable": false,
"address": "",
"level": "debug"
},
"console": {
"enable": true,
"level": "fatal"
}
}
}
```
New command lines in lieu of supporting XL.
Minio initialize filesystem backend.
~~~
$ minio init fs <path>
~~~
Minio initialize XL backend.
~~~
$ minio init xl <url1>...<url16>
~~~
For 'fs' backend it starts the server.
~~~
$ minio server
~~~
For 'xl' backend it waits for servers to join.
~~~
$ minio server
... [PROGRESS BAR] of servers connecting
~~~
Now on other servers execute 'join' and they connect.
~~~
....
minio join <url1> -- from <url2> && minio server
minio join <url1> -- from <url3> && minio server
...
...
minio join <url1> -- from <url16> && minio server
~~~
2016-02-13 00:27:10 +01:00
http://10.1.10.177:9000
2015-06-17 01:09:10 +02:00
2016-01-31 12:48:33 +01:00
Minio Browser:
http://127.0.0.1:9000
config/main: Re-write config files - add to new config v3
- New config format.
```
{
"version": "3",
"address": ":9000",
"backend": {
"type": "fs",
"disk": "/path"
},
"credential": {
"accessKey": "WLGDGYAQYIGI833EV05A",
"secretKey": "BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF"
},
"region": "us-east-1",
"logger": {
"file": {
"enable": false,
"fileName": "",
"level": "error"
},
"syslog": {
"enable": false,
"address": "",
"level": "debug"
},
"console": {
"enable": true,
"level": "fatal"
}
}
}
```
New command lines in lieu of supporting XL.
Minio initialize filesystem backend.
~~~
$ minio init fs <path>
~~~
Minio initialize XL backend.
~~~
$ minio init xl <url1>...<url16>
~~~
For 'fs' backend it starts the server.
~~~
$ minio server
~~~
For 'xl' backend it waits for servers to join.
~~~
$ minio server
... [PROGRESS BAR] of servers connecting
~~~
Now on other servers execute 'join' and they connect.
~~~
....
minio join <url1> -- from <url2> && minio server
minio join <url1> -- from <url3> && minio server
...
...
minio join <url1> -- from <url16> && minio server
~~~
2016-02-13 00:27:10 +01:00
http://10.1.10.177:9000
2015-06-17 01:09:10 +02:00
2016-01-31 12:48:33 +01:00
To configure Minio Client:
$ wget https://dl.minio.io/client/mc/release/darwin-amd64/mc
$ chmod 755 mc
$ ./mc config host add myminio http://localhost:9000 WLGDGYAQYIGI833EV05A BYvgJM101sHngl2uzjXS/OBF/aMxAN06JrJ3qJlF
2015-06-17 01:03:17 +02:00
~~~
2015-06-17 01:09:10 +02:00
2016-01-09 04:42:45 +01:00
#### How to use AWS CLI with Minio?
< blockquote >
This section assumes that you have already installed aws-cli, if not please visit https://aws.amazon.com/cli/
< / blockquote >
To configure `aws-cli` , type `aws configure` and follow below steps.
```
$ aws configure
AWS Access Key ID [None]: YOUR_ACCESS_KEY_HERE
AWS Secret Access Key [None]: YOUR_SECRET_KEY_HERE
Default region name [None]: us-east-1
Default output format [None]: ENTER
```
Additionally enable `aws-cli` to use AWS Signature Version '4' for Minio server.
```
$ aws configure set default.s3.signature_version s3v4
```
To list your buckets.
```
$ aws --endpoint-url http://localhost:9000 s3 ls
2016-05-13 01:35:11 +02:00
2016-03-27 02:06:30 deebucket
2016-03-28 21:53:49 guestbucket
2016-03-29 13:34:34 mbtest
2016-03-26 22:01:36 mybucket
2016-03-26 15:37:02 testbucket
2016-01-09 04:42:45 +01:00
```
To list contents inside bucket.
```
2016-05-13 01:35:11 +02:00
$ aws --endpoint-url http://localhost:9000 s3 ls s3://mybucket
2016-03-30 00:26:53 69297 argparse-1.2.1.tar.gz
2016-03-30 00:35:37 67250 simplejson-3.3.0.tar.gz
```
To make a bucket.
```
$ aws --endpoint-url http://localhost:9000 s3 mb s3://mybucket
make_bucket: s3://mybucket/
```
To add an object to a bucket.
```
$ aws --endpoint-url http://localhost:9000 s3 cp simplejson-3.3.0.tar.gz s3://mybucket
upload: ./simplejson-3.3.0.tar.gz to s3://mybucket/simplejson-3.3.0.tar.gz
```
Delete an object from a bucket.
```
$ aws --endpoint-url http://localhost:9000 s3 rm s3://mybucket/argparse-1.2.1.tar.gzdelete: s3://mybucket/argparse-1.2.1.tar.gz
```
Remove a bucket.
```
$ aws --endpoint-url http://localhost:9000 s3 rb s3://mybucket
remove_bucket: s3://mybucket/
2016-01-09 04:42:45 +01:00
```
2015-10-22 10:31:09 +02:00
#### How to use AWS SDK with Minio?
Please follow the documentation here - [Using aws-sdk-go with Minio server ](./AWS-SDK-GO.md )
2015-12-06 22:40:48 +01:00
#### How to use s3cmd with Minio?
2016-01-09 04:42:45 +01:00
< blockquote >
This section assumes that you have already installed s3cmd, if not please visit http://s3tools.org/s3cmd
< / blockquote >
Edit the following fields in your s3cmd configuration file `~/.s3cfg` .
2015-12-10 00:38:40 +01:00
```
host_base = localhost:9000
host_bucket = localhost:9000
access_key = YOUR_ACCESS_KEY_HERE
secret_key = YOUR_SECRET_KEY_HERE
2016-03-18 10:07:17 +01:00
signature_v2 = False
2016-04-19 19:22:40 +02:00
bucket_location = us-east-1
2015-12-10 00:38:40 +01:00
```
2016-05-13 01:35:11 +02:00
To make a bucket.
2016-03-22 08:09:44 +01:00
```
$ s3cmd mb s3://mybucket
Bucket 's3://mybucket/' created
```
2016-05-13 01:35:11 +02:00
To copy an object to bucket.
2016-03-22 08:09:44 +01:00
```
2016-05-13 01:35:11 +02:00
$ s3cmd put newfile s3://testbucket
2016-03-22 08:09:44 +01:00
upload: 'newfile' -> 's3://testbucket/newfile'
```
2016-05-13 01:35:11 +02:00
To copy an object to local system.
2016-03-22 08:09:44 +01:00
```
$ s3cmd get s3://testbucket/newfile
download: 's3://testbucket/newfile' -> './newfile'
```
2016-05-13 01:35:11 +02:00
To sync local file/directory to a bucket.
2016-03-22 08:09:44 +01:00
```
$ s3cmd sync newdemo s3://testbucket
upload: 'newdemo/newdemofile.txt' -> 's3://testbucket/newdemo/newdemofile.txt'
```
2016-05-13 01:35:11 +02:00
To sync bucket or object with local filesystem.
2016-03-22 08:09:44 +01:00
```
2016-03-22 09:07:04 +01:00
$ s3cmd sync s3://otherbucket otherlocalbucket
2016-05-13 01:35:11 +02:00
download: 's3://otherbucket/cat.jpg' -> 'otherlocalbucket/cat.jpg'
2016-03-22 08:09:44 +01:00
```
To list buckets.
2015-12-10 00:38:40 +01:00
```
2015-12-29 02:43:28 +01:00
$ s3cmd ls s3://
2015-12-10 00:38:40 +01:00
2015-12-09 16:12 s3://testbbucket
```
2016-03-22 08:09:44 +01:00
To list contents inside bucket.
2015-12-10 00:38:40 +01:00
```
2015-12-29 02:43:28 +01:00
$ s3cmd ls s3://testbucket/
2015-12-10 00:38:40 +01:00
DIR s3://testbucket/test/
2015-12-09 16:05 138504 s3://testbucket/newfile
```
2015-12-06 22:40:48 +01:00
2016-05-13 01:35:11 +02:00
Delete an object from bucket.
2016-03-22 08:09:44 +01:00
```
$ s3cmd del s3://testbucket/newfile
delete: 's3://testbucket/newfile'
```
2016-05-13 01:35:11 +02:00
Delete a bucket.
2016-03-22 08:09:44 +01:00
```
$ s3cmd rb s3://testbucket
Bucket 's3://testbucket/' removed
```
2015-11-07 03:58:28 +01:00
## Contribute to Minio Project
2015-09-27 00:34:28 +02:00
Please follow Minio [Contributor's Guide ](./CONTRIBUTING.md )
2015-09-27 00:29:05 +02:00
2015-11-07 03:58:28 +01:00
### Jobs
If you think in Lisp or Haskell and hack in go, you would blend right in. Send your github link to callhome@minio.io.