AWS/S3

From Omnia
< AWS
Jump to navigation Jump to search

Amazon Simple Storage Service (Amazon S3)

Copy File

aws s3 cp --no-sign-request --recursive s3://bucket/path/file ./
aws s3 cp --no-sign-request --recursive s3://bucket/path/ ./

s3fs

FuseOverAmazon - s3fs - FUSE-based file system backed by Amazon S3 - Google Project Hosting - http://code.google.com/p/s3fs/wiki/FuseOverAmazon

Password file:

~/.passwd-s3fs
/etc/passwd-s3fs

Password structure:

accessKeyId:secretAccessKey
# or for multiple credentials:
bucketName:accessKeyId:secretAccessKey
# example:
oeey:AKIAXXXXXXXXXGFEAC7A:6sxbN6XXXXXD5bwXFnAZIOjuIcGW/5oGap0FF+3e

Mount:

mount -t fuse s3fs#oeey:/cloud_data /mnt
mount -t fuse /opt/s3fs/bin/s3fs#oeey /mnt
# or
s3fs mybucket /mnt

-

InstallationNotes - s3fs - Installation Notes - FUSE-based file system backed by Amazon S3 - Google Project Hosting - https://code.google.com/p/s3fs/wiki/InstallationNotes

Dependencies:

yum install gcc make gcc-c++ libstdc++-devel libcurl libcurl-devel fuse fuse-devel openssl-devel libxml2-devel mailcap

Build and Install:

wget http://s3fs.googlecode.com/files/s3fs-1.74.tar.gz
tar xvzf s3fs-1.74.tar.gz
cd s3fs-1.74/
#./configure --prefix=/usr
./configure --prefix=/opt/s3fs
make
sudo make install

Results:

/opt/s3fs/bin/s3fs
/opt/s3fs/share/man/man1/s3fs.1

/etc/fstab:

s3fs#oeey:/cloud_data       /s3cache/cloud_data-mount   fuse    use_cache=/s3cache/cloud_data-cache,allow_other     0 0

keywords