S3-Storage
Simple Storage Service S3 Bucket
A bucket is a logical storage unit in Amazon's Simple Storage Service (S3). A bucket contains objects with files and metadata that describe the data.
S3 (Simple Storage Service) is a file hosting service that can theoretically store any amount of data. Access is via HTTP/HTTPS.
Apply to PP&B: A message to ppb@fhi.mpg.de or Michael Wesemann mw@fhi.mpg.de, with a description of the need and purpose of the storage space.
Use of the S3 Storage at the Fritz-Haber-Institute: The S3 storage can be used in three ways.
The first and easiest way is via the Internet browser by going to S3 website where you can securely log in with your account and use the storage like a cloud. Here we differentiate between the S3 http://s3.fhi.mpg.de:9000, which is externally accessible from the FHI network, and the internal http://s3.fhi.mpg.de:9001
The second possibility is to mount a drive in your operating system with different software programs. For Windows and MAC you can use https://cyberduck.io/ . Further possibilities are https://tntdrive.com/ or https://s3browser.com/ A solution for Linux is for example https://github.com/s3fs-fuse/s3fs-fuse
The third possibility is to retrieve the S3 data directly with a program without saving it locally. Here are a few examples:
- MATLAB https://de.mathworks.com
- Python/Jupyter https://pypi.org/project/s3/ or https://boto3.amazonaws.com
- LabView http://sine.ni.com
Other ways to work with S3 storage are https://github.com/minio/mc MinIO Client (mc) provides a modern alternative to UNIX commands like ls, cat, cp, mirror, diff, find etc. It supports filesystems and Amazon S3 compatible cloud storage service (AWS Signature v2 and v4).
Restic is a modern backup program that can back up your files from Linux, BSD, Mac and Windows https://restic.net/