Skip to content

Commit ea756b6

Browse files
author
y8z
committed
[ci skip] automated comment issue creation and tag+archive page generation
1 parent 998c2c9 commit ea756b6

File tree

5 files changed

+115
-0
lines changed

5 files changed

+115
-0
lines changed

_posts/2024-03-16-aws_s3_notes.md

+115
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,115 @@
1+
---
2+
layout: post
3+
title: Amazon AWS S3 setup
4+
subtitle:
5+
tags: [cloud, tutorial]
6+
author: Yuanpeng Zhang
7+
comments: true
8+
use_math: true
9+
---
10+
11+
Introduction
12+
===
13+
14+
Amazon S3 is a cloud service for setting up drives on the cloud, meaning that we can use it for
15+
storing and sharing files on the cloud. Compared to the Cloud drives that we commonly see and use
16+
every day, such as Dropbox, Google Drive, Proton Drive, Box, and among others to name, the Amazon
17+
S3 service is more like a backend thing for providing the underlying remote drive service. Based on
18+
such a backend engine, there exist wrapper apps to provide frontend interface for users to get
19+
access to the S3 cloud drive in an easy way.
20+
21+
> Though, AWS does provide frontend interface with which we can check, upload and download
22+
files, it is for sure not for daily use as the access to the AWS S3 frontend interface is not
23+
as straightforward as those daily used ones.
24+
25+
Typically, one has two main types of options to use the S3 cloud drive. One main way is to mount
26+
the S3 drive locally using routines like `s3fs` and a few other options as mentioned in Ref. [1].
27+
Another typical way of using S3 drive is to use it as the storage service for some web drive apps.
28+
In my case, I have a VPS (transfer to [here](https://iris2020.net/2023-09-08-docker_nginx/) and [here](https://iris2020.net/2024-01-28-oracle_vps_vol_expand/) for more about my VPS set up with Oracle) on which I have web-based
29+
file servers `SFTPGo` [2], `FileCodeBox` [3] and `KOD Cloud` [4]. These web-based file servers
30+
provide the capability to use the S3 drive as the storage.
31+
32+
In this tutorial, I will be covering the procedure to set up the AWS S3 bucket (the terminology that
33+
Amazon uses for their storage service). Also, I will put down some notes concerning the issues that
34+
I randomly came across when playing around with S3 service initially as a beginner.
35+
36+
Setup
37+
===
38+
39+
First, we can go to [https://aws.amazon.com/s3/](https://aws.amazon.com/s3/) where we can log in
40+
, if we have already got an account, or register one otherwise. The sign-in screen will look like
41+
this,
42+
43+
<p align='center'>
44+
<img src="/assets/img/posts/s3_init.png"
45+
style="border:none;"
46+
width="300"
47+
alt="s3_init"
48+
title="s3_init" />
49+
</p>
50+
51+
and the register screen will be like this,
52+
53+
<p align='center'>
54+
<img src="/assets/img/posts/s3_register.png"
55+
style="border:none;"
56+
width="300"
57+
alt="s3_register"
58+
title="s3_register" />
59+
</p>
60+
61+
Here, we can notice that in both the log-in and register screen, we have the definition of a `root`
62+
user. This is just like whatever other normal user account we created anywhere else -- the reason
63+
for calling this `root` user is because, later on, when logging into the AWS cloud service system,
64+
we will have the capability, as the `root` user, to create other users inside the AWS service (
65+
namely, the `IAM`, short for `Identity Access Management`). Amazon provides different entry point
66+
for these two different types of user account and that is why we see two options in the log-in
67+
screen.
68+
69+
Once we have an account -- suppose we are talking about the `root` account here -- we can then log
70+
into the AWS control panel. After successful login, we will see screen like follows,
71+
72+
<p align='center'>
73+
<img src="/assets/img/posts/s3_main.png"
74+
style="border:none;"
75+
width="300"
76+
alt="s3_main"
77+
title="s3_main" />
78+
</p>
79+
80+
In the main control panel as shown, we can go to the search bar on the top-left to search for
81+
`S3` and we can then go to the `S3` control panel, where we can set up the so-called `bucket`.
82+
Basically, this is just the terminology used by AWS for `storage`. We can set up multiple buckets
83+
for different uses and they are independent from each other. As shown below, I have set up only
84+
one bucket,
85+
86+
<p align='center'>
87+
<img src="/assets/img/posts/s3_bucket.png"
88+
style="border:none;"
89+
width="300"
90+
alt="s3_bucket"
91+
title="s3_bucket" />
92+
</p>
93+
94+
The charging for the `S3` storage service is not like what we usually have for normal cloud drive
95+
services (the reason is also obvious -- as mentioned above, `S3` is more like a backend service) --
96+
it is based on the usage of the storage. Basically, we put files (`S3` calls them `objects`) in the
97+
`bucket` and `S3` will calculate the cost based on the size of the file and how long we have stored
98+
the file for, during the month. For sure, there are other factors in calculating the charge rate but
99+
still the basic idea stays. For more details, refer to Ref. [5].
100+
101+
Tips & Notes
102+
===
103+
104+
References
105+
===
106+
107+
[1] [https://www.reddit.com/r/aws/comments/o7xffs/s3_bucket_mount_to_windows/?rdt=51783](https://www.reddit.com/r/aws/comments/o7xffs/s3_bucket_mount_to_windows/?rdt=51783)
108+
109+
[2] [https://sftpgo.com/](https://sftpgo.com/)
110+
111+
[3] [https://github.com/vastsa/FileCodeBox](https://github.com/vastsa/FileCodeBox)
112+
113+
[4] [https://github.com/Handsomedoggy/KodExplorer](https://github.com/Handsomedoggy/KodExplorer)
114+
115+
[5] [https://aws.amazon.com/s3/pricing/](https://aws.amazon.com/s3/pricing/)

assets/img/posts/s3_bucket.png

339 KB
Loading

assets/img/posts/s3_init.png

144 KB
Loading

assets/img/posts/s3_main.png

434 KB
Loading

assets/img/posts/s3_register.png

197 KB
Loading

0 commit comments

Comments
 (0)