The following Go program have been made in the purpose of consumming a Redis queue of coordinates, to download their related satellite image from the Google Static Map API and store them in a defined S3 Bucket.
To run this script you'll need the following:
- docker
- docker compose
- a Redis queue already running filled with locations
- an access key id and secret for a S3 Bucket
- an API key for the Google static Map API.
Then check up the S3 Bucket all the images should have been pushed to to the defined folder.
To access the data of the S3 bucket you will need the appropriate access key id and access key secret, those should have been kept by the creator of the S3 bucket (and that's likely to be me => @guilhem-sante).
You should then access the S3 bucket content through a CLI (like aws), or from a dedicated GUI like expandrive (I personnaly recommand the usage of a GUI).
You can configure the script with the following environment variables:
| NAME | DESCRIPTION | REQUIRED | DEFAULT VALUE |
|---|---|---|---|
| nb_worker | The number of goroutine that will run simultanely | no | 1 |
| log_level | The minimum log level | no | "INFO" |
| google_api.key | The required API key for any requests to the Google Static Map API | yes | |
| google_api.picture.zoom | The zoom scope (from 1 to 20) of the satellite picture | no | 18 |
| google_api.picture.width | The image width in pixel | no | 400 |
| google_api.picture.height | The image height in pixel | no | 400 |
| google_api.picture.map_type | The map type to download image from | no | "satellite" |
| google_api.picture.format | The image type format to download | no | "jpg" |
| redis.addr | The address of the Redis server | no | "localhost:6379" |
| redis.password | The password for the redis server if any | no | |
| redis.db | The database to get elements from | no | 0 |
| redis.queue_name | The queue name to get elements from | no | "locations" |
| s3.endpoint | The endpoint of the S3 bucket | no | "s3.amazonaws.com" |
| s3.region | The region of the S3 bucket if any | no | |
| s3.bucket_name | The S3 bucket name | yes | |
| s3.image_folder | The folder in which satellite images should be pushed | no | satellite-images |
| s3.access_key_id | The access key id to access the S3 Bucket | yes | |
| s3.access_key_secret | The access key secret to access the S3 Bucket | yes |