Enable to pass storage region outside of create-s3

[falexwolf]

We also need to be able to pass a storage region outside the storage param because otherwise during init_storage_hub we'll try to infer it while not yet having access:

lamindb-setup/lamindb_setup/core/_hub_core.py

Line 158 in 0501bb3

"region": ssettings.region,

I'll make a PR that adds this ability.

[Koncopd]

I am not sure what do you mean here. Do we want to force passing the region on storage init? I think we need to make sure that the region is resolved even without access rights instead of forcing manual passing. https://github.com/fsspec/s3fs/blob/a28863f084a91ee78d9cd65bd6767b2f44e81b33/s3fs/utils.py#L40
This is how it is done in s3fs, it should be able to retrieve region even when the access is denied because error response also carries the region if i understand corretly.

[falexwolf]

I mean that we get a "HeadBucket operation: Forbidden" error because it's calling the below before the storage row is in the hub and access-aws can be called:

lamindb-setup/lamindb_setup/core/_settings_storage.py

Line 52 in 0501bb3

response = s3_client.head_bucket(Bucket=bucket)

If we can get region without calling head_bucket: great!

[Koncopd]

We still call the bucket and but we check the error header in the response and it should contain the region (see the code in s3fs above), i can add this to get_storage_region tmr.

[falexwolf]

That'd be a very elegant solution! Anytime this or early next week is fine! We worked around this issue where needed it so far and it's nothing that a user will face.