Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

quota problem on min-io? #77

Open
tinaok opened this issue May 15, 2024 · 5 comments
Open

quota problem on min-io? #77

tinaok opened this issue May 15, 2024 · 5 comments

Comments

@tinaok
Copy link
Collaborator

tinaok commented May 15, 2024

#76
I can create 50MiB of zarr file but I can't if it is 70MiB. This is the notebook which shows the problem.
https://github.com/pangeo-data/pangeo-eosc/blob/tinaok-patch-1/users/how-to/quota_pb_minio.ipynb
I would like to have a space
todaka-histogen, where I can write file, and other people can use my data.
How can I increase the quota?
How can I set bucket for doing this?

Thank you for your help.

@sebastian-luna-valero
Copy link
Collaborator

Hi,

Re-running the notebook wrote the test.zarr into JupyterHub rather than MinIO. I am not sure how to update the code to properly write into MinIO.

On the other hand, I have also used this other example to test MinIO. Could you please give it a try and let me know how it goes?

@tinaok
Copy link
Collaborator Author

tinaok commented May 16, 2024

Thank you @sebastian-luna-valero

The other example works if I keep the file size small.
It cannot handle large files. It works for me with files up to 50 MiB. Could you please try re-running the notebook with the following change?

size_in_MiB = 50

Change 50 to, for example, 500.

As seen in this image, I cannot change or know the quota of my space.

スクリーンショット 2024-05-16 22 55 24

Do you know:

How to find out the quota for each bucket?
How to change the quota for each user's space?

@sebastian-luna-valero
Copy link
Collaborator

Hi Tina,

Before troubleshooting further, these cells in your notebook:

image

Create a local folder in JupyterHub instead of MinIO:

image

Do you get the same?

@tinaok
Copy link
Collaborator Author

tinaok commented May 28, 2024

Yes I get the same thing.

Sometime I can write sometime I can't. And I can't change the quota.

@sebastian-luna-valero
Copy link
Collaborator

Hi Tina,

This is the problem, then. Your code is not writing to MinIO, and that's why you get the issue.

Could you please double check why your code is not writing to MinIO? In case it helps, this other example does write to MinIO.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants