We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug
The sda-cli list shows only the first 1000 files in a dataset. In addition, rclone ls command hangs if the folder contains more than 1000 files.
sda-cli
rclone ls
Steps to reproduce Upload 10001 files on a S3 bucket and then list them.
Expected behavior
Show all files by implementing pagination in the sda-cli.
sda-cli list
Additional context The aws library in Go has a default setting for listing of 1000 objects.
Estimation of size: small/medium
Estimation of priority: high
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Describe the bug
The
sda-cli
list shows only the first 1000 files in a dataset. In addition,rclone ls
command hangs if the folder contains more than 1000 files.Steps to reproduce
Upload 10001 files on a S3 bucket and then list them.
Expected behavior
Show all files by implementing pagination in the
sda-cli
.sda-cli list
Additional context
The aws library in Go has a default setting for listing of 1000 objects.
Estimation of size: small/medium
Estimation of priority: high
The text was updated successfully, but these errors were encountered: