Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Initialization of support for S3 #540

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Conversation

ngr
Copy link

@ngr ngr commented May 2, 2022

Types of changes

  • New feature (non-breaking change which adds functionality)

Summary

  • New S3File subtype
  • helpers_aws with lazy S3 client
  • check that S3 file exists from BaseSpec if field.type is S3File

Checklist

  • I have added tests to cover my changes (if necessary)
  • I have updated documentation (if necessary)

Sorry, something went wrong.

ngr and others added 4 commits May 2, 2022 15:09
- New File subtype
- helpers_aws with lazy S3 client
- check that S3 file exists from BaseSpec if field.type is S3File
@tclose
Copy link
Contributor

tclose commented Apr 2, 2025

This could be adapted and added to pydra.tasks.common

@tclose tclose added the to consider suggesting changes that require more discussion label Apr 2, 2025
@ngr
Copy link
Author

ngr commented Apr 2, 2025

Is this still relevant at all?
We can maybe do some sprinting on this during PyCon2025...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
to consider suggesting changes that require more discussion
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants