Load multiple s3 files using S3 File Webloaders (s3Loader) #1422
Unanswered
shubhamrejolut
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am trying to load multiple unstructured files using the s3Loader, but I could not find a way to do so.
![image](https://private-user-images.githubusercontent.com/107535300/241237556-8c1d7af8-7b2e-402e-b610-6ceba937627f.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkxNzYyMTgsIm5iZiI6MTczOTE3NTkxOCwicGF0aCI6Ii8xMDc1MzUzMDAvMjQxMjM3NTU2LThjMWQ3YWY4LTdiMmUtNDAyZS1iNjEwLTZjZWJhOTM3NjI3Zi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwMjEwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDIxMFQwODI1MThaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT01ZWRlMmU5YTFjNTQ0OWUyODM2ODRjZGZiNjliNjNlOGRjMjZjZDNlZmQ0NzI3ZGYyYzljY2Y4NWQ5YjIwNmM4JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.kmiMeivE9RVQciypnbr6XHD2zMo3EtvwP6w7pML6QpA)
I can successfully load single s3 file with the .load method, but could not figure out how to load multiple datasources.
My goal is to provide the model with multiple files from s3 as a datasource to query on.
My current code looks like this.
Ignore the redundant s3Config object. ;-P
Beta Was this translation helpful? Give feedback.
All reactions