Can awswrangler.s3.read_csv be used to read .txt files?

[ANicolucciTreeOfLife]

I have flat files that will be uploaded to AWS S3 as | delimited. can awswrangler.s3.read_csv method be used to read the files?
If not, what is the right method to read it with AWS Data Wrangler?

[malachi-constant]

Hi @ANicolucciTreeOfLife.

Possibly awswrangler.s3.read_fwf() would work for your use case? If there isn't fixed-width formatting in the text file, there aren't any other options in the library.

Full list of s3 read methods are listed here in the docs.

[ANicolucciTreeOfLife]

No, the files are not fixed-width formatting they are Pipe (|) delimited. I'm not sure why this method would be an option?

[malachi-constant]

Apologies, must have misread this. Theoretically this should work as we support passing any pandas supported kwargs in read_csv().

Have you tried this call with sep='|' yet by any chance? Let me know if that works and if not, I can open an issue to look into getting this supported.