Skip to content

Commit

Permalink
Always provide partitioning=None and filesystem
Browse files Browse the repository at this point in the history
  • Loading branch information
delucchi-cmu committed Mar 6, 2025
1 parent f08cb51 commit 70a3a03
Showing 1 changed file with 7 additions and 1 deletion.
8 changes: 7 additions & 1 deletion src/hats/io/file_io/file_io.py
Original file line number Diff line number Diff line change
Expand Up @@ -306,4 +306,10 @@ def read_parquet_file_to_pandas(file_pointer: str | Path | UPath, **kwargs) -> p
partitioning=None, # Avoid the ArrowTypeError described in #367
**kwargs,
)
return pd.read_parquet(file_pointer, storage_options=storage_options, **kwargs)
return pd.read_parquet(
file_pointer,
filesystem=file_pointer.fs,
storage_options=storage_options,
partitioning=None, # Avoid the ArrowTypeError described in #367
**kwargs,
)

0 comments on commit 70a3a03

Please sign in to comment.