Skip to content

AWS Permissions required to use awswrangler.athena.to_iceberg function #3042

Closed
@git4suman

Description

@git4suman

I am using awswrangler.athena.to_iceberg to write data from a pandas dataframe to iceberg table. And this is being run from a lambda function. My question is what permissions would be required to perform this operation,so that I can add those to the lambda execution role. I beleive we should have glue and target S3 bucket access. Can anyone suggest the exact glue action and s3 action required to be added in aws policy statement. Do we have to add any athena related policies/permissions?

Code Snippet:

import awswrangler as wr

wr.athena.to_iceberg(df=df,database=GLUE_ICEBERG_DB,table=glue_table_name,table_location=OUTPUT_FILE_PATH,temp_path=TEMP_PATH,keep_files=False,index=False,schema_evolution=True,fill_missing_columns_in_df=True,partition_cols=['dt','ts'],additional_table_properties={'write_target_data_file_size_bytes':'536870912','write_compression':'SNAPPY'}
)

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions