INSERT OVERWRITE operation is updating the metastore information of ACID table to latest base directory even incase of failures

[srinikvv]

When trying to perform an INSERT OVERWRITE operation, the hive metastore information of a table are updated to point the latest base directory even in case of an error while executing the operation. And as a result the target table is no longer queryable(from presto) or shows 0 records(from hive)

Error from presto while trying to query such tables:
SQL Error [16777232]: Query failed (#20210412_083757_04509_aczvq): Not enough history available for (990,205). Oldest available base: hdfs://abc.xyz.com:8020/warehouse/tablespace/managed/hive/sales_dh.db/opportunity_product_f/base_0000881

[srinikvv]

Hi Team, can you check the above issue and provide me some inputs to avoid this issue.
Appreciate any help on this!

[mridul-naithani]

Hi Team, Any update on the above issue? Appreciate any help on this!