You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We'll need to adjust how compaction commit transactions are applied so that any invalid commits are discarded, and the transaction as a whole is still applied, so that if a job is run more than once we ignore the second run. If this results in an empty transaction we can just not add it to the log.
Analysis
Compaction commits could be invalid for a various reasons:
If input files no longer exists, (likely due to already have been committed earlier) that commit can be ignored,
If input files exists but aren't assigned to job, want to log the event out but all for the compactions to continue (i.e. not an exception)
The text was updated successfully, but these errors were encountered:
Background
Split from:
Description
We'll need to adjust how compaction commit transactions are applied so that any invalid commits are discarded, and the transaction as a whole is still applied, so that if a job is run more than once we ignore the second run. If this results in an empty transaction we can just not add it to the log.
Analysis
Compaction commits could be invalid for a various reasons:
If input files no longer exists, (likely due to already have been committed earlier) that commit can be ignored,
If input files exists but aren't assigned to job, want to log the event out but all for the compactions to continue (i.e. not an exception)
The text was updated successfully, but these errors were encountered: