You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Data warehouses like Doris provide the ability to configure aggregation keys for tables. Data written to this field will be automatically aggregated before being written to the data file. This pre-computation capability greatly improves the analytical performance of the table.
Arctic's Mixed-format design opens up rules for data merging, and we can extend an aggregation merge rule to handle such use cases.
Use case/motivation
Support defining aggregation fields on tables, data written to this field will be automatically pre-aggregated according to the aggregation function to improve query performance.
Describe the solution
Extend the merge rules for data merging and add aggregation merge rules.
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
Description
Data warehouses like Doris provide the ability to configure aggregation keys for tables. Data written to this field will be automatically aggregated before being written to the data file. This pre-computation capability greatly improves the analytical performance of the table.
Arctic's Mixed-format design opens up rules for data merging, and we can extend an aggregation merge rule to handle such use cases.
Use case/motivation
Support defining aggregation fields on tables, data written to this field will be automatically pre-aggregated according to the aggregation function to improve query performance.
Describe the solution
Extend the merge rules for data merging and add aggregation merge rules.
Subtasks
No response
Related issues
No response
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: