Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[flink] Support compact procedure #2013

Merged
merged 5 commits into from
Sep 19, 2023
Merged

Conversation

yuzelin
Copy link
Contributor

@yuzelin yuzelin commented Sep 14, 2023

Purpose

Tests

CompactActionITCase
SortCompactActionITCase

API and Format

Documentation

@yuzelin yuzelin force-pushed the compact_procedure branch 10 times, most recently from 2ef94e0 to c0848b1 Compare September 15, 2023 10:10
@@ -212,6 +213,12 @@ default boolean caseSensitive() {
return true;
}

/** Return the warehouse path. */
String warehouse();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cast to AbstractCatalog to get warehouse and options.


ReadableConfig conf = StreamExecutionEnvironmentUtils.getConfiguration(env);
String name = conf.getOptional(PipelineOptions.NAME).orElse(jobName);
if (conf.get(ExecutionOptions.RUNTIME_MODE) == RuntimeExecutionMode.STREAMING) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should use TABLE_DML_SYNC in Flink.

Copy link
Contributor

@JingsongLi JingsongLi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi JingsongLi merged commit f31cd18 into apache:master Sep 19, 2023
7 of 8 checks passed
@yuzelin yuzelin deleted the compact_procedure branch September 19, 2023 02:17
schnappi17 pushed a commit to schnappi17/flink-table-store that referenced this pull request Sep 23, 2023
pongandnoon pushed a commit to tongcheng-elong/incubator-paimon that referenced this pull request Oct 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants