Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Doris include table pattern null #294

Open
3 tasks done
gilboom opened this issue Jan 15, 2024 · 1 comment
Open
3 tasks done

[Bug] Doris include table pattern null #294

gilboom opened this issue Jan 15, 2024 · 1 comment

Comments

@gilboom
Copy link

gilboom commented Jan 15, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

Version

Doris flink connector: flink-doris-connector-1.17-1.5.0

What's Wrong?

When I use --single-sink flag to start my flink job, the task will report error:

Caused by: java.lang.IllegalArgumentException: Can't find any matched tables, please check your configured database-name: [svc_dw] and table-name: [((svc_dw)\.(null))(?!(svc_dw\.(upload_histories|supported_schemas))$)]

I try to figure out the question and I found the code that causes the question:

    protected String getSyncTableList(List<String> syncTables) {
        if (!singleSink) {
            return syncTables.stream()
                    .map(v -> getTableListPrefix() + "\\." + v)
                    .collect(Collectors.joining("|"));
        }

        // includingTablePattern and ^excludingPattern
        String includingPattern =
                String.format("(%s)\\.(%s)", getTableListPrefix(), includingTables);
        if (StringUtils.isNullOrWhitespaceOnly(excludingTables)) {
            return includingPattern;
        } else {
            String excludingPattern =
                    String.format("?!(%s\\.(%s))$", getTableListPrefix(), excludingTables);
            return String.format("(%s)(%s)", includingPattern, excludingPattern);
        }
    }

If I use --excluding-tables flag but not use --including-tables flag with --single-sink flag,the mysql flink cdc source will get the --table-name with value: ((svc_dw)\.(null))(?!(svc_dw\.(upload_histories|supported_schemas))$)

What You Expected?

Start the flink job successfully with --single-sink and --excluding-tables flags.

How to Reproduce?

Start a flink job with --single-sink and --excluding-tables flags and without --including-tables flag.

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@JNSimba
Copy link
Member

JNSimba commented Apr 24, 2024

Can you try the latest version 1.6.0?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants