Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BitSail-486][Connector] Kudu source refactor #487

Merged
merged 7 commits into from
Jun 30, 2023

Conversation

hitYangfei
Copy link
Contributor

@hitYangfei hitYangfei commented Jun 30, 2023

Prepare a Pull Request

Please change the PR title and the related issue number refer to the following description.

The above XYZ must be replaced with the actual GitHub Issue number, indicating that the current PR is used to solve the problem described in this Issue.

If you don't find an Issue that matches your changes, please Create Issue first, then commit this PR.

For more info about the contributing guide, see: Contributing Guide

Motivation

Describe what this PR does and what problems you're trying to solve.

Modifications

Describe the modifications you've done.

Verifying this change

Please pick either of the following options.

  • This change is a trivial rework/code cleanup without any test coverage.

  • This change is already covered by existing tests, such as:
    (please describe tests, example:)

    • com.bytedance.bitsail.core.EngineTest#testRunEngine
  • This change added tests and can be verified as follows:

    (example:)

    • Added unit tests for parsing of configs
    • Optimized integration tests for recovery after task failure

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
  • If a feature is not applicable for documentation, explain why?
  • If a feature is not documented yet in this PR, please create a follow-up issue for adding the documentation

hitYangfei added 5 commits June 30, 2023 10:27
1. use KuduScanTokenBuilder to build KuduScanner
2. support predicate json config for kudu source : COMPARE , NULL, NOTNULL and IN
3. add some kudu config
@healchow
Copy link
Member

Please create an Issue first, and briefly explain what you are going to do in the Issue.

@hitYangfei
Copy link
Contributor Author

Please create an Issue first, and briefly explain what you are going to do in the Issue.

#486

@healchow healchow changed the title [bitsail] kudu source refactor #486 [BitSail-486][Connector] Kudu source refactor Jun 30, 2023
@BlockLiu BlockLiu merged commit 5bf5cdc into bytedance:master Jun 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improve][Connector] Kudu source refactor
3 participants