-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature][SeaTunnel Engine IMap Storage] Imap storage supports kafka compact topic in cluster mode #5024
Conversation
58631df
to
404336e
Compare
@EricJoy2048 PTAL |
9c88f1c
to
bd395bc
Compare
@liugddx PTAL. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why are the test cases disabled? We need to add some test cases that can be used to ensure that this feature can be used.
The test is connected to my local environment |
Is there a way to enable testing? |
Can be processed using kafka container |
Yes, I think you can enable the test case by use kafka container. |
a912a1a
to
b08dba6
Compare
done |
</dependency> | ||
<dependency> | ||
<groupId>junit</groupId> | ||
<artifactId>junit</artifactId> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we need this dependency?
pom.xml
Outdated
@@ -146,6 +146,7 @@ | |||
<json-smart.version>2.4.7</json-smart.version> | |||
<hadoop-aws.version>3.1.4</hadoop-aws.version> | |||
<netty-buffer.version>4.1.60.Final</netty-buffer.version> | |||
<kafka.version>3.4.1</kafka.version> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We support those versions of kafka?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We support those versions of kafka?
Backward compatibility.
<groupId>junit</groupId> | ||
<artifactId>junit</artifactId> | ||
<version>4.13.2</version> | ||
<scope>test</scope> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same as above.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same as above.
for testcontainer
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have a question, why use kafka as storage? |
Kafka compact topic:
|
<groupId>junit</groupId> | ||
<artifactId>junit</artifactId> | ||
<version>4.13.2</version> | ||
<scope>test</scope> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@EricJoy2048 @Hisoka-X PTAL
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In general LGTM.
b08dba6
to
16c1a72
Compare
bb51370
to
807c1d4
Compare
The latest dev branch has addressed e2e test issues. Please consider merging it. |
18e46b8
to
17befc4
Compare
@ic4y There are still errors |
Waiting for #5208 |
259119e
to
0586b14
Compare
0586b14
to
f446f3f
Compare
Purpose of this pull request
Check list
New License Guide
release-note
.