Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-35401][Connectors/Sqs] Add Sqs Table API connector #155

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

vahmed-hamdy
Copy link
Contributor

@vahmed-hamdy vahmed-hamdy commented Aug 17, 2024

Purpose of the change

Implements the Table API for the Sqs Sink Connector.

Verifying this change

  • Added unit tests
  • Manually verified by running the SQS connector against real SQS resoruce.

Significant changes

(Please check any boxes [x] if the answer is "yes". You can first publish the PR and check them afterwards, for convenience.)

  • Dependencies have been added or upgraded
  • Public API has been changed (Public API is any class annotated with @Public(Evolving))
  • Serializers have been changed
  • New feature has been introduced

@vahmed-hamdy
Copy link
Contributor Author

vahmed-hamdy commented Aug 17, 2024

@hlteoh37 could you please take a look?

@vahmed-hamdy vahmed-hamdy changed the title [FLINK-35401] Add Sqs Table API connector [FLINK-35401][Connectors/Sqs] Add Sqs Table API connector Aug 17, 2024
Copy link
Contributor

@hlteoh37 hlteoh37 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution @vahmed-hamdy !

flink-connector-aws/flink-connector-sqs/pom.xml Outdated Show resolved Hide resolved

/** Options for the SQS connector. */
@PublicEvolving
public class SqsConnectorOptions {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we merge this with SqsConfigConstants?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We havent' released the connector, so let's make this uniform before we release it

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, can do but do we want to break the consistency with other AWS Table API connectors?
They are not merged for any of kinesis, firehose or DDB. I think it might be confusing for users since they are Public classes.

@vahmed-hamdy
Copy link
Contributor Author

@hlteoh37 Thanks for the review, Addressed now!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants