Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Solace Read connector #31476

Merged
merged 66 commits into from
Jun 21, 2024
Merged

Solace Read connector #31476

merged 66 commits into from
Jun 21, 2024

Commits on Apr 16, 2024

  1. wip solace connector

    @bzablocki
    bzablocki committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    f404eec View commit details
    Browse the repository at this point in the history

  2. wip solace connector

    @bzablocki
    bzablocki committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    00274a2 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. some checker errors resolved

    @bzablocki
    bzablocki committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    399ffcc View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. all checker errors resolved

    @bzablocki
    bzablocki committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    62dfa4a View commit details
    Browse the repository at this point in the history

  2. improving unit tests

    @bzablocki
    bzablocki committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    ea202fb View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. respond to pr commments

    @bzablocki
    bzablocki committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    260f645 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Documentation

    @bzablocki
    bzablocki committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    9057860 View commit details
    Browse the repository at this point in the history

  2. Small refactor - move data classes out of the client

    @bzablocki
    bzablocki committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    a74b6a6 View commit details
    Browse the repository at this point in the history

  3. refactor

    @bzablocki
    bzablocki committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    552cab4 View commit details
    Browse the repository at this point in the history

  4. Add github action for integration test of Solace

    @bzablocki
    bzablocki committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    5d847b3 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. testing github workflow

    @bzablocki
    bzablocki committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    23292a1 View commit details
    Browse the repository at this point in the history

  2. bump testcontainers to 1.19.7 - soalce semp was updated with an admin… 

    … user access
    @bzablocki
    bzablocki committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    a69e10a View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. Use FlowHandle to acknowledge messages to make SolaceCheckpointMark's… 

    … fields serializable.
    @bzablocki
    bzablocki committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    f4b0d6c View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Handle StaleSessionException error

    @bzablocki
    bzablocki committed May 8, 2024
    Configuration menu
    Copy the full SHA
    a1ca8b3 View commit details
    Browse the repository at this point in the history

  2. Add @internal annotation to mark the SolaceIO API beta and subject to… 

    … change.
    @bzablocki
    bzablocki committed May 8, 2024
    Configuration menu
    Copy the full SHA
    8007a33 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Improve documentation

    @bzablocki
    bzablocki committed May 13, 2024
    Configuration menu
    Copy the full SHA
    cff3105 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Back to ack based on bytesxmlmessages. Deduplicate default to false.

    @bzablocki
    bzablocki committed May 29, 2024
    Configuration menu
    Copy the full SHA
    f3eaabe View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into solace-connector

    @bzablocki
    bzablocki committed May 29, 2024
    Configuration menu
    Copy the full SHA
    34c4170 View commit details
    Browse the repository at this point in the history

  3. update changes.md with Solace read connector

    @bzablocki
    bzablocki committed May 29, 2024
    Configuration menu
    Copy the full SHA
    7b24fdb View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. remove ack by id code

    @bzablocki
    bzablocki committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    be74c86 View commit details
    Browse the repository at this point in the history

  2. remove todo comment

    @bzablocki
    bzablocki committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    a85c68c View commit details
    Browse the repository at this point in the history

  3. Add licenses to package-info.java files

    @bzablocki
    bzablocki committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    533f122 View commit details
    Browse the repository at this point in the history

  4. Restructure documentation

    @bzablocki
    bzablocki committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    2f41380 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. update aws test after upgrading testcontainers version.

    @bzablocki
    bzablocki committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    9a317a8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:bzablocki/beam into solace-connector

    @bzablocki
    bzablocki committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    38b6f0c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'solace-connector' of github.com:bzablocki/beam into sol… 

    …ace-connector
    @bzablocki
    bzablocki committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    cf5d24d View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Disable publishing docs until the first pass on the master branch

    @bzablocki
    bzablocki committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    aa29100 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:apache/beam into solace-connector

    @bzablocki
    bzablocki committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    94101a8 View commit details
    Browse the repository at this point in the history

  3. Remove files from this branch to split PR into smaller chunks

    @bzablocki
    bzablocki committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    c625069 View commit details
    Browse the repository at this point in the history

  4. refactor tests for readability

    @bzablocki
    bzablocki committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    1521f40 View commit details
    Browse the repository at this point in the history

  5. revert upgrade of testcontainers - not needed in this PR chunk

    @bzablocki
    bzablocki committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    b815286 View commit details
    Browse the repository at this point in the history

  6. revert upgrade of testcontainers - not needed in this PR chunk

    @bzablocki
    bzablocki committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    08b777c View commit details
    Browse the repository at this point in the history

  7. spotless

    @bzablocki
    bzablocki committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    0f63749 View commit details
    Browse the repository at this point in the history

  8. remove IT tests from this pr

    @bzablocki
    bzablocki committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    e90e69a View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Tech Writer review

    @bzablocki
    bzablocki committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    f6833d2 View commit details
    Browse the repository at this point in the history

  2. Add a field to Solace.Record mapped from BytesXMLMessage.getAttachmen… 

    …tByteBuffer()
    @bzablocki
    bzablocki committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    df1eb6c View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Add and fix some documentation

    @bzablocki
    bzablocki committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    5015b32 View commit details
    Browse the repository at this point in the history

  2. Remove CheckpointMark's reference to the UnboundedSolaceReader - unne… 

    …cessary.
    @bzablocki
    bzablocki committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    2e1c10e View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Revert "Remove CheckpointMark's reference to the UnboundedSolaceReade… 

    …r - unnecessary."

This reverts commit 2e1c10e.
    @bzablocki
    bzablocki committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    4d02b99 View commit details
    Browse the repository at this point in the history

  2. Solace project init - github workflow file, gradle module

    @bzablocki
    bzablocki committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    bee8faf View commit details
    Browse the repository at this point in the history

  3. Merge branch 'solace-connector-0-project-init' into solace-connector 

    # Conflicts:
#	.github/workflows/beam_PreCommit_Java_Solace_IO_Direct.yml
#	sdks/java/io/solace/build.gradle
    @bzablocki
    bzablocki committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    a5b29ed View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge branch 'master' of github.com:apache/beam into solace-connector 

    # Conflicts:
#	sdks/java/io/solace/build.gradle
    @bzablocki
    bzablocki committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    09368d6 View commit details
    Browse the repository at this point in the history

  2. Splitting the apache#31476 - Leaving only PTransform AutoValue config… 

    …urations
    @bzablocki
    bzablocki committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    f2d284a View commit details
    Browse the repository at this point in the history

  3. remove unnecessary dependencies

    @bzablocki
    bzablocki committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    9af3185 View commit details
    Browse the repository at this point in the history

  4. remove info from CHANGES.md

    @bzablocki
    bzablocki committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    60d854d View commit details
    Browse the repository at this point in the history

  5. Add watermark-related code

    @bzablocki
    bzablocki committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    3847876 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Merge branch 'master' of github.com:apache/beam into solace-connector… 

    …-0-watermark

# Conflicts:
#	sdks/java/io/solace/build.gradle
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/SolaceIO.java
    @bzablocki
    bzablocki committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    a00b997 View commit details
    Browse the repository at this point in the history

  2. Remove excessive @nullable annotations on Solace.Record class

    @bzablocki
    bzablocki committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    19b02be View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'refs/remotes/upstream/master' into sola… 

    …ce-connector

# Conflicts:
#	sdks/java/io/solace/build.gradle
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/SolaceIO.java
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/broker/SempClientFactory.java
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/broker/SessionServiceFactory.java
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/data/Solace.java
    @bzablocki
    bzablocki committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    bcc0a51 View commit details
    Browse the repository at this point in the history

  4. Remove entry from CHANGES.md

    @bzablocki
    bzablocki committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    0d59032 View commit details
    Browse the repository at this point in the history

  5. Make Record builder package-private

    @bzablocki
    bzablocki committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    2787260 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Refactor SolaceIO - the constructor of Read takes a configuration bui… 

    …lder as an argument
    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b46a8f8 View commit details
    Browse the repository at this point in the history

  2. Change payload and attachments type to immutable ByteString

    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    1c09b82 View commit details
    Browse the repository at this point in the history

  3. Downgrade Record builders access modifiers to package private

    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    81b7f84 View commit details
    Browse the repository at this point in the history

  4. Add documentation

    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d1ada91 View commit details
    Browse the repository at this point in the history

  5. Add documentation to classes and methods in Solace.java

    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    15b394c View commit details
    Browse the repository at this point in the history

  6. typo

    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2e536f9 View commit details
    Browse the repository at this point in the history

  7. Add SolaceCheckpointMark.java

    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    daf2cfe View commit details
    Browse the repository at this point in the history

  8. Merge branch 'refs/heads/solace-connector-0-watermark' into solace-co… 

    …nnector

# Conflicts:
#	sdks/java/io/solace/build.gradle
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/SolaceIO.java
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/broker/SempClientFactory.java
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/broker/SessionServiceFactory.java
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/data/Solace.java
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/data/SolaceRecordCoder.java
#	sdks/java/io/solace/src/test/java/org/apache/beam/sdk/io/solace/MockSempClientFactory.java
#	sdks/java/io/solace/src/test/java/org/apache/beam/sdk/io/solace/MockSessionServiceFactory.java
#	sdks/java/io/solace/src/test/java/org/apache/beam/sdk/io/solace/SolaceIOTest.java
#	sdks/java/io/solace/src/test/java/org/apache/beam/sdk/io/solace/data/SolaceDataUtils.java
#	sdks/java/io/solace/src/test/java/org/apache/beam/sdk/io/solace/data/SolaceTest.java
    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    93ffdd1 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'refs/heads/solace-connector-0-checkpoint-mark' into sol… 

    …ace-connector

# Conflicts:
#	sdks/java/io/solace/build.gradle
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/read/SolaceCheckpointMark.java
    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    9888b09 View commit details
    Browse the repository at this point in the history

  10. Make SolaceCheckpointMark visible for testing

    @bzablocki
    bzablocki committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    bbade93 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Merge remote-tracking branch 'refs/remotes/upstream/master' into sola… 

    …ce-connector
    @bzablocki
    bzablocki committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    4689fed View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into solace-connector

    @bzablocki
    bzablocki committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    58ddecc View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/master' into solace-connector 

    # Conflicts:
#	sdks/java/io/solace/build.gradle
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/broker/SessionServiceFactory.java
    @bzablocki
    bzablocki committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    a39f950 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Merge remote-tracking branch 'upstream/master' into solace-connector 

    # Conflicts:
#	sdks/java/io/solace/src/main/java/org/apache/beam/sdk/io/solace/data/Solace.java
    @bzablocki
    bzablocki committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    da26ab5 View commit details
    Browse the repository at this point in the history

  2. Remove SolaceRecordCoder and take advantage of @DefaultSchema

    @bzablocki
    bzablocki committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    63425d7 View commit details
    Browse the repository at this point in the history