Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update DataFlowIT.multipleComposedTaskWithArguments so that it will pass #5898

Closed
wants to merge 4 commits into from

Conversation

cppwfs
Copy link
Contributor

@cppwfs cppwfs commented Aug 15, 2024

This PR has 3 commits:

  1. Update scripts and docker-compose files.
    a. Make sure to remove the version from the docker-compose.yml files. It is marked as obsolete and causes different versions of docker compose to fail.
    b. Update docker-compose files to use the latest version of SCDF 3.x instead of 2.11.x
    c. Update build image script so that it uses java 17 when creating containers
  2. Update the Code so that we have SCDF 3.x enumerated. Remove the Disabled flags and TODOs
    a. Note that some code in the is already in PR Serialize Job Parameters to the command Line Arguments on Job Restarts per Batch Standards #5850 (JobParametersJacksonMixIn.java & DefaultTaskJobService.java). This was added so we could provide a successful test. And these changes can be removed on merge once that PR has been merged.
  3. Start documenting how SCDF's workflows work. This document currently only contains information on how images are created. (But its a start).

@cppwfs cppwfs changed the title Scdf ctr at update2 Update DataFlowIT.multipleComposedTaskWithArguments so that it will pass Aug 15, 2024
@cppwfs cppwfs requested review from onobc and corneil August 15, 2024 12:44
Copy link
Contributor

@onobc onobc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR @cppwfs . I have a few comments/questions but other than that LGTM.

Step 1. Make sure to remove the version from the docker compose.  It is no longer needed and causes older versions of docker to fail
Step 2. Update compose files to use the latest version of SCDF 3.x instead of 2.11.x
Step 3. Update build image script so that uses java 17 when creating containers
… multipleComposedTaskWithArguments test passes.

Notice that JobParameterJacksonDeserializer and JobParametersJacksonMixIn have been updated.  These changes mirror those in spring-cloud#5850.   These were required for the test to pass.  At the time this PR is merged we can merge accepting those from spring-cloud#5850.
Also update the DEFAULT_JDK to Java 17
* Added log message in case a JobParameter Type is invalid
* cleaned up workflow.adoc
Copy link
Contributor

@onobc onobc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates @cppwfs - LGTM!

@cppwfs
Copy link
Contributor Author

cppwfs commented Aug 20, 2024

Squashed rebased Merged. Thanks for the reviews!

@cppwfs cppwfs closed this Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants