Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature / Job cache plugin #414

Merged
merged 61 commits into from
Feb 24, 2024
Merged

Feature / Job cache plugin #414

merged 61 commits into from
Feb 24, 2024

Conversation

martin-traverse
Copy link
Collaborator

Make the job cache use the plugin mechanism and provide a plugin test suite

martin-traverse and others added 30 commits February 9, 2024 02:19
@martin-traverse
Move job cache framework into lib-orch
e8160fa
@martin-traverse
Use plugin manager to create the job cache
9c8e476
@martin-traverse
Add jobCache section to sample config files
5c8df49
@martin-traverse
Rename CacheEntry
d3634ec
@martin-traverse
Consistent naming for cache entry getters
c0615f8
@martin-traverse
Clean up job cache API
8ebfb46
@martin-traverse
Start adding some basic tests for the job cache interface
b82151a
@martin-traverse
Do not increment cache revision on open ticket (only on modifying ope…
a8f0296 
…rations)
@martin-traverse
Test stubs for job cache ticket mgmt
8fc4a54
@martin-traverse
Move local cache implementation of cache test suite into its own test…
3ad96b0 
… class
@martin-traverse
Job cache tests for openNewTicket()
434b398
@martin-traverse
Job cache fixes needed for test suite
cd48743
@martin-traverse
Work on job cache tests
b671333
@martin-traverse
Let local executor unit test work on windows
be4673d
@martin-traverse
Include run config for lib orch unit tests
8cccbe0
@martin-traverse
Finish tests for openTicket()
ce3766b
@martin-traverse
Add a test to ensure transient members are not stored in the cache
21cba7f
@martin-traverse
Add a test to check caching for different data types
144c590
@martin-traverse
Change executor API to use Java Serializable for job state, rather th…
ea12efb 
…an protobuf
@martin-traverse
Change local batch executor to match updates in executor API
ecc1635
@martin-traverse
Change SSH batch executor to match updates in executor API
9b15ff7
@martin-traverse
Cache corruption error class
fcef818
@martin-traverse
Update job cache interface
647d62c
@martin-traverse
Rename CacheTicket for job cache
8ec2e2d
@martin-traverse
Update local job cache impl to match changes in cache API
52a6891
@martin-traverse
Update job cache test suite for API changes
fbe1cec
@martin-traverse
Update executor basic test suite for API changes
258bed7
@martin-traverse
Update orch service implementation after job cache changes
fa47dd2
@martin-traverse
Update orch API method impl for checkJob
9ef0019
@martin-traverse
New LocalBatchState without protobuf
fa7cf17
Martin Traverse and others added 22 commits February 9, 2024 02:19
@martin-traverse
Add illegal arg check for closing a ticket
3d153c5
@martin-traverse
Make superseded() return true after ticket expiry time
2ac500e
@martin-traverse
Handle duplicate tickets for new items in local job cache
a2d766b
@martin-traverse
Fix some IDEA warnings
41a36d3
@martin-traverse
Remove protobuf dependency for SSH executor
e75fd15
@martin-traverse
No longer necessary to force versions of transitive dependencies for …
5eb1c86 
…the SSH executor (this is managed automatically in settings.gradle)
@martin-traverse
Start sketching out tests for cache CRUD operations
0431848
@martin-traverse
Introduce the concept of cache manager to create strongly-typed cache…
d8b972b 
… instances
@martin-traverse
Update plugin framework to give out cache manager instances rather th…
8c9fae9 
…an typed cache instances
@martin-traverse
Use the new cache manager to set up the job cache in the orchestrator
b1c9c2f
@martin-traverse
Fill in some unit tests for the job cache
15f8c7f
@martin-traverse
Fail for tests not added yet
4720406
@martin-traverse
Job cache testing work
948fc45
@martin-traverse
New exception for invalid cache operations
8240bca
@martin-traverse
Test stubs for cache CRUD operations
402f7cc
@martin-traverse
Job cache test cases for readEntry()
dc053e4
@martin-traverse
First pass on CRUD unit tests for job cache
69ca992
@martin-traverse
Rename job cache CRUD operations
76dee4f
@martin-traverse
Valid entry status in job cache
92fa08d
@martin-traverse
No expiry for missing cache tickets
7d3f3b0
@martin-traverse
Fix expected exception types for missing / new tickets
d5a55e6
Fix remaining tests for job cache
219fb94
@martin-traverse martin-traverse mentioned this pull request Feb 24, 2024
Open
@martin-traverse martin-traverse merged commit f1204c4 into finos:main Feb 24, 2024
36 checks passed
@martin-traverse martin-traverse deleted the feature/jdbc_job_cache branch February 24, 2024 17:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@martin-traverse