Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Orleans Node Interleaved Upgrade Causes Placement Strategy Not to Update #9113

Open
egmkang opened this issue Aug 14, 2024 · 0 comments
Open

Comments

@egmkang
Copy link
Contributor

egmkang commented Aug 14, 2024

In an Orleans cluster, we have two types of grains: GrainA and GrainB. GrainA is responsible for activating instances of GrainB. By default, GrainA uses the default placement strategy, while GrainB uses the PreferLocalPlacement strategy. Due to having only one instance of GrainA, the load distribution is highly imbalanced. As a solution, we decided to remove the PreferLocalPlacement strategy from GrainB and switch to a random placement strategy.

Update Steps:

  1. Old Cluster Configuration (GrainB uses PreferLocalPlacement strategy):
  2. Migrating to New Cluster:
    Shut down old Node 1, wait for a few seconds, and then start new Node 1.
    Shut down old Node 2, wait for a few seconds, and then start new Node 2.

    Shut down old Node N, wait for a few seconds, and then start new Node N.
  3. New cluster can work now.

However, after these steps, it was observed that GrainB instances activated by GrainA were still using the PreferLocalPlacement strategy, which was not the expected behavior.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant