Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

document variable vnode count #183

Open
BugenZhao opened this issue Jan 7, 2025 · 0 comments
Open

document variable vnode count #183

BugenZhao opened this issue Jan 7, 2025 · 0 comments
Labels
documentation Improvements or additions to documentation

Comments

@BugenZhao
Copy link
Member

Variable vnode count support is implemented during v2.0 to v2.2, which is believed to be stable enough now to be documented and published.

From users' prospective, there's a new session variable named STREAMING_MAX_PARALLELISM which determines the max parallelism to be adopted for future streaming jobs. Consequently, STREAMING_PARALLELISM for a new job cannot exceed this value, and ALTER .. SET PARALLELISM for an existing job cannot exceed this value used to create that job.

The default value is 256. The valid range in 2..=32768. Setting it to a larger value allows a resource-intensive job to use more resources, but this may compromise the performance of range scans on that table or materialized view, if applicable.

The max parallelism for a job cannot be changed once it's created, unless drop and recreate it. All existing jobs prior to this PR will be assigned a default value of 256.

@BugenZhao BugenZhao added the documentation Improvements or additions to documentation label Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

1 participant