Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow configuration of the scheduler's memory limit etc #2051

Closed
consideRatio opened this issue Jan 13, 2023 · 3 comments
Closed

Allow configuration of the scheduler's memory limit etc #2051

consideRatio opened this issue Jan 13, 2023 · 3 comments
Assignees
@yuvipanda
Labels
Engineering:Development Development-focused efforts for engineering team. upstream Requires an action in an upstream project

Comments

@consideRatio
Copy link
Contributor

consideRatio commented Jan 13, 2023 •
edited
Loading

I think its possible to configure dask-gateway client/server to have the dask-gateway client provide a UI for the user to configure the started cluster's scheduler's memory requests/limit.

Based on experience, this can need to be very very large, and with modern distributed versions, it can be less. Still, it should support something other than the fixed 4GB. Due to that we should support allowing users to specify such settings themselves.

Following that, we should also provide something like that here for our daskhubs.

/cc: @jbusecke who is interested in this.
@consideRatio consideRatio added upstream Requires an action in an upstream project Engineering:Development Development-focused efforts for engineering team. labels Jan 13, 2023
@consideRatio consideRatio self-assigned this Jan 13, 2023
@damianavila damianavila moved this to Needs Shaping / Refinement in DEPRECATED Engineering and Product Backlog Jan 16, 2023
@consideRatio consideRatio mentioned this issue Mar 16, 2023
Closed
@consideRatio consideRatio moved this from Needs Shaping / Refinement to Ready to work in DEPRECATED Engineering and Product Backlog Mar 16, 2023
@consideRatio consideRatio removed their assignment Mar 16, 2023
@consideRatio
Copy link
Contributor Author

I'd be happy to work on this myself, but since I'm low on time I'm unassigning myself for now.

@damianavila damianavila moved this to Todo 👍 in Sprint Board Mar 17, 2023
@yuvipanda
Copy link
Member

I think this is superseeded by 2i2c-org/features#26, as just having 1 profile should just be the default.

@github-project-automation github-project-automation bot moved this from Ready to work to Complete in DEPRECATED Engineering and Product Backlog Jun 14, 2023
@github-project-automation github-project-automation bot moved this from Todo 👍 to Done 🎉 in Sprint Board Jun 14, 2023
@jbusecke
Copy link
Contributor

I am not quite sure I see this addressed in 2i2c-org/features#26? If I understood correctly this issue was referring to changes end users could make via dask-gateway (e.g. in the notebook itself?).
Might have also misread this though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yuvipanda yuvipanda

Labels
Engineering:Development Development-focused efforts for engineering team. upstream Requires an action in an upstream project
Projects
No open projects
DEPRECATED Engineering and Product Backlog
Archived in project
Sprint Board
Archived in project
Milestone
No milestone
Development

No branches or pull requests
3 participants
@yuvipanda @consideRatio @jbusecke