Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rework the classes.py for scaling and performance #598

Open
bjoernenders opened this issue Jan 30, 2025 · 0 comments
Open

Rework the classes.py for scaling and performance #598

bjoernenders opened this issue Jan 30, 2025 · 0 comments
Assignees

Comments

@bjoernenders
Copy link
Contributor

classes.py is our main module for holding data in PtyPy. Currently we are facing performance issues when scaling up to millions of views. Also the dynamic resizing nature of the data holding numpy arrays can cause trouble further down the road when using GPU acceleration. I'm making this issue to remind myself what work needs to be done to address performance and scaling issues:

Here are a few things to look at:

  • Make View and POD class as thin as possible.
  • Create memory buffer/numpy to hold all relevant data for views to be created.
  • Create similar buffer for POD
  • Allow forming of POD and View instances from buffer arrays
  • Consider a fixed canvas for Storage classes and make sure the view access doesn't make errors
  • Consider tiling for shared Storages
  • Make sure methods modular enough for easy subclassing to GPU memory.
@bjoernenders bjoernenders self-assigned this Jan 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant