Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up weight generation #36

Merged
merged 2 commits into from
Jan 11, 2024
Merged

Speed up weight generation #36

merged 2 commits into from
Jan 11, 2024

Conversation

JoshCu
Copy link
Contributor

@JoshCu JoshCu commented Jan 11, 2024

  • Reduce the size of the array np.where is run on ~3x speedup
  • Adds multiprocessing ~the sky is the limit (~25x on 56 cores)

notes

The array is reduced by getting the geometry bounds and rounding them appropriately.
In order to convert the bounds to array indices an inverse transform is applied to them.
This transform is still quite expensive and compromises ~50% of the runtime.

@JordanLaserGit JordanLaserGit merged commit e67b89c into CIROH-UA:main Jan 11, 2024
1 check passed
@JordanLaserGit
Copy link
Collaborator

@JoshCu Thanks for this improvement!

JordanLaserGit added a commit to JordanLaserGit/ngen-datastream that referenced this pull request Jul 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants