Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Machine Memory Calculations in Hail Batch #14540

Open
sjparsa opened this issue May 9, 2024 · 1 comment
Open

Machine Memory Calculations in Hail Batch #14540

sjparsa opened this issue May 9, 2024 · 1 comment
Assignees

Comments

@sjparsa
Copy link
Collaborator

sjparsa commented May 9, 2024

What happened?

There are several places in the hail batch code where machine memory is not reported exactly/ correctly. For azure instances, the 64 Core E machines are said to have 8192 mib per core of memory which is incorrect. The machine has 504 Gib = 516096 Mib of memory, which equates to 516096/64 = 8064 mib per core. The other E instances do indeed have 8192 mib per core.

In gcp, the highcpu machines are said to have 924 mib per core which is not correct either. These machines do not have in integer number of mib per machine. The code that calculates their memory should be evaluated to see if the rounding is being done appropriately.

Version

0.2.130

Relevant log output

No response

@sjparsa sjparsa added the needs-triage A brand new issue that needs triaging. label May 9, 2024
@patrick-schultz
Copy link
Collaborator

Let's schedule time to discuss in the next few weeks.

@daniel-goldstein daniel-goldstein removed the needs-triage A brand new issue that needs triaging. label May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants