New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a thing to generate executor memory using input data size + container sizes #5

Open

holdenk opened this issue Jan 27, 2018 · 0 comments

Member

holdenk commented Jan 27, 2018

Input data size could be a user hint or based off of previous run or hadoop file or Hive stastitics ala Spark's own cost-based-query-planner.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment