Skip to content
This repository has been archived by the owner on Nov 23, 2017. It is now read-only.

Hadoop 2.6 support for Spark 1.6 #82

Open
anfeng opened this issue Feb 9, 2017 · 4 comments
Open

Hadoop 2.6 support for Spark 1.6 #82

anfeng opened this issue Feb 9, 2017 · 4 comments

Comments

@anfeng
Copy link

anfeng commented Feb 9, 2017

Is there any reason that you only support Hadoop 2.4 for Spark 1.6?
It will be lovely if you could also support Hadoop 2.6.

@WIgor
Copy link

WIgor commented Feb 22, 2017

Actually, I've made some dirty hacks here https://github.com/grammarly/spark-ec2 for my own use. Not so complex and it works, in my case. I needed in s3a support that was included to hadoop 2.6.

@shivaram
Copy link
Contributor

@WIgor would you be interested in sending a PR for this ?

@WIgor
Copy link

WIgor commented Feb 22, 2017

@shivaram Yes, I thought to update this to latest spark version. And then will send PR.

@anfeng
Copy link
Author

anfeng commented Feb 22, 2017

propose a PR #88

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants