Releases: xavierguihot/spark_helper
Releases · xavierguihot/spark_helper
Add a bunch of RDD pimps
2.0.3 Pimp RDD with fraction
Change partialMap naming to update
2.0.2 Change function name partialMap to update
Pimp RDD with a .withKey method
2.0.1 Pimp RDD with a .withKey method
2.0.0
- SparkHelper becomes a bunch of impicit classes to pimp RDDs and SparkContext.
- New helpers attached to SparkHelper
- DateHelper provide pimped versions of certain methods
- HdfsHelper becomes a singleton in order to allow setting which FileSystem Configuration
Monitor now directly creates current.ongoing instead of waiting for logs to be appeneded
v1.1.1 Monitor now directly creates current.ongoing instead of waiting for l…
Monitor becomes a singleton object! Finally looking like a real logger
v1.1.0 Monitor becomes a singleton object! Finally looking like a real logger
Add a custom sc.textFile which return an RDD of records associated to the file path they come from
v1.0.21 Add a custom sc.textFile which return an RDD of records associated to…
Test object becomes a case class
v1.0.20 Test object becomes a case class
Use case objects instead of strings to define two parameters of Test objects
v1.0.19 Use case objects instead of strings to define two parameters of Test …
Add method checking if a date is complient with a given format
v1.0.18 Add method checking if a date is complient with a given format