Skip to content

Releases: xavierguihot/spark_helper

Add a bunch of RDD pimps

24 Jun 11:04
Compare
Choose a tag to compare
2.0.3

Pimp RDD with fraction

Change partialMap naming to update

23 Jun 09:03
Compare
Choose a tag to compare
2.0.2

Change function name partialMap to update

Pimp RDD with a .withKey method

18 Jun 20:51
Compare
Choose a tag to compare
2.0.1

Pimp RDD with a .withKey method

2.0.0

17 Jun 12:35
405bf5c
Compare
Choose a tag to compare
  • SparkHelper becomes a bunch of impicit classes to pimp RDDs and SparkContext.
  • New helpers attached to SparkHelper
  • DateHelper provide pimped versions of certain methods
  • HdfsHelper becomes a singleton in order to allow setting which FileSystem Configuration

Monitor now directly creates current.ongoing instead of waiting for logs to be appeneded

05 Mar 08:07
Compare
Choose a tag to compare
v1.1.1

Monitor now directly creates current.ongoing instead of waiting for l…

Monitor becomes a singleton object! Finally looking like a real logger

03 Mar 20:49
Compare
Choose a tag to compare
v1.1.0

Monitor becomes a singleton object! Finally looking like a real logger

Add a custom sc.textFile which return an RDD of records associated to the file path they come from

08 Feb 18:19
Compare
Choose a tag to compare
v1.0.21

Add a custom sc.textFile which return an RDD of records associated to…

Test object becomes a case class

05 Feb 17:01
Compare
Choose a tag to compare
v1.0.20

Test object becomes a case class

Use case objects instead of strings to define two parameters of Test objects

28 Jan 10:54
Compare
Choose a tag to compare
v1.0.19

Use case objects instead of strings to define two parameters of Test …

Add method checking if a date is complient with a given format

18 Jan 08:59
Compare
Choose a tag to compare
v1.0.18

Add method checking if a date is complient with a given format