Skip to content

Demonstrates Apache Spark's developer plugins with small and meaningful examples

License

Notifications You must be signed in to change notification settings

falarica/spark-devplugins

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

spark-devplugins

Apache Spark is a highly extensible framework. It has given multiple plugin points to customize the behavior. Some of the plugins are well known. But many of them are developer oriented and are not documented. This work in spark-devplugins git repository is about demonstrating those extensions using small and meaningful examples.

Every project in spark-devplugins repo demonstrates a plugin with an example. There is associated documentation for each of those plugins. In the git repo, tests for the plugins are also added. The tests not only tests the project but also demonstrates the behavior of the plugin in a detailed way.

Currently, the repo is built with Spark 2.3.1.

Documentation can be found here.

About

Demonstrates Apache Spark's developer plugins with small and meaningful examples

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages