GitHub - NudnikShpilkis/KalmanFilter-1004: Data Polygamy Project for DSGA-1004

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 23 Commits
.ipynb_checkpoints		.ipynb_checkpoints
data		data
images		images
outliers		outliers
proposal		proposal
GWE_local.ipynb		GWE_local.ipynb
GWE_pyspark.py		GWE_pyspark.py
KModes.py		KModes.py
KModes_WoNan.py		KModes_WoNan.py
KModes_ignoreNan.py		KModes_ignoreNan.py
KModes_local.ipynb		KModes_local.ipynb
Plotting For Presentation.ipynb		Plotting For Presentation.ipynb
README.txt		README.txt
final_paper.pdf		final_paper.pdf
peof.py		peof.py
prepRDD.py		prepRDD.py
utils.py		utils.py

Repository files navigation

data - the four .tsv files we have tested our algorithms with
images - the outlier factors plots generated through our testing
proposal - project proposal

prepRDD.py - functions to find and remove missing data
GWE_pyspark.py - pyspark implementation of GWE
GWE_local.ipynb - a local python and Pandas implementation of GWE with testing done with our local data
outliers - Pyspark implementation of K-modes with resutls on the given datafiles from DUMBO (NYU HPC server)