bugfix/minor_updates

[kels271828]

DESCRIPTION
Updates to get codem pipeline running.

FIXED

• Pass config path instead of object in evaluate_jobmon.py
• Commented out some code in data.py where we need to make updates for new DataInterface class
• Made updates to rover_stage.py and spxmod_stage.py for new DataInterface class
• Added ability to dump pandas data frames in interface.py
• Added mkdir statement to DataIO.dump()
• Updated logic for main.load_stage() when custom stage has same name as built-in stage
• Changed subsets.create_subsets() back to pandas and added sorting for consistent subset_id assignment
• Fixed some linting, mypy errors, and tests (but not all!)

ADDED

• Added ability to specify a directory as stage input/output in io/base.py and stage/base.py
• Added to docstrings about dataif syntax in stage/base.py
• Added args to ModelStage.get_stage_subset() to make it more generalizable
• Added "name=" to pipeline and stage __repr__ functions

REMOVED

• Removed PreprocessingStage and PreprocessingConfig (various files)

CHANGED

• Updated some variable names for clarity in evaluate_jobmon.py
• Changed stages arg in evaluate_jobmon() and evaluate_local() from list to set for consistency; added stages arg to Pipeline.get_execution_order() and moved where function gets called from Pipeline.evaluate() to evaluate_jobmon() and evaluate_local()
• Changed stage_name arg to stages in main.py
• Moved error check for calling collect method on a pipeline from main.py to pipeline.py, added error check for calling collect method on a Stage instance (as opposed to ModelStage) or with Jobmon backend to stage/base.py
• Moved function Pipeline.check_upstream_output_exists() to Input.check_missing(), added calls to Input.check_missing() in Pipeline.evaluate() and Stage.evaluate()
• Add full paths to Stage.input and Stage.output items in Stage.set_dataif

TODO

• Not all tests are passing; make separate PR?

[kels271828]

Some of these changes might need to be revisited in separate PRs. Will create tickets in JIRA.

[zhengp0]

The changes look good to me! Thanks @kels271828! Indeed we need to fix the tests soon.