Skip to content

shortthirdman/DataScience-Jupyter-Notebooks

Repository files navigation

Big Data MLOps Platform

Data Science and Machine Learning Jupyter Notebooks

Made withJupyter Open In Collab Binder

GitHub commit activity GitHub commit activity GitHub Created At GitHub last commit GitHub repo size Docker Image CI

Tech Stack

shortthirdman/DataScience-Jupyter-Notebooks is built on the following main stack:

Full tech stack here

Setup References

Dataset References

Docker commands

 docker system prune --all --volumes --force
 docker build --no-cache -f Dockerfile --progress=auto --compress --rm -t shortthirdman-org/bigdata-mlops-platform:latest .
docker buildx build --progress=auto --compress --rm -t shortthirdman-org/bigdata-mlops-platform:latest .
 docker run -d -n mlops -p 8888:8888 --restart unless-stopped shortthirdman-org/bigdata-mlops-platform:latest

Local Setup

  • Create a Python virtual environment and activate

    python -m venv dev
    .\dev\Scripts\activate
  • Install the packages and dependencies as listed in requirements file

    pip install -r requirements.txt --no-cache-dir --disable-pip-version-check
  • Start your development Jupyter Notebook or Jupyter Lab server

    jupyter lab --notebook-dir=.\notebooks --no-browser
    jupyter notebook
    jupyter_nbextensions_configurator
    

References