Skip to content

Latest commit

 

History

History
35 lines (17 loc) · 1.53 KB

README.md

File metadata and controls

35 lines (17 loc) · 1.53 KB

MapR Yelp Tutorial

The Zeppelin notebook used in the MapR Python blog (insert link later)

Goal: Peruse the Yelp Open Dataset and plot the probability of receiving a particular rating using MatPlotLib,PySpark, SparkSQL, and MapR-DB. Tutorial assumes you’ve already uploaded the JSON dataset from here to your distributed file system and untarred it into the /user/mapr/ directory.

Step 1: Create a Python environment and store it to MapR-FS

Detailed steps for doing this with Condas can be found here. But the overall process is:

  1. Create a Python environment with Pandas and MatPlotLib:

    conda create -p mapr_yelp_tutorial/ python=2 pandas matplotlib

  2. Zip this directory up from inside the directory:

    cd mapr_yelp_tutorial/
zip -r mapr_yelp_tutorial.zip ./

  3. Store this to MapR-FS

    hadoop fs -put mapr_yelp_tutorial.zip /user/mapr/python_envs/

Step 2: Load the MapR Data Science Refinery and specify the Python archive created earlier in the Docker run command or environment variable file:

  1. Set the following variable either in the Docker Run command or in the environment variables file you’re using:

    ZEPPELIN_ARCHIVE_PYTHON=/user/mapr/python_envs/mapr_yelp_tutorial.zip

  2. Log into Zeppelin on specified host and port

  3. Download our demo notebook from this repo and import it into Zeppelin