Skip to content

Latest commit

 

History

History
7 lines (7 loc) · 424 Bytes

README.md

File metadata and controls

7 lines (7 loc) · 424 Bytes

scrapy

Web Scrapper

  • The notebook contains the code for my process in extracting jobs from the ihub jobs website
  • I saved the jobs as a json file that I'll export to mongodb
  • Exporting to mongodb via this terminal command mongoimport --db scrapy --collection jobs --file ihub.json --jsonArray
  • Check out the scrapy-edge repository where I build a flask endpoint to expose the jobs.