Godwin Pang Vivian Wei Casey Price
March 14, 2019 - Godwin Pang
This document serves as a design document for the webscraping portion of the Honey For Groceries project. It will serve the purpose of documenting design iterations and considerations along with milestones along the way
The webscraping part of the Honey for Groceries project serves as the data source for the database
Describe the following:
- What is the problem that this part of the project is trying to solve?
- Why is this approach necessary to solve this problem?
Describe which problems will be fixed and which will not be fixed
Divide up the milestone into a sprint for spring quarter
Provide big picture of the technical architecture then jam pack it with details. Aim to have so many details that another engineer may be able to implement the solution that you described. Also describe file structure and how things will be done
How to run tests for the webscrapers? How to run monitor webscraping status?
List alternative architectures you have considered
A lot of websites are