Skip to content
This repository has been archived by the owner on Jul 28, 2019. It is now read-only.

Latest commit

 

History

History
8 lines (5 loc) · 177 Bytes

README.md

File metadata and controls

8 lines (5 loc) · 177 Bytes

Usage

Configure urls to parse in config.py. Then, run:

scrapy runspider broken_links_spider.py -o output.json

Then check 404 items in the output.json file.