Skip to content

Redcker/aggregate_spider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

全网聚合爬虫

准备工作

安装项目所需依赖

pip install -r requirements.txt

运行单个爬虫

scrapy crawl xxxx(项目spider文件夹中的爬虫名)

运行所有爬虫

python run.py

查看结果

点击下载MongoDB Compass

About

全网聚合爬虫

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages