Skip to content

It is a script which is used to download table from a specific site. I used the scrapy to get 15000 links and saved tables from these links using request which exceded 12 lakh excel rows. It is very fast data can be extracted within day when script is completed.

Notifications You must be signed in to change notification settings

faniAhmed/Scrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Scrapy

It is a script which is used to download table from a specific site. I used the scrapy to get 15000 links and saved tables from these links using request which exceded 12 lakh excel rows. It is very fast data can be extracted within day when script is completed. I have added demo links and output csv file which is converted to excel using pandas, a module in python

About

It is a script which is used to download table from a specific site. I used the scrapy to get 15000 links and saved tables from these links using request which exceded 12 lakh excel rows. It is very fast data can be extracted within day when script is completed.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages