Skip to content

Web Crawler made in python.A web crawler, crawler or web spider, is a computer program that's used to search and automatically index website content and other information over the internet

Notifications You must be signed in to change notification settings

atif044/Web-Crawler

Repository files navigation

Web-Crawler

It is a Operating system project and threading is involved Web Crawler made in python.A web crawler, crawler or web spider, is a computer program that's used to search and automatically index website content and other information over the internet

Run the main.py file there are two options search by content and search by query

if you search by query you just have to enter the keyword you want to crawl for and it will give you the result if you search by content you have to enter the url link of any website such as "https://www.youtube.com" it will give you all the links inside youtube

About

Web Crawler made in python.A web crawler, crawler or web spider, is a computer program that's used to search and automatically index website content and other information over the internet

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages