Skip to content

Latest commit

 

History

History
41 lines (29 loc) · 873 Bytes

README.md

File metadata and controls

41 lines (29 loc) · 873 Bytes

Youtube Scraper

Lumen + PHP 7.4 + MySQL

Installing

git clone https://github.com/driule/youtube-scraper
cd path/to/youtube-scraper
composer install

Edit .env file

Setup DB

php artisan migrate:fresh

Add command scheduler to crontab

* * * * * php /path/to/project/public_html/artisan schedule:run >> /dev/null 2>&1

Scraping

Scrape Youtube channel and save/update video statistics and tags

php artisan scrape:channel UC03RvJoIhm_fMwlUpm9ZvFw

Update channel videos performance statistic

php artisan update:videos-performance UC03RvJoIhm_fMwlUpm9ZvFw

Massive Scrapping

Conceptual implementation on how to scrape Youtube channels massivevly can be found in App\Services\YoutubeScraper::scrapeChannelsMassively()