Features
- Update SDK
Fixes
- Random crash when scraping images
- Fix log for number of scraped businesses
- Fix website extraction
Fixes
- Fixed page layout change (whole scraper was broken)
- Added support to different languages domains such as yelp.fr to input url.
Features
- Enhanced reviews with more fields:
language
,isFunnyCount
,isUsefulCount
,isCoolCount
,reviewerName
,reviewerUrl
,reviewerReviewCount
,reviewerLocation
- Scraping
reviewerName
,reviewerUrl
requires enabling personal data input fields:scrapeReviewerName
,scrapeReviewerUrl
- Added section about GDPR and personal data protection to README
searchTerm
andlocation
deprecated in favor ofsearchTerms
andlocations
. You can scrape any number of those in a single run now.- Refactored to SDK 1
- Fixed for new layout
- Added
maxRequestRetries
to input and increased its default from2
to10
- Added
cuisine
to output - Added
website
to output - Added
images
to output
- Data format changed (refer to README.md)
- Fixed scraping information of business
- Updated SDK to 0.21+
- Minor changes to code style and linting
- Updated dependencies
priceRange
field changed from$
/$$$
to actual prices like$10-30
- Reviews dates are now a proper ISO date time string
- Review texts now contains plain text instead of HTML