Changelog

Command Line
- fixed a bug where absolute paths were treated as relative
- new options: save, scrape, retry
Scraper
- gracefully shutdown on SIGTERM, SIGINT
Plugins
- NodeFetchPlugin:
  - new rejectUnauthorized option

Command Line
- external plugins can be specified in the config file via pluginOpts.path
- scrape progress is displayed after each scraped resource
- relative file paths are resolved to current working directory
- more verbose error messages when missing packages
- errors output to stderr
Scraper
- multiple starting urls can be defined at scrape definition level
Storage
- Project: no longer contains a single start url
Export
- scraped resources with no content are also exported as csv rows with just the url

Command Line
- supported arguments: --version, --loglevel, --logdestination, --config, --discover, --overwrite, --export, --exportType
Plugins
- NodeFetchPlugin:
  - supports br, gzip, deflate content encoding
  - added headers option with {'Accept-Encoding': 'br,gzip,deflate'} default value
RuntimeMetrics
- added memory and cpu usage constraints at process and OS level
Export
- relative and absolute export paths are now supported
Scraper
- scrape configuration contains an optional name parameter
Storage:
- Project: batchInsertResourcesFromFile allows saving project resources from external csv files

Storage:
- Project: batchInsertResources allows fast resource saving with just url and depth properties
Plugins:
- SelectResourcePlugin: removed, resources are now selected for scraping via ConcurrencyManager
- BrowserFetchPlugin: improved DOM stability check support, added gotoOptions
Scenarios:
- are now renamed to pipelines
Concurrency:
- scrape events are now emitted
- control sequential and parralel scraping behaviour at project/proxy/domain/session level
- available options: proxyPool, delay, maxRequests
- browser clients support only sequential scraping with maxRequests = 1

Storage
- Added resource.status
Browser Clients:
- Playwright
DOM Clients:
- Cheerio
- Jsdom
Plugins:
- NodeFetchPlugin: basic proxy support
- NodeFetchPlugin, BrowserFetchPlugin: improved fetch error handling for redirect, not found, internal error status
- ExtractHtmlContentPlugin, ExtractUrlsPlugin: can either run in browser or make use of a dom client
- UpsertResourcePlugin: new keepHtmlData flag
Scenarios
- browser-static-content (former static-content)
- dom-static-content
Logging
- Settings and output destination can now be customized
- Binary data no longer appears in logs, even on TRACE level

Provide feedback