Skip to content

Latest commit

 

History

History
41 lines (25 loc) · 1.49 KB

CHANGELOG.md

File metadata and controls

41 lines (25 loc) · 1.49 KB
Raw

Change Log

All notable changes to this project will be documented in this file.

Next

0.3.0

Changed

  • When url is added via add(_:) method, and there are available spiders, scrapping starts immediately instead of waiting for previous urls to finish.

0.2.0

Breaking

  • Spider protocol no longer requires init(url:) initializer, url parameter is passed in request(url:completion:) method instead.
  • URLSessionSpider now has init() method without parameters.

Added

  • Linux support
  • ScrappableURL.userInfo property for storing values or objects related to this scrappable URL
  • Swarm.cooldown property, that allows to customize how cooldown is executed. For example, when using Swarm from Vapor app, which itself uses SwiftNIO for scheduling tasks, cooldown property can be setup in following way:
swarm.cooldown = { interval, closure in
    eventLoop.scheduleTask(in: TimeAmount.seconds(Int64(interval)), closure)
}

Changed

  • Absence of response and data is now treated as failure for network request ( request timeout ), and request is retried configuration.delayedRequestRetries times after configuration.delayedRetryDelay

Fixed

  • Action log for previous requests is now properly stored, thus allowing correct number of request retries.

0.1.0

  • Initial release