Skip to content

Releases: rmax/scrapy-redis

v0.9.1

06 Jul 21:54
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.9.0...v0.9.1

v0.9.0

06 Jul 21:46
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.8.0...v0.9.0

v0.8.0

02 Jul 23:05
2ef8162
Compare
Choose a tag to compare

What's Changed

  • [settings] Deprecate REDIS_START_URLS_BATCH_SIZE by @LuckyPigeon in #259
  • [spiders] Remove duplicate check setting types by @LuckyPigeon in #261
  • fix(sec): upgrade scrapy to 2.6.0 by @lifefloating in #270
  • [dev] Deprecated function scrapy.utils.request.request_fingerprint() warning by @LuckyPigeon in #275
  • [dev] Add customize fingerprint by @LuckyPigeon in #280
  • [spiders] Remove 'spider' argument to ExecutionEngine.crawl by @mic1on in #286
  • Fix test requirements and simplified tox config by @rmax in #295

New Contributors

Full Changelog: 0.7.3...v0.8.0

Version 0.7.3 Released

26 Jul 09:37
e26cabd
Compare
Choose a tag to compare

Release patch version 0.7.23:

Version 0.7.2 Released

26 Dec 20:49
60a7b02
Compare
Choose a tag to compare

Release patch version 0.7.2:

  • Add ')' to spiders.py: #202
  • Fix RedisStatsCollector._get_key(): #200
  • Fix redis-py dependency version: #199
  • Added maximum idle waiting time MAX_IDLE_TIME_BEFORE_CLOSE: #193
  • Correction of wrongly written characters: #191

Version 0.7.1 Released

27 Mar 15:33
Compare
Choose a tag to compare
  • Support priority start_urls. #172
  • Support init batch tasks. #176
  • Fixes datetime parsing error for redis-py 3.x. #190
  • Add support for stats extensions. #186
  • Support using pipeline when read redis lit queue. #169
  • Support to configure different redis-server db by adding REDIS_DB #166
  • Add option to decode responses in python3 #146
  • Add support for making dupefilter support create from spider #83
  • Fix example: update dmoz spider domain #164

v0.6.8

24 Mar 18:04
Compare
Choose a tag to compare
Release 0.6.8