Skip to content

Commit

Permalink
解决缓存数据量太大清空redis的性能问题，解决url匹配不够完美问题，增加redis集合，可以随机读取url进行采集，进行多域并发，缩短…
Browse files Browse the repository at this point in the history 
…redis前缀，减少redis占用空间，增加记录采集慢的URL，增加泛域名采集，增加每个进程采集域名数量配置，
  • Loading branch information
seatle committed Jul 18, 2018
1 parent 5a89a48 commit ab3c655
Show file tree
Hide file tree
Showing 4 changed files with 1,236 additions and 381 deletions.
Loading

0 comments on commit ab3c655

Please sign in to comment.