Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Waiting period after execution does not work #634

Open
sercaanszn opened this issue Dec 16, 2024 · 2 comments
Open

Waiting period after execution does not work #634

sercaanszn opened this issue Dec 16, 2024 · 2 comments

Comments

@sercaanszn
Copy link

Hi dear friend,

I set varying waiting periods between pages to avoid cloudflare captcha. When I run Easyspider manually, it works fine.

But when I try to run it by powershell, waiting periods I set are not appyling so program gets caught by cloudflare.

What is your soluiton for this ?
Screenshot_5

@NaiboWang
Copy link
Owner

Hi, it should work by the following code at ExecuteStage/easyspider_executestage.py at lines 988-1000:

elif waitType == 1:  # 随机等待时间
    time.sleep(random.uniform(waitTime * 0.5, waitTime * 1.5))

If it still not work, maybe it's not the random time that causes the detection of cloudflare, you can try download the code and debug by yourself to see if it is the random wait's problem or other problems...

@sercaanszn
Copy link
Author

It works fine when I run through powershell now, but when I schedule via task manager, it does seem to skip the pages that require cloudflare turnstile.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants