Can't bypass nowsecure.nl

[Kotov584]

I tried to test this package and found that it can be detected by cloudflare used on nowsecure.nl website I also did attempt to find captcha in html automatically to click on it but unsuccessful

[Chetan11-dev]

Try this https://www.omkar.cloud/bose/docs/tutorial/#undetected-driver.
Also, as per Ultrafunkamsterdam’s Undetected Driver it should work with clean IP.

[Kotov584]

Man I'm not this dumb

[Chetan11-dev]

What do you mean? Does it not work?

[Kotov584]

On this website no
For other websites it works ok

[Kotov584]

I will try on different machine later

[gameuser1982]

Yeah I just tested it on a clean ip that passes the cloudflare anti bot filter with a normal non webdriver controlled Chrome browser and it doesn't ask for captcha checkbox. It redirects to actual site after a few seconds.

But it detects botasaurus framework even with AntiDetectDriver. It throws up a captcha checkbox if I use botasaurus, a clicking the captcha checkbox causes it to go in infinite loop. Does Botasaurus suppress the webdriver fingerprint? My understanding is default Selerium webdriver announces itself with a special fingerprint that can be detected by anti bot filters.

I agree with @Kotov584 that this framework is getting caught by bot detection if cloudflare protected site is using anti DDOS shield. Any luck with finding a solution for this @Chetan11-dev ?

Here is the code I tried:

from botasaurus import *
import time

@browser(parallel=bt.calc_max_parallel_browsers, data=["https://nowsecure.nl"])
def scrape_heading_task(driver: AntiDetectDriver, data):
    driver.google_get(data)
    time.sleep(30)
    heading = driver.text('h1')
    print(heading)
    return heading
     

# Initiate the web scraping task
scrape_heading_task()

[Chetan11-dev]

No Luck :(, tried with puppeteer, playwright, undetected all were getting detected.

[gameuser1982]

Is it because nowsecure.nl is using a higher level of cloudflare protection or is there something else going on? As other sites with the cloudflare anti DDOS shield do seem to work.

[Chetan11-dev]

@gameuser1982 @Kotov584, Botasaurus can now visit https://nowsecure.nl
See the truth for yourself by running this code:

from botasaurus import *
from botasaurus.create_stealth_driver import create_stealth_driver

@browser(
    create_driver=create_stealth_driver(
        start_url="https://nowsecure.nl/",
    ),
)
def scrape_heading_task(driver: AntiDetectDriver, data):
    driver.prompt()
    heading = driver.text('h1')
    return heading

scrape_heading_task()    

Also, update update botasaurus by running

python -m pip install botasaurus --upgrade