Add non-www switch

[szepeviktor]

While checking a www website manually I've noticed there are non-www (broken?) links.

  website_url: 'https://www.website.test'
  include_url_prefix: 'https://www.website.test'
  resolve_before_filtering: 'true'

Please consider adding a www switch that includes/follows non-www links.

[szepeviktor]

And maybe the reverse too

  website_url: 'https://website.test'
  include_url_prefix: 'https://website.test'
  resolve_before_filtering: 'true'

that includes/follows www links.

[ScholliYT]

Are you talking about following links like https://www.website.test given the following config:

  website_url: 'https://website.test'
  include_url_prefix: 'https://website.test'
  resolve_before_filtering: 'true'
  auto_follow_www: 'true'

Can you maybe add a real website where the Issue exists? That would be very helpful.

[szepeviktor]

Thank you for your response!

Here it is
https://github.com/szepeviktor/bankitamas.hu_404/runs/7287428037?check_suite_focus=true

This website has many non-www links, e.g. on this page https://www.bankitamas.hu/bekapcsol.html

[szepeviktor]

This seems to change things.
include_url_prefix: "https://www.bankitamas.hu,https://bankitamas.hu"
But I'd like to keep this issue open.

[ScholliYT]

Yes, the current solution is to include both the www and non-www version in include_url_prefix.

Maybe a solution allowing you to specify prefixes / subdomains (e.g., www to auto follow for all domains would be a general solution to this.