Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ability download extensions based #59

Open
moashxer opened this issue Sep 12, 2022 · 3 comments
Open

Ability download extensions based #59

moashxer opened this issue Sep 12, 2022 · 3 comments

Comments

@moashxer
Copy link

Can download everything from https://example.com but if it is possible to download only the files for give extension with a flag like;
-f .js

https://example.com/new/jobs/file.js
https://example.com/staffs/fired.js

downloaded all the js files from example.com

@jsvine
Copy link
Owner

jsvine commented Sep 15, 2022

This is not currently possible with waybackpack. But you can get part of the way by using waybackpack --list https://example.com | grep ".js", and then use curl/wget to download those specific links.

@cblc
Copy link

cblc commented Dec 9, 2024

I don't understand your suggestion, @jsvine , because I tried the --list option and it shows just the available timestamps, not the URLs for all the files. But I see this answer is from 2012. Has the behaviour of --list changed since then? Is it possible to get the complete list of URLs for a site?

@jsvine
Copy link
Owner

jsvine commented Dec 16, 2024

Hi @cblc, that's a good question. It seems likely that I miscommunicated in that prior comment — since, you're correct, --list does not provide that functionality. My apologies. Currently, there is not a way to do this via waybackpack.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants