Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Control over -storage-field output directory name and location and other -sf odds and ends #401

Open
ruevaughn opened this issue Apr 8, 2023 · 0 comments
Labels
Type: Enhancement Most issues will probably ask for additions or changes.

Comments

@ruevaughn
Copy link

ruevaughn commented Apr 8, 2023

Please describe your feature request:

It would be very useful in my case to be able to control the directory that -sf or -store-field gets placed in. Currently it is statically chosen 'katana_field'. -sfd or -store-field-dir would do the trick, and would match the -srd syntax.

Having control over the naming of the files and whether they are globbed together or split out into individual files would be handy as well. Something like:

katana -sf url,qurl -sfd redacted.com -store-field-output glob
Would result in

>  ls -la redacted.com/
-rw-r--r--   1 user  staff   1807 Apr  2 11:48 all_katana_urls.txt
-rw-r--r--   1 user  staff     38 Apr  2 11:48 all_katana_qurls.txt 

And the original request would be something like:
katana -sf url,qurl -sfd $outputdir/urls
Would result in something like

> ls -la $outputdir/urls/
-rw-r--r--   1 user  staff   1807 Apr  2 11:48 https_fiveoclock.redacted.com_url.txt
-rw-r--r--   1 user  staff     38 Apr  2 11:48 http_redacted.com_url.txt
-rw-r--r--   1 user  staff     65 Apr  2 11:50 http_www.redacted.com_url.txt
-rw-r--r--   1 user  staff  65337 Apr  2 12:05 https_www.redacted.com_url.txt
-rw-r--r--   1 user  staff   7262 Apr  2 12:05 https_help.redacted.com_url.txt
-rw-r--r--   1 user  staff  10301 Apr  2 12:05 https_redacted.com_url.txt
-rw-r--r--   1 user  staff     90 Apr  6 08:33 http_fiveoclock.redacted.com_qurl.txt
-rw-r--r--   1 user  staff     43 Apr  6 08:33 http_proofs.redacted.com_qurl.txt
-rw-r--r--   1 user  staff     92 Apr  6 08:33 https_app.redacted.com_qurl.txt
-rw-r--r--   1 user  staff     50 Apr  6 08:33 https_auth.redacted.com_qurl.txt
-rw-r--r--   1 user  staff    325 Apr  6 08:33 https_fiveoclock.redacted.com_qurl.txt
-rw-r--r--   1 user  staff   1927 Apr  6 08:33 https_mpg-builder-redacted.redacted.app_qurl.txt
-rw-r--r--   1 user  staff  76736 Apr  6 08:33 https_www.redacted-factory.de_qurl.txt
-rw-r--r--   1 user  staff  27956 Apr  6 08:33 https_www.redacted.com_qurl.txt
-rw-r--r--   1 user  staff    141 Apr  6 08:33 https_www.redacted.com_qurl.txt
-rw-r--r--   1 user  staff   1193 Apr  6 08:33 https_www.redacted.com_qurl.txt
-rw-r--r--   1 user  staff    762 Apr  6 08:33 https_zookeeper.redacted.com_qurl.txt

Describe the use case of this feature:

I have a bash script that is using Katana, and I have to tailor the entire script around the fact that katana_field directory is output in the working directory that the script is in instead of just being able to specify it

@ruevaughn ruevaughn added the Type: Enhancement Most issues will probably ask for additions or changes. label Apr 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: Enhancement Most issues will probably ask for additions or changes.
Projects
None yet
Development

No branches or pull requests

1 participant