Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add gristle_deduper #55

Open
kenfar opened this issue Jan 28, 2015 · 0 comments
Open

Add gristle_deduper #55

kenfar opened this issue Jan 28, 2015 · 0 comments

Comments

@kenfar
Copy link
Owner

kenfar commented Jan 28, 2015

Deduping files using unix utilities is unnecessarily complex - since the sort and uniq commands compare the entire row, not just a key, do not ignore parts of the row, and remove all duplicates rather than all, but one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant