Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

removed the wc program requirement. #26

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

petedv
Copy link

@petedv petedv commented Sep 25, 2014

If done directly in python it is not OS dependent

@kmatt
Copy link

kmatt commented Sep 29, 2014

For near zero startup time, I replaced the line count with the size of the file in bytes as

num_bytes = os.path.getsize(input_filename)

then keep track the total of the line lengths as

bytes += len(line)

and calculate progress as

percentage_done = bytes / num_bytes
...
logging.write("\rLine %i (%.2f%%) [%s tables] [%s inserts] [ETA: %i min %i sec]"

I let my fork get out of sync with the master through multiple commits, otherwise I would put in a PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants