Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preview first 100 lines before importing #1

Open
simonw opened this issue Jan 27, 2020 · 0 comments
Open

Preview first 100 lines before importing #1

simonw opened this issue Jan 27, 2020 · 0 comments
Labels
enhancement New feature or request

Comments

@simonw
Copy link
Owner

simonw commented Jan 27, 2020

Importing CSV files is tricky when there's a chance they might actually be TSV, or may use an unexpected encoding or strange escaping rules.

I can address many of these issues by providing a "preview" of the CSV file before running the conversion to SQLite. The preview could operate against the first 100 rows (which can be efficiently loaded without consuming the whole file). The user can then confirm that it looks like the import is correct, or can switch to CSV or some other encoding/escaping mechanism and preview again.

This also provides the opportunity to allow the user to select the primary key, select columns that should be extracted into a separate table and select columns for indexing with FTS.

@simonw simonw added the enhancement New feature or request label Jan 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant