Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V1.4.4 #512

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open

V1.4.4 #512

wants to merge 9 commits into from

Conversation

flarco
Copy link
Collaborator

@flarco flarco commented Feb 24, 2025

No description provided.

- Increased the buffer size of the csv.NewWriter to improve performance.  The new size is 409600 bytes (40KB).  This should reduce the number of writes to disk, leading to faster CSV generation.
- Fixed a potential resource leak by ensuring the temporary file is closed before being removed.  The `defer` statement now correctly closes the file handle before removing the temporary file.
- Updated the mapping for the `float` type in the `types_general_to_native.tsv` file to accurately reflect its native representation in various database systems.  The previous mapping was inconsistent and caused issues with data type conversions.  The change ensures consistent and correct type handling.
- Expanded the accent removal logic in the `Transformers` struct to handle a wider range of special characters, including Polish characters and other variations.
- Added specific mappings for various accented characters to their closest ASCII equivalents.
- This enhances the accuracy and consistency of accent removal during stream processing.
- Prevent erroring when listing a non-existent directory.
- Return an empty FileNodes instead.
- Added check for nil update column and return error if found.
- Improved error message clarity.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant