Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Two phase migrate #34

Open
wants to merge 11 commits into
base: master
Choose a base branch
from
Open

Two phase migrate #34

wants to merge 11 commits into from

Conversation

josteinl
Copy link

This PR probably need more work. Please see my comments in #15. I will be working more with this in the near future.

I think this fixes #15 and #33.

… into memory at once. Not very effective yet, due to opening and closing export file for every row.
Remove dependency on specific old versions of SQLAlchemy and six.
Updated the version number to 1.0.7.
…e pointer as a parameter (not opening and closing the file for each row).
…ase. Previous method crashed with and SQL error in Oracle 11.2.
…use mysqlimport with a new parameter '--replace' that will update or insert based on the primary key.
@lyle-w
Copy link

lyle-w commented Oct 17, 2018

Hi @seanharr11 ,
Could you please help review this PR, seems this PR can resolve below issue:

TypeError: 'twophase' is an invalid keyword argument for this function

Thanks

@GuidoOeffling
Copy link

I've just used this fork[two_phase_migrate] to check if I now can work with the upseting feature on MariaDB. I was able to transfer the data of a smaller Oracle 12.2 DB with about 180 Tables to a MariaDB 10.3 where the MariaDB Tables already were created before :-)

pkej pushed a commit to pkej/etlalchemy that referenced this pull request Mar 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Large table runs into memory limit
3 participants