-
Notifications
You must be signed in to change notification settings - Fork 52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
MySQL Snapshot fails at 50m rows and keeps starting over and over again #812
Comments
@poweroftrue for MySQL, you can take a snapshot via MySQLshell (see python utilities in this project). You can dump and TB of data this way. |
Thanks @aadant! Yes I checked the tool, it's amazing it dumps TBs of data very fast, I will use it after I try couple of weeks on this issue because it fit my use case better. Having Debezium snapshot working open the door for simpler automation running this as a sidecar container for large number of MySQL services. |
Hello @aadant, I finally found what causes this issue! I was debugging if certain rows causes the interruption but it wasn't, I enabled all logs (DEBUG) from log4j.xml and I found that Debezium was asked to stop. It turned out to be
I set it to false and now it's snapshotting rows beyond 100 million. Should I add to docs that you need this disabled during the snapshot? |
Good catch ! I think it is a bug. We should fix this as it is very misleading. The connector should only restart if it is idle (this is a workaround against a Debezium bug that should be fixed in the latest releases). |
See #380 @subkanthi let us fix this even if there is a workaround. |
Hello there,
The lightweight version is a true magic, one container and you have near real time replication from MySQL to Clickhouse with all the columns moved right for you, a piece of art!
For a while now I'm debugging the issue
java.lang.InterruptedException: null
happens at ~50 million rows crashes and keep on happening.What I have tired so far:
jcmd 1 GC.heap_info
inside the container:So, it's not memory usage problem
I'm using no locks
snapshot.locking.mode: "none"
Related issue #722
What I'm trying now is attach local Intellij remote debugger, but I'm having hard time stopping on the right exception.
The text was updated successfully, but these errors were encountered: