Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Oracle Partition Table Migrate to Postgres Partition Table #157

Open
prensgold opened this issue Sep 8, 2023 · 0 comments
Open

Oracle Partition Table Migrate to Postgres Partition Table #157

prensgold opened this issue Sep 8, 2023 · 0 comments

Comments

@prensgold
Copy link

Hi ,

I ran the following command to transfer a day's partition data, approximately 12 million records, from Oracle to Postgres.
Even though I wrote Fetch 1 or 10000, I couldn't see any data in Postgres when I waited for a long time ~ about 1 hours.
but it doesn't give any error.
the partition I moved ; I can create it in source oracle in 7 minutes with create table as select.
Can we trace what he is doing or what he is waiting for?
Should I follow a different method when moving a partition table?

[root@lprddebvtb01 replicadb]# ./bin/replicadb --options-file ./conf/replicadb.conf
2023-09-08 18:57:16,753 INFO ReplicaDB:63 Running ReplicaDB version: 0.15.1
2023-09-08 18:57:16,755 INFO ReplicaDB:66 Setting verbose mode INFO
2023-09-08 18:57:16,806 INFO SqlManager:373 Truncating sink table with this command: TRUNCATE TABLE bkmgo.go_txn_msg_log_p2023_09_07
2023-09-08 18:57:16,972 INFO ReplicaTask:35 Starting TaskId-0
Sep 08, 2023 6:57:47 PM oracle.simplefan.impl.FanManager configure
SEVERE: attempt to configure ONS in FanManager failed with oracle.ons.NoServersAvailable: Subscription time out
2023-09-08 18:57:47,349 INFO SqlManager:128 TaskId-0: Executing SQL statement: SELECT * FROM (SELECT * FROM "BKMGO"."GO_TXN_MSG_LOG" PARTITION (sys_p26831) a ) where 0 = ?
2023-09-08 18:57:47,363 INFO SqlManager:148 TaskId-0: With args: 0,
2023-09-08 18:57:47,537 WARN ConnManager:188 Options source-columns and sink-columns are null, getting from Source ResultSetMetaData: ID,TXN_ID,INSTANCE_NAME,MSG_TYPE,REQUEST_IP,REQUEST_HTTP_HEADERS,MSG_DATA,CREATED_DATE,CREATED_USER,MODIFIED_DATE,MODIFIED_USER,PARTITION_DATE
2023-09-08 18:57:47,538 INFO PostgresqlManager:189 Copying data with this command: COPY bkmgo.go_txn_msg_log_p2023_09_07 (ID,TXN_ID,INSTANCE_NAME,MSG_TYPE,REQUEST_IP,REQUEST_HTTP_HEADERS,MSG_DATA,CREATED_DATE,CREATED_USER,MODIFIED_DATE,MODIFIED_USER,PARTITION_DATE) FROM STDIN WITH DELIMITER e'\x1f' ENCODING 'UTF-8'

[root@lprddebvtb01 replicadb]# cat ./conf/replicadb.conf
######################## ReplicadB General Options ########################
mode=complete
jobs=1
fetch.size=1
verbose=false
############################# Soruce Options ##############################
source.connect=jdbc:oracle:thin:@100.100.100.2:1521:source
source.user=ora2pg
source.password=
source.query=SELECT * FROM "SCHEMA"."TXN_MSG_LOG" PARTITION (sys_p26831) a
############################# Sink Options ################################
sink.connect=jdbc:postgresql://100.100.100.3:5432/target
sink.user=owner
sink.password=
sink.table=schema.txn_msg_log_p2023_09_07
[root@lprddebvtb01 replicadb]#

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant