Node.js script to transfer DynamoDB table to MySQL
All you need to do is create config.json file in that same directory as such:
{
"aws":
{
"key": "AWS_ACCESS_KEY",
"secret": "AWS_SECRET_KEY",
"region": "AWS_REGION",
"limit": DYNAMODB_LIMIT_ROWS_PER_READ
},
"mysql":
{
"host": "MYSQL_HOST",
"port": "MYSQL_PORT",
"user": "MYSQL_USER",
"password": "MYSQL_PASSWORD",
"database": "MYSQL_DATABASE_NAME"
}
}
If you want to notify on transfer complete or execution fails, you should add section "notify" in config.json as such:
{
"aws":
{
"key": "AWS_ACCESS_KEY",
"secret": "AWS_SECRET_KEY",
"region": "AWS_REGION",
"limit": DYNAMODB_LIMIT_ROWS_PER_READ
},
"mysql":
{
"host": "MYSQL_HOST",
"port": "MYSQL_PORT",
"user": "MYSQL_USER",
"password": "MYSQL_PASSWORD",
"database": "MYSQL_DATABASE_NAME"
},
"notify":
{
"sender": "[email protected]",
"recipient": "[email protected]",
}
}
Notification using Amazon SES.
The output is executed sql.
You'll need to install a few modules, including:
- aws-sdk
- commander
- mysql
typically, to use you should run:
node dynamodb2mysql.js -s dynamodb_table_name -d mysql_table_name > output.sql
Full options list is:
-h, --help output usage information
-V, --version output the version number
-s, --source [tablename] The source (DynamoDB) table
-d, --destination [tablename] The destination (MySQL) table
--destroy Destroy source (DynamoDB) table on transfer complete
--notify Notify by Amazon SES on transfer complete
-e, --execute [filename] The SQL file will be executed on transfer complete
Big thanks to DynamoDBtoCSV and Dynamo-archive repositories for knowledge