Backup S3 bucket to local borg repository

[pgtaboada]

Hi,

I need to backup a S3 repo locally. What is the best approach?

[ThomasWaldmann]

borg only supports "filesystem" as method of accessing input (backup source) data (not: "remote repository").

so you'ld need a "S3 filesystem" and mount it locally, maybe check if there is something like that as a FUSE filesystem. alternatively, you could pull stuff out from S3 by any means, store it in local filesystem and then backup that with borg.

[RonnyPfannschmidt]

i think s3 would be fit as another key/value backend instead of the default one
edit: i misunderstood the source/sink direction of OP - sorry

[anarcat]

"from borg to S3" is #102, from what i understand, this is "from s3 to borg".

[ThomasWaldmann]

@anarcat thanks, confused that. @RonnyPfannschmidt please update or delete your answer.

[ThomasWaldmann]

This is some stuff a quick search gives:

• https://github.com/s3fs-fuse/s3fs-fuse
• https://github.com/danilop/yas3fs

Closing this as out of scope.

[xenithorb]

Sorry for resurrecting an old ticket, but I have a quick question:

Do you think aws s3 sync would suffice, to sync the resultant repo to S3? As far as I understand it works similarly to rsync (without the deltas I believe):

DESCRIPTION
       Syncs  directories  and S3 prefixes. Recursively copies new and updated
       files from the source directory to the destination. Only creates  fold-
       ers in the destination if they contain one or more files.

It also has a --delete option to effectively mirror

[enkore]

Should work