Skip to content

Commit

Permalink
Increase MULTIPART_CHUNK_SIZE
Browse files Browse the repository at this point in the history
Increasing the chunk size avoids an issue where too many parts are uploaded, triggering an error when calling the S3 CompleteMultipartUpload API command.  The current limit on the number of parts per upload is 10,000 according to the S3 documentation (https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html)
  • Loading branch information
meinemitternacht authored Sep 10, 2018
1 parent 6913723 commit 7676aa9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/s3.c
Original file line number Diff line number Diff line change
Expand Up @@ -2057,7 +2057,7 @@ static int putObjectDataCallback(int bufferSize, char *buffer,
return ret;
}

#define MULTIPART_CHUNK_SIZE (15 << 20) // multipart is 15M
#define MULTIPART_CHUNK_SIZE (768 << 20) // multipart is 768M

typedef struct MultipartPartData {
put_object_callback_data put_object_data;
Expand Down

0 comments on commit 7676aa9

Please sign in to comment.