Add Attachments to the challenge specification

[maxceem]

As API already supports it, we have to support adding attachments for the challenge specification.

FYI @vikasrohit

[rootelement]

Challenge API supports Attachments. You'll need to upload through the UI via the Filestack widget into the S3 bucket, then submit that s3 URL as the attachment URL. Then the challenge api will handle security and retrieval of the attachment.

[maxceem]

Thanks, @rootelement. This is how we implement it now in Work Manager. I only had an issue with creating attachments, as it didn't allow S3 bucket that I used see #737 (comment). But I guess you've already whitelisted the bucket for me, as I contacted Thomas for this. Would give some time for the deployment and try it again.

submission-staging-dev
topcoder-dev-media
tc-challenge-v5-dev

[maxceem]

@vikasrohit file uploading is done via PR #931

See demo video: https://monosnap.com/file/I4B4UsRVCtJBQv1wzraQwwvkcvibNF

Though there is some issue with config, so I use the incorrect FileStack/AWS bucket config, because it doesn't work for me with the correct one. As was clarified by @rootelement (on Slack) we have to upload challenge attachments to tc-challenge-v5-dev bucket. But if I config this bucket I get 403 error during uploading files to AWS via FileStack:

But if I only change the bucket to submission-staging-dev the same code works for me, and I can upload files to AWS via FileStack:

But Challenge API doesn't allow creating attachments with submission-staging-dev because this bucket is not whitelisted. So to be able to test I had to set the bucket tc-challenge-v5-dev for attachments when creating them in Challenge API:

So as result I upload files to submission-staging-dev but tell Challenge API that file is uploaded to tc-challenge-v5-dev so it accepts my POST requests 🤯

This might lead to the next issues I have:

• When I reload the challenge page, not all uploaded attachments are returned by Chalelnge API (even though all POST request were successful)
• I cannot download attachments as the server returns Internal server error. This is logical as I misconfigured buckets.
• I cannot remove attachments as the server returns Internal server error. This could be also logical if the server tries to clean file and cannot find it on the misconfigured bucket.

So we have to find out why we cannot upload files to tc-challenge-v5-dev AWS, while can upload to submission-staging-dev. There must be something with FileStack or AWS configuration.

[vikasrohit]

@rootelement @mtwomey can you guys help us here?

[rootelement]

I've reached out to Guna to fix the s3 bucket. @vikasrohit this is exactly like how the file upload in community app works. The idea is using the Filestack Dev key to upload to the tc-challenge-v5-dev bucket, then the challenge api should be able to read from it. I'm unclear how the frontend of filestack works, but if you're using this filestack api key in dev: AzFINuQoqTmqw0QEoaw9az you should be able to write to the tc-challenge-v5-dev bucket.

Matt and I will look into uploading to a workflow so things are virus scanned automatically.

I will confirm here when Guna has fixed the security issue.

[vikasrohit]

@rootelement Do we have confirmation for S3 bucket? @maxceem can you please give it a try in case it has been fixed?

[maxceem]

@vikasrohit it's still forbidden for tc-challenge-v5-dev bucket:

[maxceem]

@vikasrohit Uploading attachments work well now end-to-end now.

There is only one issue with Challenge API when adding multiple attachments at once:

• we send multiple POST /challenges/:id/attachments requests in parallel and all of them are successful
• but after I reload the challenge GET /challenge/:id returns only one attachment

See demo video https://monosnap.com/file/mVqe0igPbDIa68bUepKwRujaTU0mQN

Example challenge 29d3d66f-d87f-402f-882f-258235ac7a6f on DEV.

I've logged an issue on Challenge API topcoder-platform/challenge-api#348.
FYI @ThomasKranitsas