-
Notifications
You must be signed in to change notification settings - Fork 0
Conversation
a8f53aa
to
7dc0905
Compare
160430f
to
b9a4886
Compare
Codecov ReportAttention:
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## main #347 +/- ##
==========================================
- Coverage 67.03% 62.15% -4.89%
==========================================
Files 10 10
Lines 1611 1633 +22
==========================================
- Hits 1080 1015 -65
- Misses 493 583 +90
+ Partials 38 35 -3
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
b9a4886
to
09ad062
Compare
Code looks good, but I'm a bit worried about the amount of unit tests cut, do all need to go? I see the added other tests ("integration"), but think we could have both. (and now I reread the top again and is less worried.) |
Also, I'm curious, I hope (and believe) I didn't break anything when I added random access to the crypt4gh golang. |
We were using the datalistpackets, and I am sure they worked previously. I remember testing, but we don't have a test to see when and if they were actually broken |
marking as draft as we test more things |
@pontus we tried to make it work with large file chunks but we see that chunks larger than ~5Mb don't work |
d6a6e93
to
53c1c36
Compare
@pontus i made it work with the example reader you created; it was my mistake trying to be fancy about how to work with it, now sda-download works with larger files as well, however the problem with the data edit list still exists in crypt4gh how we were using it previously |
f19c273
to
2cc065c
Compare
2cc065c
to
04f0ff6
Compare
When this PR is merged can we archive this repo so that all future work gets done in neicnordic/sensitive-data-archive? |
yes, but there were some issues @aaperis reported i will see if i can replicate |
99fca36
to
81d7cc3
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hopefully, problem solved :-)
I believe the issue was that the logic for seeking the first byte where the byte range will be read was missing. As a consequence, download
was always starting from byte 1. With the suggested change, sda-download
, the read example from the crypt4gh
repo and dd
tests all agree. I also made some suggestions about the integration tests. Ideally, for the later we should use a small bam file when we migrate to the merged repo.
you are right, i think i had it there, but in the confusion of me rewriting that piece many times and bad tests, i did not spot it |
3d02749
to
511b5dc
Compare
511b5dc
to
6810871
Compare
Co-authored-by: Alex Aperis <[email protected]>
6810871
to
03449f4
Compare
does this fix the coordinates ... well yes :) does it remove a lot of the unit tests ... yes
Tests will be revamped when we move to new repo with issue neicnordic/sensitive-data-archive#410
inspired by: https://github.com/neicnordic/crypt4gh/blob/master/examples/reader/main.go