Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filemanager: Cannot get ingest id for old fastq files #844

Open
alexiswl opened this issue Feb 1, 2025 · 1 comment
Open

Filemanager: Cannot get ingest id for old fastq files #844

alexiswl opened this issue Feb 1, 2025 · 1 comment
Assignees
Labels
filemanager an issue relating to the filemanager

Comments

@alexiswl
Copy link
Member

alexiswl commented Feb 1, 2025

Hello,

I have a set of s3 objects that do not have an ingest id, that could be because they were created before the filemanager was deployed.

It is possible for this data to be reingested?

Example:

bucket="pipeline-prod-cache-503977275616-ap-southeast-2"
key="byob-icav2/production/primary/240913_A01052_0227_BHV7CYDSXC/20240915d20fd5fc/Samples/Lane_3/L2401287/L2401287_S9_L003_R2_001.fastq.gz"
curl \
  --request GET \
  --fail-with-body \
  --silent \
  --show-error \
  --header "Authorization: Bearer $ORCABUS_TOKEN" \
  "https://file.prod.umccr.org/api/v1/s3?bucket=${bucket}&key=${key}" | \
jq '.results[0]'

Gives

{
  "s3ObjectId": "0191f347-999a-7260-a190-1860a612aef8",
  "eventType": "Created",
  "bucket": "pipeline-prod-cache-503977275616-ap-southeast-2",
  "key": "byob-icav2/production/primary/240913_A01052_0227_BHV7CYDSXC/20240915d20fd5fc/Samples/Lane_3/L2401287/L2401287_S9_L003_R2_001.fastq.gz",
  "versionId": "EDfkg6vh3rCBG8UUu_ed8xbQj4xjyYKE",
  "eventTime": "2024-09-15T01:23:59Z",
  "size": 41805097155,
  "sha256": null,
  "lastModifiedDate": "2024-09-15T01:23:50Z",
  "eTag": "\"9bab28f79fd94e081e7bd3a064429d7d-7974\"",
  "storageClass": "Standard",
  "sequencer": "0066E637251B51D28A",
  "isDeleteMarker": false,
  "numberDuplicateEvents": 0,
  "attributes": {
    "portalRunId": "20240915d20fd5fc"
  },
  "deletedDate": null,
  "deletedSequencer": null,
  "numberReordered": 0,
  "ingestId": null,
  "isCurrentState": true
}
@alexiswl
Copy link
Member Author

alexiswl commented Feb 1, 2025

Only need it for the following prefixes:

s3://pipeline-prod-cache-503977275616-ap-southeast-2/byob-icav2/production/primary/240913_A01052_0227_BHV7CYDSXC/20240915d20fd5fc/
s3://pipeline-prod-cache-503977275616-ap-southeast-2/byob-icav2/production/primary/240920_A01052_0230_AHVGW3DSXC/202409225d69d7e7/
s3://pipeline-prod-cache-503977275616-ap-southeast-2/byob-icav2/production/primary/240926_A01052_0232_AHW7LHDSXC/20240928f63332ac/
s3://pipeline-prod-cache-503977275616-ap-southeast-2/byob-icav2/production/primary/241018_A01052_0235_BHW7NKDSXC/2024102052e63883/

@mmalenic mmalenic added the filemanager an issue relating to the filemanager label Feb 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
filemanager an issue relating to the filemanager
Projects
None yet
Development

No branches or pull requests

2 participants