Skip to content

Latest commit

 

History

History
59 lines (49 loc) · 2.58 KB

how-data.md

File metadata and controls

59 lines (49 loc) · 2.58 KB
Raw
layout title date_published date_modified author maintainer
docpost
What happens to uploaded data on CLIMB
2020-03-29 23:20:00 +0000
2021-04-16 13:30:00 +0000
samstudio8
samstudio8

Basics

The CLIMB QC pipeline

Data uploaded by users to CLIMB with sufficient metadata is periodically pulled through the elan nextflow pipeline. elan is responsible for basic quality checking including the following:

  • Filtering unmapped reads to ensure this step is done, previously Elan also sorted BAMs but will now reject unsorted BAMs
  • Ensuring the BAM is valid with samtools quickcheck
  • Counting the proportion of non-ambiguous, ambigious and invalid bases in the consensus FASTA
  • Counting the proportion of positions in the aligned BAM that are above certain coverage thresholds
  • Pruning potentially spurious or human-looking reads from uploaded BAMs (for ENA uploads)
  • Where applicable, checks the depth of tiles amplified by the ARTIC protocol

Once elan has finished, the following artifacts are automatically published with a version number based on the date:

  • fasta: All consensus FASTA with the naming strategy <coguk_id>.<run_name>.climb.fasta
  • alignment: Each filtered, sorted and checked BAM with the naming strategy <coguk_id>.<run_name>.climb.bam
  • qc: A basic quality report for each COGUK ID.

Data is automatically discarded by the following criteria (QC spec v2 2021-04-16):

Basic QC (COG-UK dataset, ENA uploads)

  • Illumina
    • Average BAM depth less than 10x
    • BAM depth less than 10x over at least 50% of the reference positions
    • Consensus FASTA containing more than 50% Ns
  • Nanopore
    • Average BAM depth less than 20x
    • BAM depth less than 20x over at least 50% of the reference positions
    • Consensus FASTA containing more than 50% Ns
  • Ion Torrent
    • Average BAM depth less than 30x
    • BAM depth less than 20x over at least 50% of the reference positions
    • Consensus FASTA containing more than 50% Ns

High Quality QC (COG-UK high QC dataset, GISAID uploads)

  • Illumina
    • Average BAM depth less than 10x
    • BAM depth less than 10x over at least 10% of the reference positions
    • Consensus FASTA containing more than 10% Ns
  • Nanopore
    • Average BAM depth less than 20x
    • BAM depth less than 20x over at least 10% of the reference positions
    • Consensus FASTA containing more than 10% Ns
  • Ion Torrent
    • Average BAM depth less than 30x
    • BAM depth less than 20x over at least 10% of the reference positions
    • Consensus FASTA containing more than 10% Ns