- ENCODE: Encyclopedia of DNA Elements
- ENCODE Factorbook
- ChromNet ChIP-seq interactions
paper: Learning the human chromatin network using all ENCODE ChIP-seq datasets - The International Human Epigenome Consortium (IHEC) epigenome data portal
- GEO. Sequences are in .sra format, need to use sratools to dump into fastq.
- European Nucleotide Archive. Sequences are available in fastq format.
- Data bases and software from Sheirly Liu's lab at Harvard
- Blueprint epigenome
- A collection of tools and papers for nucelosome positioning and TF ChIP-seq
- review paper:Deciphering ENCODE
- EpiFactors is a database for epigenetic factors, corresponding genes and products.
- biostar handbook. My ChIP-seq chapter will be out March 2017!
-
ChIP-seq guidelines and practices of the ENCODE and modENCODE consortia
-
Practical Guidelines for the Comprehensive Analysis of ChIP-seq Data
-
Systematic evaluation of factors influencing ChIP-seq fidelity
-
ChIP–seq: advantages and challenges of a maturing technology
-
2016 review Recent advances in ChIP-seq analysis: from quality management to whole-genome annotation
-
bioinformatics paper:Features that define the best ChIP-seq peak calling algorithms compares different peak callers for TFs and histones.
-
Systematic comparison of monoclonal versus polyclonal antibodies for mapping histone modifications by ChIP-seq The binding patterns for H3K27ac differed substantially between polyclonal and monoclonal antibodies. However, this was most likely due to the distinct immunogen used rather than the clonality of the antibody. Altogether, we found that monoclonal antibodies as a class perform as well as polyclonal antibodies. Accordingly, we recommend the use of monoclonal antibodies in ChIP-seq experiments.
-
A nice small review: Unraveling the 3D genome: genomics tools for multiscale exploration
-
Three very interesting papers, Developmental biology: Panoramic views of the early epigenome
Protocols
Data downloaded from GEO usually are raw fastq files. One needs to do quality control (QC) on them.
- fastqc
- multiqc Aggregate results from bioinformatics analyses across many samples into a single report. Could be very useful to summarize the QC report.
Be careful with the peaks you get:
Active promoters give rise to false positive ‘Phantom Peaks’ in ChIP-seq experiments
It is good to have controls for your ChIP-seq experiments. A DNA input control (no antibody is applied) is prefered. The IgG control is also fine, but because so little DNA is there, you might get many duplicated reads due to PCR artifact.
For cancer cells, an input control can be used to correct for copy-number bias.
A quote from Tao Liu: who develped MACS1/2
I remember in a PloS One paper last year by Elizabeth G. Wilbanks et al., authors pointed out the best way to sort results in MACS is by -10*log10(pvalue) then fold enrichment. I agree with them. You don't have to worry about FDR too much if your input data are far more than ChIP data. MACS1.4 calculates FDR by swapping samples, so if your input signal has some strong bias somewhere in the genome, your FDR result would be bad. Bad FDR may mean something but it's just secondary.
-
The most popular peak caller by Tao Liu: MACS2. Now
--broad
flag supports broad peaks calling as well. -
TF ChIP-seq peak calling using the Irreproducibility Discovery Rate (IDR) framework and many Software Tools Used to Create the ENCODE Resource
-
SICER for broad histone modification ChIP-seq
-
HOMER can also used to call Transcription factor ChIP-seq peaks and histone modification ChIP-seq peaks.
-
permseq R package for mapping protein-DNA interactions in highly repetitive regions of the genomes with prior-enhanced read mapping. Paper on PLos Comp.
-
Ritornello: High fidelity control-free chip-seq peak calling. No input is required!
-
Tumor samples are heterogeneous containing different cell types. MixChIP: a probabilistic method for cell type specific protein-DNA binding analysis
-
Detecting broad domains and narrow peaks in ChIP-seq data with hiddenDomains tool
-
BroadPeak: a novel algorithm for identifying broad peaks in diffuse ChIP-seq datasets
-
epic: diffuse domain ChIP-Seq caller based on SICER. It is a re-writen of SICER for faster processing using more CPUs. (Will try it for broad peak for sure).
-
Cistrome: The best place for wet lab scientist to check the binding sites. Developed by Shierly Liu lab in Harvard.
-
Accounting for GC-content bias reduces systematic errors and batch effects in ChIP-Seq peak callers tool in github
Different parameters using the same program can produce drastic different sets of peaks especially for histone modifications with variable enrichment length and gaps between peaks. One needs to make a valid argument for parameters he uses
An example of different parameters for homer findPeaks
:
-
A significant proportion of transcription-factor binding sites may be nonfunctional A post from Judge Starling
-
Several papers have shown that changes of adjacent TF binding poorly correlates with gene expression change: Extensive Divergence of Transcription Factor Binding in Drosophila Embryos with Highly Conserved Gene Expression
Transcription Factors Bind Thousands of Active and Inactive Regions in theDrosophila Blastoderm
The Functional Consequences of Variation in Transcription Factor Binding
" On average, 14.7% of genes bound by a factor were differentially expressed following the knockdown of that factor, suggesting that most interactions between TF and chromatin do not result in measurable changes in gene expression levels of putative target genes. "
- paper A large portion of the ChIP-seq signal does not correspond to true binding
- BIDCHIPS: Bias-Decomposition of ChIP-seq Signals
mappability, GC-content and chromatin accessibility affect ChIP-seq read counts. - ChIP bias as a function of cross-linking time
We analyzed the dependence of the ChIP signal on the duration of formaldehyde cross-linking time for two proteins: DNA topoisomerase 1 (Top1) that is functionally associated with the double helix in vivo, especially with active chromatin, and green fluorescent protein (GFP) that has no known bona fide interactions with DNA. With short time of formaldehyde fixation, only Top1 immunoprecipation efficiently recovered DNA from active promoters, whereas prolonged fixation augmented non-specific recovery of GFP dramatizing the need to optimize ChIP protocols to minimize the time of cross-linking, especially for abundant nuclear proteins. Thus, ChIP is a powerful approach to study the localization of protein on the genome when care is taken to manage potential artifacts.
The Gene Ontology Handbook Read it for basics for GO.
- Broad Enrich
- ChIP Enrich
- GREAT predicts functions of cis-regulatory regions.
- ENCODE ChIP-seq significance tool. Given a list of genes, co-regulating TFs will be identified.
- cscan similar to the ENCODE significance tool.
- CompGO: an R package for comparing and visualizing Gene Ontology enrichment differences between DNA binding experiments
- interactive and collaborative HTML5 gene list enrichment analysis tool
- GeNets from Broad. Looks very promising.
- Bioconductor EnrichmentBrowser
- clusterProfiler by Guangchuan Yu, the author of
ChIPseeker
. - fgsea bioconductor package Fast Gene Set Entrichment Analysis.
- paper: A Comparison of Gene Set Analysis Methods in Terms of Sensitivity, Prioritization and Specificity
- ChromHMM from Manolis Kellis in MIT.
In ChromHMM the raw reads are assigned to non-overlapping bins of 200 bps and a sample-specific threshold is used to transform the count data to binary values
- Segway from Hoffman lab. Base pair resolution. Takes longer time to run.
- epicseg published 2015 in genome biology. Similiar speed with ChromHMM.
- Spectacle: fast chromatin state annotation using spectral learning. Also published 2015 in genome biology.
- chromstaR: Tracking combinatorial chromatin state dynamics in space and time
- epilogos visualization and analysis of chromatin state model data.
- Accurate promoter and enhancer identification in 127 ENCODE and Roadmap Epigenomics cell types and tissues by GenoSTAN
- Coda uses convolutional neural networks to learn a mapping from noisy to high-quality ChIP-seq data. These trained networks can then be used to remove noise and improve the quality of new ChIP-seq data. From Ashul lab.
- DeepChrome is a unified CNN framework that automatically learns combinatorial interactions among histone modification marks to predict the gene expression. (Is it really better than a simple linear model?)
- deep learning in biology
- Homer
annotatePeak
- Bioconductor package ChIPseeker by Guangchuan Yu
See an important post by him on 0 or 1 based coordinates.
Most of the software for ChIP annotation doesn't considered this issue when annotating peak (0-based) to transcript (1-based). To my knowledge, only HOMER consider this issue. After I figure this out, I have updated ChIPseeker (version >= 1.4.3) to fix the issue.
- Bioconductor package ChIPpeakAnno. There is a bug with this package, not sure if it is solved or not. Still a post from Guangchuan Yu: Bug of R package ChIPpeakAnno.
I used R package ChIPpeakAnno for annotating peaks, and found that it handle the DNA strand in the wrong way. Maybe the developers were from the computer science but not biology background.
-
annotatr Annotation of Genomic Regions to Genomic Annotations.
-
geneXtendeR computes optimal gene extensions tailored to the broadness of the specific epigenetic mark (e.g., H3K9me1, H3K27me3), as determined by a user-supplied ChIP-seq peak input file. As such, geneXtender maximizes the signal-to-noise ratio of locating genes closest to and directly under peaks
Look at a post and here describing different tools. A review paper A comprehensive comparison of tools for differential ChIP-seq analysis
-
PePr. It can also call peaks.
-
diffreps for histone. developed by Shen Li's lab in Mount Sinai who also develped ngs.plot.
-
diffbind bioconductor package. Internally uses RNA-seq tools: EdgR or DESeq. Most likely, I will use this tool.
-
ChIPComp. Very little tutorial. Now it is on bioconductor.
-
csaw bioconductor package. Tutorial here
-
chromDiff. Also from from Manolis Kellis in MIT. Similar with ChromHMM, documentation is not that detailed. Will have a try on this.
-
paper Identifying differential transcription factor binding in ChIP-seq
- HOMER. It has really detailed documentation. It can also be used to call peaks.
For TF ChIP-seq, one can usually find the summit of the peak (macs14 will report the summit), and extend the summit to both sides to 100bp-500bp. One can then use those 100bp-500 bp small regions to do motif analysis. Usually, oen should find the motif for the ChIPed TF in the ChIP-seq experiment if it is a DNA binding protein.
It is trickier to do motif analysis using histone modification ChIP-seq. For example, the average peak size of H3K27ac is 2~3 kb. If one wants to find TF binding motifs from H3K27ac ChIP-seq data, it is good to narrow down the region a bit. MEME and many other motif finding tools require that the DNA sequence length to be small (~500bp). One way is to use findPeaks
in homer turning on -nfr
(nucleosome free region) flag, and then do motif analysis in those regions.
suggestions for finding motifs from histone modification ChIP-seq data from HOMER page:
Since you are looking at a region, you do not necessarily want to center the peak on the specific position with the highest tag density, which may be at the edge of the region. Besides, in the case of histone modifications at enhancers, the highest signal will usually be found on nucleosomes surrounding the center of the enhancer, which is where the functional sequences and transcription factor binding sites reside. Consider H3K4me marks surrounding distal PU.1 transcription factor peaks. Typically, adding the -center >option moves peaks further away from the functional sequence in these scenarios.
Other strategy similar to -nfr
was developed in this paper: Dissecting neural differentiation regulatory networks through epigenetic footprinting. In the method part of the paper, the authors computed a depletion score within the peaks, and use the footprinted regions to do motif analysis. (Thanks kadir for pointing out the paper)
I just found PARE. PARE is a computational method to Predict Active Regulatory Elements, specifically enhancers and promoters. H3K27ac and H3K4me can be used to define active enhancers.
- MEME suite. It is probably the most popular motif finding tool in the papers. protocol:Motif-based analysis of large nucleotide data sets using MEME-ChIP
- JASPAR database
- pScan-ChIP
- MotifMap
- RAST Regulatory Sequence Analysis Tools.
- ENCODE TF motif database
- oPOSSUM is a web-based system for the detection of over-represented conserved transcription factor binding sites and binding site combinations in sets of genes or sequences.
- my post how to get a genome-wide motif bed file
- Many other tools here
- A review of ensemble methods for de novo motif discovery in ChIP-Seq data
- melina2. If you only have one sequence and want to know what TFs might bind there, this is a very useful tool.
- STEME. A python library for motif analysis. STEME started life as an approximation to the Expectation-Maximisation algorithm for the type of model used in motif finders such as MEME. STEME’s EM approximation runs an order of magnitude more quickly than the MEME implementation for typical parameter settings. STEME has now developed into a fully-fledged motif finder in its own right.
- CENTIPEDE: Transcription factor footprinting and binding site prediction. Tutorial
- msCentipede: Modeling Heterogeneity across Genomic Sites and Replicates Improves Accuracy in the Inference of Transcription Factor Binding
- DiffLogo: A comparative visualisation of sequence motifs
- Weeder (version: 2.0)
- MCAST: scanning for cis-regulatory motif clusters Part of MEME suite.
- Sequence-based Discovery of Regulons iRegulon detects the TF, the targets and the motifs/tracks from a set of genes.
- Regulatory genomic toolbox
- Parse TF motifs from public databases, read into R, and scan using 'rtfbs'
- Romulus: Robust multi-state identification of transcription factor binding sites from DNase-seq data: Romulus is a computational method to accurately identify individual transcription factor binding sites from genome sequence information and cell-type--specific experimental data, such as DNase-seq. It combines the strengths of its predecessors, CENTIPEDE and Wellington, while keeping the number of free parameters in the model robustly low. The method is unique in allowing for multiple binding states for a single transcription factor, differing in their cut profile and overall number of DNase I cuts.
- moca: Tool for motif conservation analysis
The fancy "supper-enhancer" term was first introduced by Richard Young in Whitehead Institute. Basically, super-enhancers are enhancers that span large genomic regions(~12.5kb). The concept of super-enhancer is not new. One of the most famous example is the Locus Control Region (LCR) that controls the globin gene expression, and this has been known for decades.
A review in Nature Genetics What are super-enhancers?
paper: Genetic dissection of the α-globin super-enhancer in vivo
By generating a series of mouse models, deleting each of the five regulatory elements of the α-globin super-enhancer individually and in informative combinations, we demonstrate that each constituent enhancer seems to act independently and in an additive fashion with respect to hematological phenotype, gene expression, chromatin structure and chromosome conformation, without clear evidence of synergistic or higher-order effects.
paper: Hierarchy within the mammary STAT5-driven Wap super-enhancer
paper: Enhancers and super-enhancers have an equivalent regulatory role in embryonic stem cells through regulation of single or multiple genes
From the HOMER page How finding super enhancers works:
Super enhancer discovery in HOMER emulates the original strategy used by the Young lab. First, peaks are found just like any other ChIP-Seq data set. Then, peaks found within a given distance are 'stitched' together into larger regions (by default this is set at 12.5 kb). The super enhancer signal of each of these regions is then determined by the total normalized number reads minus the number of normalized reads in the input. These regions are then sorted by their score, normalized to the highest score and the number of putative enhancer regions, and then super enhancers are identified as regions past the point where the slope is greater than 1.
Example of a super enhancer plot:
In the plot above, all of the peaks past 0.95 or so would be considered "super enhancers", while the one's below would be "typical" enhancers. If the slope threshold of 1 seems arbitrary to you, well... it is! This part is probably the 'weakest link' in the super enhancer definition. However, the concept is still very useful. Please keep in mind that most enhancers probably fall on a continuum between typical and super enhancer status, so don't bother fighting over the precise number of super enhancers in a given sample and instead look for useful trends in the data.
Using ROSE from Young lab
ROSE: RANK ORDERING OF SUPER-ENHANCERS
**imPROSE - Integrated Methods for Prediction of Super-Enhancers
WiggleTools
bigwig tool
bigwig-python
samtools
bedtools my all-time favorite tool from Araon Quinlan' lab. Great documentation!
Hosting bigWig for UCSC visualization
My first play with GRO-seq data, from sam to bedgraph for visualization
convert bam file to bigwig file and visualize in UCSC genome browser in a Box (GBiB)
The genomic association tester (GAT)
poverlap from Brent Pedersen. Now he is working with Aaron Quinlan at university of Utah.
Genometric Correlation (GenometriCorr): an R package for spatial correlation of genome-wide interval datasets
Location overlap analysis for enrichment of genomic ranges bioconductor package.
regioneR Association analysis of genomic regions based on permutation tests
similaRpeak: Metrics to estimate a level of similarity between two ChIP-Seq profiles
Beta from Shirley Liu's lab in Harvard. Tao Liu's previous lab.
Many papers draw meta-plot and heatmap on certain genomic regions (2kb around TSS, genebody etc) using ChIP-seq data.
See an example from the ngs.plot:
Tools
-
deeptools.It can do many others and have good documentation. It can also generate the heatmaps, but I personally use ngs.plot which is esy to use. (developed in Mount Sinai).
-
you can also draw heatmaps using R. just count (using either Homer or bedtools) the ChIP-seq reads in each bin and draw with heatmap.2 function. here and here. Those are my pretty old blog posts, I now have a much better idea on how to make those graphs from scratch.
-
You can also use bioconductor Genomation. It is very versatile.
-
EnrichedHeatmaps from Zuguang Gu based on his own package
ComplexHeatmaps
. This is now my default go-to because of the flexiability of the package and the great user support. Thx! -
A biostar post discussing the tools: Visualizations of ChIP-Seq data using Heatmaps
-
Fluff is a Python package that contains several scripts to produce pretty, publication-quality figures for next-generation sequencing experiments I just found it 09/01/2016. looks promising especially for identifying the dynamic change.
One cavet is that the meta-plot (on the left) is an average view of ChIP-seq tag enrichment and may not reflect the real biological meaning for individual cases.
See a post from Lior Patcher How to average genome-wide data
I replied the post:
for ChIP-seq, in addition to the average plot, a heatmap that with each region in each row should make it more clear to compare (although not quantitatively). a box-plot (or a histogram) is better in this case . I am really uncomfortable averaging the signal, as a single value (mean) is not a good description of the distribution.
By Meromit Singer:
thanks for the paper ref! Indeed, an additional important issue with averaging is that one could be looking at the aggregation of several (possibly very distinct) clusters. Another thing we should all keep in mind if we choose to make such plots..
A paper from Genome Research Ubiquitous heterogeneity and asymmetry of the chromatin environment at regulatory elements
- FANTOM project CAGE for promoters and enhancers.
- DENdb: database of integrated human enhancers
- VISTA enhancer browser
- Super-enhancer database
- Genome-wide identification and characterization of HOT regions in the human genome
- EnhancerAtlas: a resource for enhancer annotation and analysis in 105 human cell/tissue types
- review: Computational Tools for Stem Cell Biology
- Assessing Computational Methods for Transcription Factor Target Gene Identification Based on ChIP-seq Data
- Protein binding and methylation on looping chromatin accurately predict distal regulatory interactions
- i-cisTarget
- protocol iRegulon and i-cisTarget: Reconstructing Regulatory Networks Using Motif and Track Enrichment
- Model-based Analysis of Regulation of Gene Expression: MARGE from Shirley Liu's lab. MARGE is a robust methodology that leverages a comprehensive library of genome-wide H3K27ac ChIP-seq profiles to predict key regulated genes and cis-regulatory regions in human or mouse.
- PrESSto: Promoter Enhancer Slider Selector Tool
- TargetFinder. paper: Enhancer–promoter interactions are encoded by complex genomic signatures on looping chromatin
- WASP: allele-specific software for robust molecular quantitative trait locus discovery
- ABC -- (Allele-specific Binding from ChIP-Seq)
- SNPsplit: Allele-specific splitting of alignments between genomes with known SNP genotypes
- BaalChIP: Bayesian analysis of allele-specific transcription factor binding in cancer genomes. bioconductor pacckage, seems to be very useful.
- RegulomeDB Use RegulomeDB to identify DNA features and regulatory elements in non-coding regions of the human genome by entering dbSNP id, chromosome regions or single Nucleotides.
- motifbreakR A Package For Predicting The Disruptiveness Of Single Nucleotide Polymorphisms On Transcription Factor Binding Sites.
- GERV: A Statistical Method for Generative Evaluation of Regulatory Variants for Transcription Factor Binding From the same group as above.
- PRIME: Predicted Regulatory Impact of a Mutation in an Enhancer
- paper: Which Genetics Variants in DNase-Seq Footprints Are More Likely to Alter Binding? website
- paper: Large-scale identification of sequence variants influencing human transcription factor occupancy in vivo
- A Sicence paper:Survey of variation in human transcription factors reveals prevalent DNA binding changes
- paper Estimating the functional impact of INDELs in transcription factor binding sites: a genome-wide landscape
- paper: Mutational Biases Drive Elevated Rates of Substitution at Regulatory Sites across Cancer Types
- paper: Recurrent promoter mutations in melanoma are defined by an extended context-specific mutational signature
- In-silico Search for co-occuring transcription factors: INSECT
- INSECT 2
- CO-factors associated with Uniquely-bound GEnomic Regions:COUGER
- bioconductor annotation package phastCons100way.UCSC.hg19 see this post how to use it.
methylPipe and compEpiTools: a suite of R packages for the integrative analysis of epigenomics data
Copy number information from targeted sequencing using off-target reads bioconductor CopywriteR package.
3CPET: Finding Co-factor Complexes in Chia-PET experiment using a Hierarchical Dirichlet Process
- RASQUAL (Robust Allele Specific QUAntification and quality controL) maps QTLs for sequenced based cellular traits by combining population and allele-specific signals. paper: Fine-mapping cellular QTLs with RASQUAL and ATAC-seq
- ATAC-seq Forum
- Single-cell ATAC-Seq
- Global Prediction of Chromatin Accessibility Using RNA-seq from Small Number of Cells from RNA-seq to DNA accessibility. tool on github
- NucleoATAC:Python package for calling nucleosomes using ATAC-Seq data
- pyDNase - a library for analyzing DNase-seq data. paper: Wellington-bootstrap: differential DNase-seq footprinting identifies cell-type determining transcription factors
- paper: Analysis of computational footprinting methods for DNase sequencing experiments tool
- Two nature prime: Genome-wide footprinting: ready for prime time? Genomic footprinting
- PING biocondcutor package: Probabilistic inference for Nucleosome Positioning with MNase-based or Sonicated Short-read Data
- Basset Convolutional neural network analysis for predicting DNA sequence activity]
- ChIA-PET2 a versatile and flexible pipeline for analysing different variants of ChIA-PET data
- TopDom : An efficient and Deterministic Method for identifying Topological Domains in Genomes
- DBPnet: Inferring cooperation of DNA binding proteins in 3D genome
- Systematic identification of cooperation between DNA binding proteins in 3D space
- DiffHiC package maintained by Aaron Lun, who is the author of csaw and InteractionSet as well.
- protocol:Practical Analysis of Genome Contact Interaction Experiments
- 4D genome: a general repository for chromatin interaction data
- CCSI: a database providing chromatin–chromatin spatial interaction information. only hg38 for human and mm10 for mouse.
- LOGIQA is a database hosting local and global quality scores assessed over long-range interaction assays (e.g. Hi-C).Based on the concept applied by the NGS-QC Generator over ChIP-seq and related datasets, LOGIQA infers quality indicators by the comparison of multiple sequence reads random sampling assays.
- Computational Identification of Genomic Features That Influence 3D Chromatin Domain Formation
- Feng Yue's lab in PSU developed tools for Hi-C, 4C
- QuIN: A Web Server for Querying and Visualizing Chromatin Interaction Networks
- paper: Three-dimensional disorganization of the cancer genome occurs coincident with long-range genetic and epigenetic alterations
- Exploring long-range genome interactions using the WashU Epigenome Browse
- MAPPING OF LONG-RANGE CHROMATIN INTERACTIONS BY PROXIMITY LIGATION ASSISTED CHIP-SEQ
- HiChIP: Efficient and sensitive analysis of protein-directed genome architecture HiChIP improves the yield of conformation-informative reads by over 10-fold and lowers input requirement over 100-fold relative to ChIA-PE
- A Compendium of Chromatin Contact Maps Reveals Spatially Active Regions in the Human Genome paper from Bing Ren's group. 21 tissue-specific TADs.