ChIPexoQual: A quality control pipeline for ChIP-exo/nexus data.
30 April 2018
Contents
1 Overview
In this vignette, we provide a brief overview of the ChIPexoQual package. This package provides a statistical quality control (QC) pipeline that enables the exploration and analysis of ChIP-exo/nexus experiments. In this vignette we used the reads aligned to chr1 in the mouse liver ChIP-exo experiment (Serandour et al. 2013) to illustrate the use of the pipeline. To load the packages we use:
library(ChIPexoQual)
library(ChIPexoQualExample)ChIPexoQual takes a set of aligned reads from a ChIP-exo (or ChIP-nexus) experiment as input and performs the following steps:
- Identify read islands, i.e., overlapping clusters of reads separated by gaps, from read coverage.
- Compute \(D_i\), number of reads in island \(i\), and \(U_i\), number of island \(i\) positions with at least one aligning read, \(i=1, \cdots, I\).
- For each island \(i\), \(i=1, \cdots, I\) compute island statistics: \[ \begin{align*} \mbox{ARC}_i &= \frac{D_i}{W_i}, \quad \mbox{URC}_i = \frac{U_i}{D_i}, \\ %\mbox{URC}_i &= \frac{U_i}{D_i}, \\ \mbox{FSR}_i &= \frac{(\text{Number of forward strand reads aligning to island $i$})}{D_i}, \end{align*} \]
- Generate diagnostic plots (i) URC vs. ARC plot; (ii) Region Composition plot; (iii) FSR distribution plot.
- Randomly sample \(M\) (at least 1000) islands and fit, \[ \begin{align*} D_i = \beta_1 U_i + \beta_2 W_i + \varepsilon_i, \end{align*} \] where \(\varepsilon_i\) denotes the independent error term. Repeat this process \(B\) times and generate box plots of estimated \(\beta_1\) and \(\beta_2\).
We analyzed a larger collection of ChIP-exo/nexus experiments in (Welch et al. 2016) including complete versions of this samples.
2 Creating an ExoData object
The minimum input to use ChIPexoQual are the aligned reads of a ChIP-exo/nexus experiment. ChIPexoQual accepts either the name of the bam file or the reads in a GAlignments object:
files = list.files(system.file("extdata",
package = "ChIPexoQualExample"),full.names = TRUE)
basename(files[1])## [1] "ChIPexo_carroll_FoxA1_mouse_rep1_chr1.bam" ex1 = ExoData(file = files[1],mc.cores = 2L,verbose = FALSE)
ex1## ExoData object with 655785 ranges and 11 metadata columns:
## seqnames ranges strand | fwdReads revReads
## <Rle> <IRanges> <Rle> | <integer> <integer>
## [1] chr1 3000941-3000976 * | 2 0
## [2] chr1 3001457-3001492 * | 0 1
## [3] chr1 3001583-3001618 * | 0 2
## [4] chr1 3001647-3001682 * | 1 0
## [5] chr1 3001852-3001887 * | 1 0
## ... ... ... ... . ... ...
## [655781] chr1 197192012-197192047 * | 0 1
## [655782] chr1 197192421-197192456 * | 0 1
## [655783] chr1 197193059-197193094 * | 1 0
## [655784] chr1 197193694-197193729 * | 0 3
## [655785] chr1 197194986-197195021 * | 0 2
## fwdPos revPos depth uniquePos ARC
## <integer> <integer> <integer> <integer> <numeric>
## [1] 1 0 2 1 0.0555555555555556
## [2] 0 1 1 1 0.0277777777777778
## [3] 0 1 2 1 0.0555555555555556
## [4] 1 0 1 1 0.0277777777777778
## [5] 1 0 1 1 0.0277777777777778
## ... ... ... ... ... ...
## [655781] 0 1 1 1 0.0277777777777778
## [655782] 0 1 1 1 0.0277777777777778
## [655783] 1 0 1 1 0.0277777777777778
## [655784] 0 1 3 1 0.0833333333333333
## [655785] 0 1 2 1 0.0555555555555556
## URC FSR M A
## <numeric> <numeric> <numeric> <numeric>
## [1] 0.5 1 -Inf Inf
## [2] 1 0 -Inf -Inf
## [3] 0.5 0 -Inf -Inf
## [4] 1 1 -Inf Inf
## [5] 1 1 -Inf Inf
## ... ... ... ... ...
## [655781] 1 0 -Inf -Inf
## [655782] 1 0 -Inf -Inf
## [655783] 1 1 -Inf Inf
## [655784] 0.333333333333333 0 -Inf -Inf
## [655785] 0.5 0 -Inf -Inf
## -------
## seqinfo: 1 sequence from an unspecified genome; no seqlengths reads = readGAlignments(files[1],param = NULL)
ex2 = ExoData(reads = reads,mc.cores = 2L,verbose = FALSE)
identical(GRanges(ex1),GRanges(ex2))## [1] TRUEFor the rest of the vignette, we generate an ExoData object for each replicate:
files = files[grep("bai",files,invert = TRUE)] ## ignore index files
exampleExoData = lapply(files,ExoData,mc.cores = 2L,verbose = FALSE)Finally, we can recover the number of reads that compose a ExoData object by using the nreads function:
sapply(exampleExoData,nreads)## [1] 1654985 1766665 16701172.1 Enrichment analysis and library complexity:
To create the ARC vs URC plot proposed in (Welch et al. 2016), we use the ARC_URC_plot function. This function allows to visually compare different samples:
ARCvURCplot(exampleExoData,names.input = paste("Rep",1:3,sep = "-"))
This plot typically exhibits one of the following three patterns for any given sample. In all three panels we can observe two arms: the first with low Average Read Coefficient (ARC) and varying Unique Read Coefficient (URC); and the second where the URC decreases as the ARC increases. The first and third replicates exhibit a defined decreasing trend in URC as the ARC increases. This indicates that these samples exhibit a higher ChIP enrichment than the second replicate. On the other hand, the overall URC level from the first two replicates is higher than that of the third replicate, elucidating that the libraries for the first two replicates are more complex than that of the third replicate.
2.2 Strand imbalance
To create the FSR distribution and Region Composition plots suggested in Welch et. al 2016 (submitted), we use the FSR_dist_plot and region_comp_plot, respectively.
p1 = regionCompplot(exampleExoData,names.input = paste("Rep",1:3,
sep = "-"),depth.values = seq_len(50))
p2 = FSRDistplot(exampleExoData,names.input = paste("Rep",1:3,sep = "-"),
quantiles = c(.25,.5,.75),depth.values = seq_len(100))
gridExtra::grid.arrange(p1,p2,nrow = 1)
The left panel displays the Region Composition plot and the right panel shows the Forward Strand Ratio (FSR) distribution plot, both of which highlight specific problems with replicates 2 and 3. The Region Composition plot exhibits apparent decreasing trends in the proportions of regions formed by fragments in one exclusive strand. High quality experiments tend to show exponential decay in the proportion of single stranded regions, while for the lower quality experiments, the trend may be linear or even constant. The FSR distributions of both of replicates 2 and 3 are more spread around their respective medians. The rate at which the FSR distribution becomes more centralized around the median indicates the aforementioned lower enrichment in the second replicate and the low complexity in the third one. The asymmetric behavior of the second replicate is characteristic of low enrichment, while the constant values of replicate three for low minimum number of reads indicate that this replicate has islands composed of reads aligned to very few unique positions.
2.2.1 Further exploration of ChIP-exo data
All the plot functions in ChIPexoQual allow a list or several separate ExoData objects. This allows to explore island subsets for each replicate. For example, to show that the first arm is composed of regions formed by reads aligned to few positions, we can generate the following plot:
ARCvURCplot(exampleExoData[[1]],
subset(exampleExoData[[1]],uniquePos > 10),
subset(exampleExoData[[1]],uniquePos > 20),
names.input = c("All", "uniquePos > 10", "uniquePos > 20"))
For this figure, we used the ARC vs URC plot to show how several of the regions with low ARC values are composed by reads that align to a small number of unique positions. This technique highlights a strategy that can be followed to further explore the data, as with all the previously listed plotting functions we may compare different subsets of the islands in the partition.
2.3 Quality evaluation
The last step of the quality control pipeline is to evaluate the linear model:
\[ \begin{align*} D_i = \beta_1 U_i + \beta_2 U_2 + \epsilon_i, \end{align*} \]
The distribution of the parameters of this model is built by sampling nregions regions (the default value is 1,000), fitting the model and repeating the process ntimes (the default value is 100). We visualize the distributions of the parameters with box-plots:
p1 = paramDistBoxplot(exampleExoData,which.param = "beta1", names.input = paste("Rep",1:3,sep = "-"))
p2 = paramDistBoxplot(exampleExoData,which.param = "beta2", names.input = paste("Rep",1:3,sep = "-"))
gridExtra::grid.arrange(p1,p2,nrow = 1)
Further details over this analysis are in Welch et. al 2016 (submitted). In short, when the ChIP-exo/nexus sample is not deeply sequenced, high values of \(\hat{\beta}_1\) indicate that the library complexity is low. In contrast, lower values correspond to higher quality ChIP-exo experiments. We concluded that samples with estimated \(\hat{\beta_1} \leq 10\) seem to be high quality samples. Similarly, samples with estimated \(\hat{\beta_2} \approx 0\) can be considered as high quality samples. The estimated values for these parameters can be accessed with the beta1, beta2, and param_dist methods. For example, using the median to summarize these parameter distributions, we conclude that these three replicates (in chr1) are high quality samples:
sapply(exampleExoData,function(x)median(beta1(x)))## [1] 1.902620 1.524066 8.329828 sapply(exampleExoData,function(x)median(-beta2(x)))## [1] 0.015662660 0.009949551 0.0526532382.4 Subsampling reads from the experiment to asses quality
The behavior of the third’s FoxA1 replicate may be an indication of problems in the sample. However, it is also common to observe that pattern in deeply sequenced experiments. For convenience, we added the function ExoDataSubsampling, that performs the analysis suggested by Welch et. al 2016 (submitted) when the experiment is deeply sequenced. To use this function, we proceed as follows:
sample.depth = seq(1e5,2e5,5e4)
exoList = ExoDataSubsampling(file = files[3],sample.depth = sample.depth, verbose=FALSE)The output of ExoDataSubsampling is a list of ExoData objects, therefore its output can be used with any of the plotting functions to asses the quality of the samples. For example, using we may use paramDistBoxplot to get the following figures:
p1 = paramDistBoxplot(exoList,which.param = "beta1")
p2 = paramDistBoxplot(exoList,which.param = "beta2")
gridExtra::grid.arrange(p1,p2,nrow = 1)
Clearly there are increasing trends in both plots, and since we are only using the reads in chromosome 1, we are observing fewer reads than in a typical ChIP-exo/nexus experiment. In a higher quality experiment it is expected to show lower \(\hat{\beta}_1\) and \(\hat{\beta}_2\) levels. Additionally, the rate at which the estimated \(\hat{\beta}_2\) parameter increases is going to be higher in a lower quality experiment.
3 Conclusions
We presented a systematic exploration of a ChIP-exo experiment and show how to use the QC pipeline provided in ChIPexoQual. ChIPexoQual takes aligned reads as input and automatically generates several diagnostic plots and summary measures that enable assessing enrichment and library complexity. The implications of the diagnostic plots and the summary measures align well with more elaborate analysis that is computationally more expensive to perform and/or requires additional imputes that often may not be available.
4 SessionInfo
sessionInfo("ChIPexoQual")## R version 3.5.0 (2018-04-23)
## Platform: x86_64-pc-linux-gnu (64-bit)
## Running under: Ubuntu 16.04.4 LTS
##
## Matrix products: default
## BLAS: /home/biocbuild/bbs-3.7-bioc/R/lib/libRblas.so
## LAPACK: /home/biocbuild/bbs-3.7-bioc/R/lib/libRlapack.so
##
## locale:
## [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C
## [3] LC_TIME=en_US.UTF-8 LC_COLLATE=C
## [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
## [7] LC_PAPER=en_US.UTF-8 LC_NAME=C
## [9] LC_ADDRESS=C LC_TELEPHONE=C
## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
##
## attached base packages:
## character(0)
##
## other attached packages:
## [1] ChIPexoQual_1.4.0
##
## loaded via a namespace (and not attached):
## [1] nlme_3.1-137 utils_3.5.0
## [3] ProtGenerics_1.12.0 bitops_1.0-6
## [5] matrixStats_0.53.1 bit64_0.9-7
## [7] RColorBrewer_1.1-2 progress_1.1.2
## [9] httr_1.3.1 rprojroot_1.3-2
## [11] GenomeInfoDb_1.16.0 tools_3.5.0
## [13] backports_1.1.2 R6_2.2.2
## [15] rpart_4.1-13 Hmisc_4.1-1
## [17] DBI_0.8 lazyeval_0.2.1
## [19] BiocGenerics_0.26.0 colorspace_1.3-2
## [21] nnet_7.3-12 mnormt_1.5-5
## [23] gridExtra_2.3 prettyunits_1.0.2
## [25] bit_1.1-12 curl_3.2
## [27] compiler_3.5.0 Biobase_2.40.0
## [29] htmlTable_1.11.2 datasets_3.5.0
## [31] DelayedArray_0.6.0 labeling_0.3
## [33] rtracklayer_1.40.0 bookdown_0.7
## [35] base_3.5.0 scales_0.5.0
## [37] checkmate_1.8.5 hexbin_1.27.2
## [39] psych_1.8.3.3 stringr_1.3.0
## [41] digest_0.6.15 Rsamtools_1.32.0
## [43] foreign_0.8-70 rmarkdown_1.9
## [45] XVector_0.20.0 base64enc_0.1-3
## [47] dichromat_2.0-0 pkgconfig_2.0.1
## [49] htmltools_0.3.6 ensembldb_2.4.0
## [51] BSgenome_1.48.0 grDevices_3.5.0
## [53] htmlwidgets_1.2 rlang_0.2.0
## [55] rstudioapi_0.7 RSQLite_2.1.0
## [57] ChIPexoQualExample_1.3.0 bindr_0.1.1
## [59] BiocParallel_1.14.0 acepack_1.4.1
## [61] dplyr_0.7.4 VariantAnnotation_1.26.0
## [63] RCurl_1.95-4.10 magrittr_1.5
## [65] GenomeInfoDbData_1.1.0 Formula_1.2-2
## [67] Matrix_1.2-14 Rcpp_0.12.16
## [69] munsell_0.4.3 S4Vectors_0.18.0
## [71] viridis_0.5.1 stringi_1.1.7
## [73] yaml_2.1.18 SummarizedExperiment_1.10.0
## [75] zlibbioc_1.26.0 plyr_1.8.4
## [77] grid_3.5.0 blob_1.1.1
## [79] parallel_3.5.0 methods_3.5.0
## [81] lattice_0.20-35 Biostrings_2.48.0
## [83] splines_3.5.0 GenomicFeatures_1.32.0
## [85] knitr_1.20 pillar_1.2.2
## [87] GenomicRanges_1.32.0 reshape2_1.4.3
## [89] biomaRt_2.36.0 stats4_3.5.0
## [91] XML_3.98-1.11 glue_1.2.0
## [93] evaluate_0.10.1 biovizBase_1.28.0
## [95] latticeExtra_0.6-28 data.table_1.10.4-3
## [97] graphics_3.5.0 purrr_0.2.4
## [99] gtable_0.2.0 tidyr_0.8.0
## [101] assertthat_0.2.0 ggplot2_2.2.1
## [103] xfun_0.1 broom_0.4.4
## [105] AnnotationFilter_1.4.0 viridisLite_0.3.0
## [107] survival_2.42-3 tibble_1.4.2
## [109] GenomicAlignments_1.16.0 stats_3.5.0
## [111] AnnotationDbi_1.42.0 memoise_1.1.0
## [113] IRanges_2.14.0 bindrcpp_0.2.2
## [115] cluster_2.0.7-1 BiocStyle_2.8.0References
Serandour, Aurelien, Brown Gordon, Joshua Cohen, and Jason Carroll. 2013. “Development of and Illumina-Based ChIP-Exonuclease Method Provides Insight into FoxA1-DNA Binding Properties.” Genome Biology.
Welch, Rene, Dongjun Chung, Jeffrey Grass, Robert Landick, and Sündüz Keleş. 2016. “Data Exploration, Quality Control, and Statistical Analysis of ChIP-Exo/Nexus Experiments.” Submitted.