BioCor 1.4.0
Methods to find similarities have been developed for several purposes, being Jaccard and Dice similarities the most known. In bioinformatics much of the research on the topic is centered around Gene Ontologies because they provide controlled vocabularies, as part of their mission:
The mission of the GO Consortium is to develop an up-to-date, comprehensive, computational model of biological systems, from the molecular level to larger pathways, cellular and organism-level systems.
However, there is another resource of similarities between genes: metabolic pathways. Metabolic pathways describe the relationship between genes, proteins, lipids and other elements of the cells. A pathway describes, to some extent, the function in which it is involved in the cell. There exists several databases about which gene belong to which pathway. Together with pathways, gene sets related to a function or to a phenotype are a source of information of the genes function. With this package we provide the methods to calculate functional similarities based on this information.
Here we provides functions to calculate functional similarities for pathways, gene sets, genes and clusters of genes. The name BioCor stands from biological correlation, shortened to BioCor, because as said we look if some genes are in the same pathways or gene sets as other genes.
As it development started aiming to improve clustering of genes by functionality in weighted gene co-expression networks using WGCNA. The package has some functions to combine similarities in order to integrate with WGCNA
.
The main article describing the software and its usefulness is currently under writing. However you can cite as said in:
citation("BioCor")
The BioCor package is available at Bioconductor and can be downloaded and installed via biocLite:
source("http://bioconductor.org/biocLite.R")
biocLite("BioCor")
You can install the latest version of BioCor from Github with:
library("devtools")
install_github("llrs/BioCor")
We can load the package and prepare the data for which we want to calculate the similarities:
library("BioCor")
## Load libraries with the data of the pathways
library("org.Hs.eg.db")
library("reactome.db")
genesKegg <- as.list(org.Hs.egPATH)
genesReact <- as.list(reactomeEXTID2PATHID)
# Remove genes and pathways which are not from human pathways
genesReact <- sapply(genesReact, function(x){
unique(grep("R-HSA-", x, value = TRUE))
})
genesReact <- genesReact[lengths(genesReact) >= 1]
To avoid having biased data it is important to have all the data about the pathways and genes associated to all pathways for the organism under study. Here we assume that we are interested in human pathways. We use this two databases KEGG and Reactome as they are easy to obtain the data. However KEGG database is no longer free for large retrievals therefore it is not longer updated in the Bioconductor annotation packages.
However, one can use any list where the names of the list are the genes and the elements of the list the pathways or groups where the gene belong. One could also read from a GMT file or use GeneSetCollections in addition or instead of those associations from a pathway database and convert it to list using:
library("GSEABase")
paths2Genes <- geneIds(getGmt("/path/to/file.symbol.gmt",
geneIdType=SymbolIdentifier()))
genes <- unlist(paths2Genes, use.names = FALSE)
pathways <- rep(names(paths2Genes), lengths(paths2Genes))
genes2paths <- split(pathways, genes) # List of genes and the gene sets
With genes2paths
we have the information ready to use.
We can compute similarities (Dice similarity, see question 1 of FAQ) between two pathways or between several pathways and combine them, or not:
(paths <- sample(unique(unlist(genesReact)), 2))
## [1] "R-HSA-913531" "R-HSA-112316"
pathSim(paths[1], paths[2], genesReact)
## [1] 0.01413428
(pathways <- sample(unique(unlist(genesReact)), 10))
## [1] "R-HSA-168799" "R-HSA-9018682" "R-HSA-5250958" "R-HSA-2033515"
## [5] "R-HSA-5357786" "R-HSA-8937144" "R-HSA-111461" "R-HSA-69017"
## [9] "R-HSA-2243919" "R-HSA-2206296"
mpathSim(pathways, genesReact)
## R-HSA-168799 R-HSA-9018682 R-HSA-5250958 R-HSA-2033515
## R-HSA-168799 1.0 0 0.5 0
## R-HSA-9018682 0.0 1 0.0 0
## R-HSA-5250958 0.5 0 1.0 0
## R-HSA-2033515 0.0 0 0.0 1
## R-HSA-5357786 0.0 0 0.0 0
## R-HSA-8937144 0.0 0 0.0 0
## R-HSA-111461 0.0 0 0.0 0
## R-HSA-69017 0.0 0 0.0 0
## R-HSA-2243919 0.0 0 0.0 0
## R-HSA-2206296 0.0 0 0.0 0
## R-HSA-5357786 R-HSA-8937144 R-HSA-111461 R-HSA-69017
## R-HSA-168799 0 0 0 0
## R-HSA-9018682 0 0 0 0
## R-HSA-5250958 0 0 0 0
## R-HSA-2033515 0 0 0 0
## R-HSA-5357786 1 0 0 0
## R-HSA-8937144 0 1 0 0
## R-HSA-111461 0 0 1 0
## R-HSA-69017 0 0 0 1
## R-HSA-2243919 0 0 0 0
## R-HSA-2206296 0 0 0 0
## R-HSA-2243919 R-HSA-2206296
## R-HSA-168799 0 0
## R-HSA-9018682 0 0
## R-HSA-5250958 0 0
## R-HSA-2033515 0 0
## R-HSA-5357786 0 0
## R-HSA-8937144 0 0
## R-HSA-111461 0 0
## R-HSA-69017 0 0
## R-HSA-2243919 1 0
## R-HSA-2206296 0 1
When the method to combine the similarities is set to NULL
mpathSim returns a matrix of pathway similarities, otherwise it combines the values. In the next section we can see the methods to combine pathway similarities.
To combine values we provide a function with several methods:
sim <- mpathSim(pathways, genesReact)
methodsCombineScores <- c("avg", "max", "rcmax", "rcmax.avg", "BMA",
"reciprocal")
sapply(methodsCombineScores, BioCor::combineScores, scores = sim)
## avg max rcmax rcmax.avg BMA reciprocal
## 0.11 1.00 1.00 1.00 1.00 1.00
We can also specify the method to combine the similarities in mpathSim
, geneSim
, mgeneSim
, clusterSim
, mclusterSim
, clusterGeneSim
and mclusterGeneSim
, argument method. By default the method is set to “max” to combine pathways (except in mpathSim where the default is to show all the pathway similarities) and “BMA” to combine similarities of genes or for cluster analysis. This function is adapted from GOSemSim package.
The function combineScoresPar
allows to use a parallel background (using BiocParallel) to combine the scores. It is recommended to use a parallel background if you calculate more than 300 gene similarities. It also have an argument in case you want to calculate the similarity scores of several sets.
To compare the function of two genes there is the geneSim
function and mgeneSim
function for several comparisons. In this example we compare the genes BRCA1 and BRCA2 and NAT2, which are the genes 672, 675 and 10 respectively in ENTREZID:
geneSim("672", "675", genesKegg)
## [1] 0.0824295
geneSim("672", "675", genesReact)
## [1] 1
mgeneSim(c("BRCA1" = "672", "BRCA2" = "675", "NAT2" = "10"), genesKegg)
## BRCA1 BRCA2 NAT2
## BRCA1 1.0000000 0.082429501 0.000000000
## BRCA2 0.0824295 1.000000000 0.008241758
## NAT2 0.0000000 0.008241758 1.000000000
mgeneSim(c("BRCA1" = "672", "BRCA2" = "675", "NAT2" = "10"), genesReact)
## BRCA1 BRCA2 NAT2
## BRCA1 1.0000000 1.0000000 0.1729575
## BRCA2 1.0000000 1.0000000 0.0781307
## NAT2 0.1729575 0.0781307 1.0000000
Note that for the same genes each database or list provided has different annotations, which result on different similarity scores. In this example BRCA1 has 3 and 14 pathways in KEGG and Reactome respectively and BRCA2 has 1 and 38 pathways in KEGG and Reactome respectively which results on different scores.
There are two methods:
As explained, in this method all the pathways of a cluster are compared with all the pathways of the other cluster. If a method to combine pathways similarities is not provided, all pathway similarities are returned:
clusterSim(c("672", "675"), c("100", "10", "1"), genesKegg)
## [1] 0.04210526
clusterSim(c("672", "675"), c("100", "10", "1"), genesKegg, NULL)
## 00230 01100 05340 00232 00983
## 04120 0.00000000 0.000000000 0.011764706 0 0
## 03440 0.04210526 0.006908463 0.000000000 0 0
## 05200 0.00000000 0.008241758 0.005540166 0 0
## 05212 0.00000000 0.001666667 0.019047619 0 0
clusters <- list(cluster1 = c("672", "675"),
cluster2 = c("100", "10", "1"),
cluster3 = c("18", "10", "83"))
mclusterSim(clusters, genesKegg, "rcmax.avg")
## cluster1 cluster2 cluster3
## cluster1 1.00000000 0.01587957 0.00256157
## cluster2 0.01587957 1.00000000 0.56412591
## cluster3 0.00256157 0.56412591 1.00000000
mclusterSim(clusters, genesKegg, "max")
## cluster1 cluster2 cluster3
## cluster1 1.000000000 0.04210526 0.008241758
## cluster2 0.042105263 1.00000000 1.000000000
## cluster3 0.008241758 1.00000000 1.000000000
In this method first the similarities between each gene is calculated, then the similarity between each group of genes is calculated. Requiring two methods to combine values, the first one to combine pathways similarities and the second one to combine genes similarities. If only one is provided it returns the matrix of similarities of the genes of each cluster:
clusterGeneSim(c("672", "675"), c("100", "10", "1"), genesKegg)
## [1] 0.02605425
clusterGeneSim(c("672", "675"), c("100", "10", "1"), genesKegg, "max")
## 100 10 1
## 672 0.01176471 0.000000000 NA
## 675 0.04210526 0.008241758 NA
mclusterGeneSim(clusters, genesKegg, c("max", "rcmax.avg"))
## cluster1 cluster2 cluster3
## cluster1 1.000000000 0.02605425 0.006181319
## cluster2 0.026054248 1.00000000 1.000000000
## cluster3 0.006181319 1.00000000 1.000000000
mclusterGeneSim(clusters, genesKegg, c("max", "max"))
## cluster1 cluster2 cluster3
## cluster1 1.000000000 0.04210526 0.008241758
## cluster2 0.042105263 1.00000000 1.000000000
## cluster3 0.008241758 1.00000000 1.000000000
Note the differences between mclusterGeneSim
and mclusterSim
in the similarity values of the clusters. If we set method = c("max", "max")
in mclusterGeneSim
then the similarity between the clusters is the same as clusterSim
.
If needed, Jaccard similarity can be calculated from Dice similarity using D2J
:
D2J(sim)
## R-HSA-168799 R-HSA-9018682 R-HSA-5250958 R-HSA-2033515
## R-HSA-168799 1.0000000 0 0.3333333 0
## R-HSA-9018682 0.0000000 1 0.0000000 0
## R-HSA-5250958 0.3333333 0 1.0000000 0
## R-HSA-2033515 0.0000000 0 0.0000000 1
## R-HSA-5357786 0.0000000 0 0.0000000 0
## R-HSA-8937144 0.0000000 0 0.0000000 0
## R-HSA-111461 0.0000000 0 0.0000000 0
## R-HSA-69017 0.0000000 0 0.0000000 0
## R-HSA-2243919 0.0000000 0 0.0000000 0
## R-HSA-2206296 0.0000000 0 0.0000000 0
## R-HSA-5357786 R-HSA-8937144 R-HSA-111461 R-HSA-69017
## R-HSA-168799 0 0 0 0
## R-HSA-9018682 0 0 0 0
## R-HSA-5250958 0 0 0 0
## R-HSA-2033515 0 0 0 0
## R-HSA-5357786 1 0 0 0
## R-HSA-8937144 0 1 0 0
## R-HSA-111461 0 0 1 0
## R-HSA-69017 0 0 0 1
## R-HSA-2243919 0 0 0 0
## R-HSA-2206296 0 0 0 0
## R-HSA-2243919 R-HSA-2206296
## R-HSA-168799 0 0
## R-HSA-9018682 0 0
## R-HSA-5250958 0 0
## R-HSA-2033515 0 0
## R-HSA-5357786 0 0
## R-HSA-8937144 0 0
## R-HSA-111461 0 0
## R-HSA-69017 0 0
## R-HSA-2243919 1 0
## R-HSA-2206296 0 1
Also if one has a Jaccard similarity and wants a Dice similarity, can use the J2D
function.
We can compute the whole similarity of genes in KEGG or Reactome by using :
## Omit those genes without a pathway
nas <- sapply(genesKegg, function(y){all(is.na(y)) | is.null(y)})
genesKegg2 <- genesKegg[!nas]
m <- mgeneSim(names(genesKegg2), genesKegg2, method = "max")
It takes around 5 hours in one core but it requires high memory available.
If one doesn’t have such a memory available can compute the similarities by pieces, and then fit it in another matrix with:
sim <- AintoB(m, B)
Usually B is a matrix of size length(genes)
, see ?AintoB
.
In this example I show how to use BioCor to analyse a list of genes by functionality. With a list of genes we are going to see how similar are those genes:
genes.id <- c("10", "15", "16", "18", "2", "9", "52", "3855", "3880", "644",
"81327", "9128", "2073", "2893", "5142", "60", "210", "81",
"1352", "88", "672", "675")
genes.id <- mapIds(org.Hs.eg.db, keys = genes.id, keytype = "ENTREZID",
column = "SYMBOL")
## 'select()' returned 1:1 mapping between keys and columns
genes <- names(genes.id)
names(genes) <- genes.id
react <- mgeneSim(genes, genesReact)
## Warning in mgeneSim(genes, genesReact): Some genes are not in the list
## provided.
## We remove genes which are not in list (hence the warning):
nan <- genes %in% names(genesReact)
react <- react[nan, nan]
hc <- hclust(as.dist(1 - react))
plot(hc, main = "Similarities between genes")
Now we can see the relationship between the genes. We can group them for a cluster analysis to visualize the relationship between the clusters:
mycl <- cutree(hc, h = 0.2)
clusters <- split(genes[nan], as.factor(mycl))
# Removing clusters of just one gene
(clusters <- clusters[lengths(clusters) >= 2])
## $`1`
## NAT2 AANAT NAT1 BLVRA ALAD COX10
## "10" "15" "9" "644" "210" "1352"
##
## $`2`
## AARS ACTB BRCA1
## "16" "60" "672"
##
## $`3`
## ABAT GRIA4 ACTN2
## "18" "2893" "88"
##
## $`4`
## A2M OR4A16 PDE4B
## "2" "81327" "5142"
##
## $`5`
## KRT7 KRT19
## "3855" "3880"
##
## $`7`
## ERCC5 BRCA2
## "2073" "675"
names(clusters) <- paste0("cluster", names(clusters))
## Remember we can use two methods to compare clusters
sim_clus1 <- mclusterSim(clusters, genesReact)
plot(hclust(as.dist(1 - sim_clus1)),
main = "Similarities between clusters by pathways")
sim_clus2 <- mclusterGeneSim(clusters, genesReact)
plot(hclust(as.dist(1 - sim_clus2)),
main ="Similarities between clusters by genes")
Each method results in a different dendrogram as we can see on Figure 2 compared to Figure 3.
In this section I will compare the functional similarity of BioCor with the closely related package GOSemSim. The genes and gene clusters used were extracted from GOSemSim’s vignette, we only change the ontology, instead of the molecular function, the biological process will be used:
suppressPackageStartupMessages(library("GOSemSim"))
hsGO <- godata('org.Hs.eg.db', ont = "BP", computeIC = FALSE)
## preparing gene to GO mapping data...
I will compare the functions geneSim from section geneSim and mgeneSim from GOSemSim with both data sets from KEGG and Reactome:
goSemSim <- GOSemSim::geneSim("241", "251", semData = hsGO,
measure = "Wang", combine="BMA")$geneSim
BioCor::geneSim("241", "251", genesKegg, "BMA") - goSemSim
## [1] NA
BioCor::geneSim("241", "251", genesReact, "BMA") - goSemSim
## [1] -0.1488073
genes <- c("835", "5261","241", "994")
goSemSim <- GOSemSim::mgeneSim(genes, semData = hsGO,
measure = "Wang", combine = "BMA",
verbose = FALSE, drop = NULL)
BioCor::mgeneSim(genes, genesKegg, "BMA", round = TRUE) - goSemSim
## 835 5261 241 994
## 835 NA NA NA NA
## 5261 NA 0.000 NA -0.293
## 241 NA NA NA NA
## 994 NA -0.293 NA 0.000
BioCor::mgeneSim(genes, genesReact, "BMA", round = TRUE) - goSemSim
## 835 5261 241 994
## 835 0.000 -0.250 -0.145 -0.252
## 5261 -0.250 0.000 0.003 -0.365
## 241 -0.145 0.003 0.000 -0.179
## 994 -0.252 -0.365 -0.179 0.000
We can observe that for the first genes there isn’t information on the pathways of those genes in the KEGG data set.
See FAQ question 8 about the use of BioCor::
and GOSemSim::
.
If named characters are passed they are used to name the resulting matrix:
genes <- c("CDC45", "MCM10", "CDC20", "NMU", "MMP1")
genese <- mapIds(org.Hs.eg.db, keys = genes, column = "ENTREZID",
keytype = "SYMBOL")
## 'select()' returned 1:1 mapping between keys and columns
BioCor::mgeneSim(genese, genesReact, "BMA")
## CDC45 MCM10 CDC20 NMU MMP1
## CDC45 1.00000000 0.90463112 0.5103900 0.04517255 0.09431228
## MCM10 0.90463112 1.00000000 0.5291507 0.05378892 0.10250668
## CDC20 0.51038999 0.52915066 1.0000000 0.15920808 0.22602436
## NMU 0.04517255 0.05378892 0.1592081 1.00000000 0.10131424
## MMP1 0.09431228 0.10250668 0.2260244 0.10131424 1.00000000
We can further compare the cluster similarities from the next section of the vignette:
gs1 <- c("835", "5261","241", "994", "514", "533")
gs2 <- c("578","582", "400", "409", "411")
BioCor::clusterSim(gs1, gs2, genesReact, "BMA") -
GOSemSim::clusterSim(gs1, gs2, hsGO, measure = "Wang", combine = "BMA")
## [1] -0.1917226
x <- org.Hs.egGO
hsEG <- mappedkeys(x)
set.seed(123)
(clusters <- list(a=sample(hsEG, 20), b=sample(hsEG, 20), c=sample(hsEG, 20)))
## $a
## [1] "2712" "8359" "390191" "9455" "29087" "10801" "54517" "9656"
## [9] "55214" "4643" "55026" "4538" "653" "55823" "128368" "9816"
## [17] "246175" "10713" "29078" "51250"
##
## $b
## [1] "9603" "6778" "6188" "55216" "6415" "715" "55027" "57037"
## [9] "27164" "154865" "64115" "9879" "6721" "8396" "10312" "5071"
## [17] "79901" "23026" "28663" "23390"
##
## $c
## [1] "152138" "3925" "392" "344" "1600" "150221" "23428" "4856"
## [9] "26" "9113" "10807" "4306" "84144" "140738" "55534" "2261"
## [17] "144404" "79759" "970" "348094"
BioCor::mclusterSim(clusters, genesReact, "BMA") -
GOSemSim::mclusterSim(clusters, hsGO, measure = "Wang", combine = "BMA")
## Warning in BioCor::mclusterSim(clusters, genesReact, "BMA"): Some genes are
## not in the list provided.
## a b c
## a 0.000000000 0.002762193 -0.04408699
## b 0.002762193 0.000000000 0.06385953
## c -0.044086990 0.063859528 0.00000000
WGCNA uses the correlation of the expression data of several samples to cluster genes. Sometimes, from a biological point of view the interpretation of the resulting modules is difficult, even more when some groups of genes end up not having an enrichment in previously described functions. BioCor was originally thought to be used to overcome this problem: to help clustering genes, not only by correlation but also by functionality.
In order to have groups functionally related, functional similarities can enhance the clustering of genes when combined with experimental correlations. The resulting groups will reflect, not only the correlation of the expression provided, but also the functionality known of those genes.
We propose the following steps:
Here we provide an example on how to use BioCor with WGCNA:
sim
is a list where each element is a matrix of similarities between genes
Our normalized expression is in the expr
variable, a matrix where the samples are in the rows and genes in the columns.
expr.sim <- WGCNA::cor(expr) # or bicor
## Combine the similarities
similarity <- similarities(c(list(exp = expr.sim), sim), mean, na.rm = TRUE)
## Choose the softThreshold
pSFT <- pickSoftThreshold.fromSimilarity(similarity)
## Or any other function we want
adjacency <- adjacency.fromSimilarity(similarity, power = pSFT$powerEstimate)
## Once we have the similarities we can calculate the TOM with TOM
TOM <- TOMsimilarity(adjacency) ## Requires adjacencies despite its name
dissTOM <- 1 - TOM
geneTree <- hclust(as.dist(dissTOM), method = "average")
## We can use a clustering tool to group the genes
dynamicMods <- cutreeHybrid(dendro = geneTree, distM = dissTOM,
deepSplit = 2, pamRespectsDendro = FALSE,
minClusterSize = 30)
moduleColors <- labels2colors(dynamicMods$labels)
Once the modules are identified using the functional similarities of this package and the gene correlations, one can continue with the workflow of WGCNA.
An important aspect in this process is deciding how to combine the similarities and the expression data: - If the functional similarities play a huge role, we will end up having only those genes closely related to the same functions. - If the functional similarities play a low role, it will be similarly to only use WGCNA, and the genes won’t be functionally related.
For these reasons it is better to use weights between 0.5
and 1
for expression if you use weighted.sum
or similar functions.
There are several things to take into account when choosing a way to combine: - The size of the grey or 0 modules (those who don’t show a specific pattern) - The number and size of the modules created. - The way the similarities are combined
Violin plots may help to view the differences in size and distribution of the modules across different methods of combining the similarities.
BioCor uses the Sørensen–Dice index: The dice similarity is the double of the genes shared by the pathways divided by the number of genes in each pathway.
We can calculate the similarity between two pathways (\(x\), \(w\)) with:
\[Dice(x, w) = \frac{2 |x \cap w|}{|x| + |w|}\]
This is implemented in the diceSim
function, which results is similar to Jaccard index:
\[Jaccard(x, w) = \frac{|x \cap w|}{|x \cup w|}\]
Both Jaccard index and dice index are between 0 and 1 (\([0, 1]\)). To calculate the Jaccard index from the diceSim
use the D2J
function.
We consider Dice coefficient better than Jaccard because it has higher values for the same comparisons, which reflects that including a gene in a pathway is not easily done.
Although the recommend method is the “max” method, (set as default), there are implemented other methods in combineScores
of the GOSemSim package which I borrowed1.
The purpose of combining the scores is usually to find the relationships between genes through their pathways. The higher the similarity is between two pathway of two genes, the higher functionality do the genes share, even if those genes have other non-related functions.
If two genes are involved in the same pathways usually they have (to some extent, maybe indirect) interactions. To detect which relationship is more important between two genes one could measure other similarities scores and check the stoichiometry of the pathways and measure the expression changes and correlation between them or use dynamic simulations of the pathways.
This is covered by the GOSemSim package, you can use it to produce a similarity matrix (i.e. use mgeneSim
). You can parallelize it with foreach
package or BiocParallel
if your list of genes is big.
If the error is like this:
Error in FUN(X[[i]], ...) :
trying to get slot "geneAnno" from an object of a basic class ("list") with no slots
And you have loaded the GOSemSim
library, R is calling the GOSemSim function of the same name. Use BioCor::
to call the function from BioCor
(f.ex: BioCor::geneSim
)
If the error is not previously described in the support forum, post a question there.
My apologies if you found a bug or an inconsistency between what BioCor
should do and what it actually does. Once you checked that it is a bug, please let me know at the issues page of Github.
sessionInfo()
## R version 3.5.0 (2018-04-23)
## Platform: x86_64-pc-linux-gnu (64-bit)
## Running under: Ubuntu 16.04.4 LTS
##
## Matrix products: default
## BLAS: /home/biocbuild/bbs-3.7-bioc/R/lib/libRblas.so
## LAPACK: /home/biocbuild/bbs-3.7-bioc/R/lib/libRlapack.so
##
## locale:
## [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C
## [3] LC_TIME=en_US.UTF-8 LC_COLLATE=C
## [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
## [7] LC_PAPER=en_US.UTF-8 LC_NAME=C
## [9] LC_ADDRESS=C LC_TELEPHONE=C
## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
##
## attached base packages:
## [1] parallel stats4 stats graphics grDevices utils datasets
## [8] methods base
##
## other attached packages:
## [1] GOSemSim_2.6.0 reactome.db_1.64.0 org.Hs.eg.db_3.6.0
## [4] AnnotationDbi_1.42.0 IRanges_2.14.0 S4Vectors_0.18.0
## [7] Biobase_2.40.0 BiocGenerics_0.26.0 BioCor_1.4.0
## [10] BiocStyle_2.8.0
##
## loaded via a namespace (and not attached):
## [1] Rcpp_0.12.16 highr_0.6 compiler_3.5.0
## [4] bitops_1.0-6 tools_3.5.0 digest_0.6.15
## [7] bit_1.1-12 lattice_0.20-35 annotate_1.58.0
## [10] evaluate_0.10.1 RSQLite_2.1.0 memoise_1.1.0
## [13] pkgconfig_2.0.1 Matrix_1.2-14 graph_1.58.0
## [16] DBI_0.8 yaml_2.1.18 xfun_0.1
## [19] stringr_1.3.0 knitr_1.20 rprojroot_1.3-2
## [22] bit64_0.9-7 grid_3.5.0 GSEABase_1.42.0
## [25] XML_3.98-1.11 BiocParallel_1.14.0 rmarkdown_1.9
## [28] bookdown_0.7 GO.db_3.6.0 blob_1.1.1
## [31] magrittr_1.5 backports_1.1.2 htmltools_0.3.6
## [34] xtable_1.8-2 stringi_1.1.7 RCurl_1.95-4.10