Contents

1 Summary

Multi-omics data from the same set of samples contain complementary information and may provide a more accurate and holistic view of the biological system consisting of different interconnected molecular components. Hence, a computational framework to infer regulatory relationships by integrating multiple modalities is one of the most relevant and challenging problems in systems biology.

IntOMICS is an efficient integrative framework based on Bayesian networks. IntOMICS systematically analyses gene expression (GE), DNA methylation (METH), copy number variation (CNV) and biological prior knowledge (B) to infer regulatory networks. IntOMICS complements the missing biological prior knowledge by so-called empirical biological knowledge (empB), estimated from the available
experimental data.

An automatically tuned MCMC algorithm (Yang and Rosenthal, 2017) estimates model parameters and the empirical biological knowledge. Conventional MCMC algorithm with additional Markov blanket resampling (MBR) step (Su and Borsuk, 2016) infers resulting regulatory network structure consisting of three types of nodes: GE nodes refer to gene expression levels, CNV nodes refer to associated copy number variations, and METH nodes refer to associated DNA methylation probe(s). Regulatory networks derived from IntOMICS provide deeper insights into the complex flow of genetic information. IntOMICS is a powerful resource for exploratory systems biology and can provide valuable insights into the complex mechanisms of biological processes that has a vital role in personalised medicine.

IntOMICS takes as input MultiAssayExperiment or named list with:

  1. gene expression matrix,
  2. associated copy number variation matrix sampled from the same individuals (optional),
  3. associated DNA methylation matrix of beta-values sampled from the same individuals (optional), and
  4. the biological prior knowledge with information on known interactions among molecular features (optional; highly recommended).

The resulting regulatory network structure contains the edge weights \(w_i\) representing the empirical frequency of given edge over samples of network structures from two independent MCMC simulations.

For further details about the IntOMICS algorithm, its performance and benchmark analysis, see manuscript Pacinkova & Popovici, 2022.

Projects such as The Cancer Genome Atlas aim to catalogue multi-omics data from a large number of samples. Bioconductor packages such as curatedTCGA enable to download and efficiently collect these multi-omics data. R-packages such as IntOMICS, MOFA2, and cosmosR can provide a complementary understanding of hidden interplay between multi-omics dataset and deciphering the complexity of the biological system.

IntOMICS framework is demonstrated using colon cancer data from the curatedTCGA package. However, it is not limited to any particular omics data or phenotype.

IntOMICS framework

2 Installation

# bioconductor install
if (!requireNamespace("BiocManager", quietly = TRUE))
    install.packages("BiocManager")
BiocManager::install("IntOMICS")

# install the newest (development) version from GitHub
# install.packages("remotes")
remotes::install_github("anna-pacinkova/IntOMICS")  

3 Usage

This tutorial will show you how to use the IntOMICS package
with a toy example. The example dataset consisting of processed gene expression, DNA methylation (Illumina Infinium HumanMethylation450 BeadChip) and copy number variation is from the TCGA data portal (https://portal.gdc.cancer.gov/): primary colon cancer samples (COAD) with microsatellite instability (MSI). However,
the approach is not limited to any phenotype. We choose the set of 8 genes from the KEGG Colorectal cancer pathway(https://www.genome.jp/pathway/hsa05210).

3.1 Part 1: Input data

library(IntOMICS)

# load required libraries
suppressPackageStartupMessages({
library(curatedTCGAData)
library(TCGAutils)
library(bnlearn)
library(bnstruct)
library(matrixStats)
library(parallel)
library(RColorBrewer)
library(bestNormalize)
library(igraph)
library(gplots)
library(methods)
library(ggraph)
library(ggplot2)})

IntOMICS framework takes as input:

  1. gene expression matrix \(GE\) (\(m\) x \(n_1\)) with microarray intensities or RNA-seq count data transformed into a continuous domain (\(m\) samples and \(n_1\) features)

  2. associated copy number variation matrix \(CNV\) (\(m\) x \(n_2\)) with continuous segment mean values derived for each gene (\(n_2 \leq n_1\)),

  3. associated DNA methylation matrix of beta-values \(METH\) (\(m\) x \(n_3\)),

  4. data.frame including all known interactions between molecular features (information from public available databases such as KEGG (Ogata et al., 1999) or REACTOME (Wu & Haw, 2017)). Any other source of prior knowledge can be used. (IntOMICS is designed to run even if prior knowledge is not available. However, we highly recommend to use it.)

  5. logical matrix with known transcription factors (TFs) and its targets (information from public available databases such as ENCODE (ENCODE Project Consortium, 2004). Any other source can be used. (IntOMICS is designed to run even if any TF-target interaction is not available.)

All data matrices are sampled from the same individuals.

We use curatedTCGA package to obtain publicly available toy dataset from The Cancer Genome Atlas (TCGA):

coad_SE <- curatedTCGAData("COAD",
                           c("RNASeq2GeneNorm_illuminahiseq",
                             "Methylation_methyl450","GISTIC_AllByGene"), 
                           version = "2.0.1", dry.run = FALSE)
coad_SE <- TCGAprimaryTumors(coad_SE)
 
## keep NA for Methylation data
coad_ma <- subsetByColData(coad_SE, coad_SE$MSI_status == "MSI-H" | 
                             is.na(coad_SE$MSI_status))
# choose random 50 samples for illustration
random_samples <- sample(names(which(table(sampleMap(coad_ma)$primary)==3)),50)
coad_ma <- subsetByColData(coad_ma, random_samples)

rownames(coad_ma[["COAD_GISTIC_AllByGene-20160128"]]) <- rowData(coad_ma[["COAD_GISTIC_AllByGene-20160128"]])[["Gene.Symbol"]]
 
data(list=c("gene_annot","annot"))
rowselect <- list(gene_annot$gene_symbol, gene_annot$gene_symbol, 
                  unlist(annot))
names(rowselect) <- names(coad_ma)
omics <- coad_ma[rowselect, , ]
names(omics) <- c("cnv","ge","meth")

Available omics data are saved in a MultiAssayExperiment object including gene expression (GE) of 8 genes + copy number variation (CNV) of 8 genes + beta value of 9 DNA methylation (METH) probes:

t(assay(omics[["ge"]]))[1:5,1:5]
##                                 WNT2B     FZD2     DVL3    GSK3B     AXIN1
## TCGA-CA-6715-01A-21R-1839-07   9.2387  15.5211 2087.583 1490.761 1594.9741
## TCGA-D5-5540-01A-01R-1653-07  17.8571  57.2660 1346.059 1434.113  301.1084
## TCGA-CK-5914-01A-11R-1653-07  31.9968  29.1616 1466.586 1289.591 1466.5857
## TCGA-AA-3496-01A-21R-1839-07  89.8317 139.0943 2311.615 1234.048 1656.2984
## TCGA-CK-4947-01B-11R-1653-07 172.0203  50.7185 1457.735 1591.716 1224.0068

These values correspond to normalised RNA-seq data (in this case transcripts per million (TPM)). However, the user is not limited to this platform. Another assay, such as microarray data, can be used.

t(assay(omics[["cnv"]]))[1:5,1:5]
##                              WNT2B    FZD2    DVL3     GSK3B    AXIN1  
## TCGA-CA-6715-01A-21D-1834-01 "0.001"  "0.890" "-0.005" "-0.005" "0.015"
## TCGA-D5-5540-01A-01D-1649-01 "-0.833" "0.040" "-0.852" "0.026"  "0.032"
## TCGA-CK-5914-01A-11D-1649-01 "-0.008" "0.011" "0.000"  "0.000"  "0.348"
## TCGA-AA-3496-01A-21D-1834-01 "-0.006" "0.685" "0.000"  "0.000"  "0.007"
## TCGA-CK-4947-01B-11D-1649-01 "0.008"  "0.020" "-0.005" "-0.005" "0.000"

These copy number values represent segment mean values equal to \(log_2(\frac{copy-number}{2})\). In the omics$cnv matrix, define only columns with available CNV data.

t(assay(omics[["meth"]]))[1:5,1:5]
## <5 x 5> DelayedMatrix object of type "double":
##                              cg14479617 cg12588208 cg27308245 cg26525629
## TCGA-CA-6715-01A-21D-1837-05  0.9370897  0.9035330  0.8538490  0.9355458
## TCGA-D5-5540-01A-01D-1651-05  0.9356751  0.6853780  0.8766104  0.9305654
## TCGA-CK-5914-01A-11D-1651-05  0.9448775  0.9299059  0.8308637  0.9294791
## TCGA-AA-3496-01A-21D-1837-05  0.9247683  0.9164458  0.8726970  0.9366663
## TCGA-CK-4947-01B-11D-1651-05  0.9298511  0.8314423  0.6827767  0.8920144
##                              cg04571584
## TCGA-CA-6715-01A-21D-1837-05  0.3006658
## TCGA-D5-5540-01A-01D-1651-05  0.4806522
## TCGA-CK-5914-01A-11D-1651-05  0.4331426
## TCGA-AA-3496-01A-21D-1837-05  0.4978493
## TCGA-CK-4947-01B-11D-1651-05  0.3632599

These values represent DNA methylation beta values of given probes (defined by IDs).

!!Please, be sure that samples are in the same order across all modalities!!

IntOMICS is designed to infer regulatory networks even if the copy number variation or DNA methylation data (or both) are not available. In such a case, omics must be a MultiAssayExperiment with gene expression.

If methylation data are available, we have to provide an annotation:

str(annot)
## List of 5
##  $ GSK3B : chr [1:2] "cg14479617" "cg12588208"
##  $ AXIN1 : chr [1:2] "cg27308245" "cg26525629"
##  $ WNT2B : chr "cg04571584"
##  $ CTNNB1: chr [1:3] "cg04180460" "cg06626556" "cg02247160"
##  $ FZD2  : chr "cg09339219"

annot is a named list. Each component of the list is a character vector and corresponds to probe IDs associated with a given gene.

We also have to provide a gene annotation table:

gene_annot
##    entrezID gene_symbol
## 14 EID:7482       WNT2B
## 21 EID:2535        FZD2
## 34 EID:1857        DVL3
## 35 EID:2932       GSK3B
## 38 EID:8312       AXIN1
## 40 EID:1499      CTNNB1
## 36  EID:324         APC
## 43 EID:6934      TCF7L2

gene_annot is Gene ID conversion table with “entrezID” and “gene_symbol” column names. Entrez IDs are used in for regulatory network inference, gene symbols are used for the final regulatory network visualisation.

And finally, the prior knowledge from any source chosen by the user:

data("PK")
PK
##   src_entrez dest_entrez edge_type
## 1   EID:7482    EID:2535   present
## 2   EID:2535    EID:1857   present
## 3   EID:1857    EID:2932   present
## 4    EID:324    EID:1499   present
## 5    EID:324    EID:1857   present
## 6   EID:8312     EID:324   present

PK is the data.frame with biological prior knowledge about known interactions between features. Column names are “src_entrez” (the parent node), “dest_entrez” (the child node) and “edge_type” (the prior knowledge about the direct interaction between parent and child node; the allowed values are “present” or “missing”).

data("TFtarg_mat")
TFtarg_mat[1:5,1:5]
##            EID:1820 EID:466 EID:1386 EID:467 EID:571
## EID:1             1       0        0       0       0
## EID:503538        1       0        0       0       0
## EID:29974         1       0        0       0       0
## EID:2             1       0        0       0       0
## EID:144568        0       0        1       0       0

TFtarg_mat is a logical matrix with known transcription factors (TFs) and its targets. TFs are listed in columns, corresponding targets are listed in rows.

data("layers_def")
layers_def
##   omics layer fan_in_ge
## 1    ge     2         3
## 2   cnv     1         1
## 3  meth     1        NA

layers_def is a data.frame containing:

  1. the modality ID (character vector); must be same as names of omics MultiAssayExperiment object,

  2. corresponding layer in IntOMICS MCMC scheme (numeric vector); edges from the lowest layer (must be always GE) to the CNV/METH layers are excluded from the set of candidate edges), and

  3. maximal number of parents from given layer to GE nodes (numeric vector).

3.2 Part 2: Data preprocessing

The first step is to define the biological prior matrix and estimate the upper bound of the partition function needed to define the prior distribution of network structures. We also need to define all possible parent set configurations for each node. For each parent set configuration, we compute the energy (needed to define the prior distribution of network structures) and the BGe score (needed to determine the posterior probability of network structures). These functionalities are available through the omics_module function. We can use linear regression to filter irrelevant DNA methylation probes. In such a case, we set the parameter “lm_METH = TRUE”. We can also specify the threshold for the R^2 to choose DNA methylation probes with significant coefficient using argument “r_squared_thres” (default = 0.3), or p-value using “p_val_thres” (default = 0.05). There are several other arguments: “woPKGE_belief” (default = 0.5) refers to the belief concerning GE-GE interactions without prior knowledge, “nonGE_belief” (default = 0.5) refers to the belief concerning the belief concerning interactions of features except GE (e.g. CNV-GE, METH-GE), “TFBS_belief” refers to the belief concerning the TF and its target interaction (default = 0.75). Note that all interactions with belief equal to “woPKGE_belief” in biological prior knowledge will be updated in empirical biological knowledge.

OMICS_mod_res <- omics_module(omics = omics, 
                              PK = PK, 
                              layers_def = layers_def, 
                              TFtargs = TFtarg_mat,
                              annot = annot, 
                              gene_annot = gene_annot,
                              lm_METH = TRUE,
                              r_squared_thres = 0.3,
                              p_val_thres = 0.1)

This function returns several outputs:

names(OMICS_mod_res)
## [1] "pf_UB_BGe_pre"       "B_prior_mat"         "annot"              
## [4] "omics"               "layers_def"          "omics_meth_original"
  1. OMICS_mod_res$pf_UB_BGe_pre is a list that contains:
  • OMICS_mod_res$pf_UB_BGe_pre$partition_func_UB the upper bound of the partition function for hyperparameter \(\beta = 0\),
  • OMICS_mod_res$pf_UB_BGe_pre$parents_set_combinations all possible parent set configuration for given node,
  • OMICS_mod_res$pf_UB_BGe_pre$energy_all_configs_node energy for given parent set configurations,
  • OMICS_mod_res$pf_UB_BGe_pre$BGe_score_all_configs_node BGe score for given parent set configurations.
  1. OMICS_mod_res$B_prior_mat is a biological prior matrix.
  2. OMICS_mod_res$annot contains DNA methylation probes that passed the filter.
  3. OMICS_mod_res$omics is a list with gene expression, copy number variation and normalised methylation data (possibly filtered if we use “lm_METH = TRUE”).
  4. OMICS_mod_res$omics_meth_original the original methylation data.

3.3 Part 3: MCMC simulation

We use the automatically tuned MCMC algorithm (Yang and Rosenthal, 2017) with default setting to estimate model hyperparameter \(\beta\) and empirical biological knowledge matrix through multiple phases.

  1. The first adaptive phase is used to roughly tune the hyperparameter \(\beta\), more precisely the variance of its proposal distribution.

  2. The transient phase is applied to diagnose whether the chain has reached the mode of the target distribution.

  3. The second adaptive phase is used to fine-tune the hyperparameter \(\beta\), the variance of its proposal distribution and to compute the empirical biological prior matrix. Assuming there is no prior knowledge aboit interaction from node i to node j, the prior knowledge about interaction from node i to node j is updated during the second adaptive phase after every conventional edge proposal move (addition, deletion, reversal).
    The empirical biological knowledge corresponds to the ratio of acceptance (number of iterations with accepted candidate edge from~node i to~node j) and frequency (number of iterations with proposed candidate edge from~node i to~node j). Reversing an edge is equivalent to deleting the edge and adding the edge in the opposite direction.

  4. The empirical biological matrix and the hyperparameter \(\beta\) determined bythesecond adaptive phase are used in the last sampling phase. In this phase, IntOMICS applies a greedy horizon approach. Three independent paths are executed with a fixed BGe score (except the MBR step). The most probable path is chosen after every 500 iterations.
    The conventional MCMC algorithm with additional Markov blanket resampling step (Su and Borsuk, 2016) to infer regulatory network structure consisting of three types of nodes: GE, CNV and METH nodes. Two independent samples of network structures are produced to evaluate the convergence of the Markov chain. Each sample consists of 2*burn_in DAGs. The~resulting samples of DAGs are thinned - discarded all but every thin DAG. The burn-in period and thinning frequency are arbitrary choices.

if(interactive())
{
  BN_mod_res_sparse <- bn_module(burn_in = 500, 
                               thin = 50, 
                               OMICS_mod_res = OMICS_mod_res,
                               minseglen = 5)
}

Because of the MCMC simulation, bn_module function is time-consuming. For the illustration, we have used only short burn-in period of the resulting Markov chain. We recommend to use much longer burn-in period and check trace plots of the MCMC simulation. We recommend to use burn_in = 100.000, thin = 500, and minseglen = 50.000 (for further details see (Pacinkova & Popovici, 2022)). To investigate relevant IntOMICS outputs, use the pre-computed result saved in BN_mod_res R object).
There are two optional arguments: “len” specifies the initial width of the sampling interval for hyperparameter \(\beta\). However, this parameter will be tuned during the adaptive phases of the MCMC algorithm. “prob_mbr” specifies the probability of the MBR step (default = TRUE). We strongly recommend to use the default setting (for further details on how this argument affects MCMC scheme results, see (Su and Borsuk, 2016)).

Let’s check the outputs of bn_module function:

data("BN_mod_res")
getSlots(class(BN_mod_res))
##       estimated_beta        estimated_len B_prior_mat_weighted 
##            "numeric"            "numeric"             "matrix" 
##          beta_tuning          CPDAGs_sim1          CPDAGs_sim2 
##             "matrix"               "list"               "list" 
##                  rms 
##            "numeric"
  1. estimated_beta(BN_mod_res) Numeric, estimated value of hyperparameter \(\beta\)

  2. estimated_len(BN_mod_res) Numeric, estimated width of the sampling interval for hyperparameter \(\beta\)

  3. B_prior_mat_weighted(BN_mod_res) Empirical biological knowledge matrix, interactions from the biological prior knowledge and TFs-target interactions are constant (unless “TFBS_belief” is not equal to “woPKGE_belief”).

  4. CPDAGs_sim1(BN_mod_res) List of CPDAGs from the first independent MCMC simulation (thinned DAGs from the MCMC simulation converted into CPDAGs, duplicated CPDAGs discarded)

  5. CPDAGs_sim2(BN_mod_res) List of CPDAGs from the second independent MCMC simulation (thinned DAGs from the MCMC simulation converted into CPDAGs, duplicated CPDAGs discarded)

  6. beta_tuning(BN_mod_res) Matrix of results from adaptive phases that contains hyperparameter \(\beta\) tuning (trace of hyperparameter \(\beta\), trace of width of the sampling interval for hyperparameter \(\beta\)

  7. rms(BN_mod_res) Numeric, trace of root mean square used for c_rms measure to evaluate the convergence of MCMC simulation

3.4 Part 4: MCMC diagnostics

Trace plots provide an important tool for assessing mixing of a Markov chain and
should be inspected carefully. We can generate them using the trace_plots functions:

trace_plots(mcmc_res = BN_mod_res,
            burn_in = 10000,
            thin = 500, 
            edge_freq_thres = 0.5)

The trace_plots function generates the following:

  1. trace plot of beta values (we want to explore the sample space many times and avoid flat bits - the chain stays in the same state for too long; in this case, beta value fluctuates around single value, so the Markov chain is mixing well).

  2. consistency of edges posterior probabilities in two independent MCMC simulations (scatter plot of the edge weights confidence using two independent MCMC runs; the convergence is determined by the spread of the points around the y=x line; in this case, the edge weights seems to be consistent in two independent simulations).

  3. the crms strength for the convergence evaluation (summarizes the spread of the points around the line y=x, for details see (Agostinho et al., 2015) and (Pacinkova & Popovici, 2022)).

The parameter “edge_freq_thres” determines the quantile of all edge weights used to filter only reliable edges (default = NULL, all edges will be considered as present). For illustration, we use quite low edge weights filter to capture interactions between features from different layers. We recommend to use some edge weights filtering, such as 0.75 quantile of all edge weights in the resulting networks using “edge_freq_thres = 0.75”.

3.5 Part 5: IntOMICS resulting network structure

Now we use edge_weights and weighted_net functions to define the resulting regulatory network inferred by IntOMICS with specific thresholds:

res_weighted <- edge_weights(mcmc_res = BN_mod_res, 
                            burn_in = 10000, 
                            thin = 500, 
                            edge_freq_thres = 0.5)

weighted_net_res <- weighted_net(cpdag_weights = res_weighted,
                                 gene_annot = gene_annot, 
                                 PK = PK, 
                                 OMICS_mod_res = OMICS_mod_res, 
                                 gene_ID = "gene_symbol", 
                                 TFtargs = TFtarg_mat, 
                                 B_prior_mat_weighted = B_prior_mat_weighted(BN_mod_res))

The parameter “gene_ID” determines the IDs used in the final network. There are two options: “gene_symbol” (default) or “entrezID”.

We can plot the resulting regulatory network inferred by IntOMICS using ggraph_weighted_net function (node size and label size can be modified):

ggraph_weighted_net(net = weighted_net_res, 
                    node_size = 10, 
                    node_label_size = 4, 
                    edge_label_size = 4)

Edges highlighted in blue are known from the biological prior knowledge. The edge labels reflect its empirical frequency over the final set of CPDAGs. GE node names are in upper case, CNV node names are in lower case, and METH node names are the same as DNA methylation probe names in omics$meth matrix. Node colour scales are given by GE/CNV/METH values of all features from the corresponding input data matrix.

We can also change the edge labels to inspect the empirical prior knowledge inferred by IntOMICS using the argument “edge_weights = empB” (default = “MCMC_freq”):

weighted_net_res <- weighted_net(cpdag_weights = res_weighted,
                                 gene_annot = gene_annot, 
                                 PK = PK, 
                                 OMICS_mod_res = OMICS_mod_res, 
                                 gene_ID = "gene_symbol", 
                                 edge_weights = "empB",
                                 TFtargs = TFtarg_mat, 
                                 B_prior_mat_weighted = B_prior_mat_weighted(BN_mod_res))
ggraph_weighted_net(net = weighted_net_res)

Function empB_heatmap can be used to check the difference between empirical biological knowledge and biological prior knowledge in GE-GE interactions:

emp_b_heatmap(mcmc_res = BN_mod_res, 
             OMICS_mod_res = OMICS_mod_res, 
             gene_annot = gene_annot, 
             TFtargs = TFtarg_mat)

Interactions with constant biological knowledge are highlighted in gray.

Interesting could be also density of the edge weights inferred by IntOMICS. First of all, we have to use the edge_weights function without the edge weights filtering:

res_weighted <- edge_weights(mcmc_res = BN_mod_res, 
                            burn_in = 10000, 
                            thin = 500,
                            edge_freq_thres = NULL)
                            
weighted_net_res <- weighted_net(cpdag_weights = res_weighted,
                                 gene_annot = gene_annot, 
                                 PK = PK, 
                                 OMICS_mod_res = OMICS_mod_res, 
                                 gene_ID = "gene_symbol", 
                                 TFtargs = TFtarg_mat, 
                                 B_prior_mat_weighted = B_prior_mat_weighted(BN_mod_res))

dens_edge_weights(weighted_net_res)

4 References

Appendix

  1. Yang, J. & Rosenthal, J. S. (2017). Automatically tuned general-purpose MCMC via new adaptive diagnostics. Computational Statistics, 32, 315 – 348.

  2. Su, C. & Borsuk, M. E. (2016). Improving Structure MCMC for Bayesian Networks through Markov Blanket Resampling. Journal of Machine Learning Research, 17, 1 – 20.

  3. Pacinkova, A. & Popovici, V. (2022). Using Empirical Biological Knowledge to Infer Regulatory Networks From Multi-omics Data. BMC Bioinformatics, 23. Ogata, H., et al. (1999). KEGG: Kyoto Encyclopedia of Genes and Genomes. Nucleic Acids Res 27, 29–34.

  4. Wu, G. & Haw, R. (2017). Functional Interaction Network Construction and Analysis for Disease Discovery. Methods Mol Biol. 1558, 235–253. ENCODE Project Consortium (2004). The ENCODE (ENCyclopedia Of DNA Elements) Project. Science 22, 636-40.

  5. Agostinho, N. B. et al. (2015). Inference of regulatory networks with a convergence improved MCMC sampler. BMC Bioinformatics, 16.

sessionInfo()
## R version 4.3.1 (2023-06-16)
## Platform: x86_64-pc-linux-gnu (64-bit)
## Running under: Ubuntu 22.04.3 LTS
## 
## Matrix products: default
## BLAS:   /home/biocbuild/bbs-3.18-bioc/R/lib/libRblas.so 
## LAPACK: /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.10.0
## 
## locale:
##  [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C              
##  [3] LC_TIME=en_GB              LC_COLLATE=C              
##  [5] LC_MONETARY=en_US.UTF-8    LC_MESSAGES=en_US.UTF-8   
##  [7] LC_PAPER=en_US.UTF-8       LC_NAME=C                 
##  [9] LC_ADDRESS=C               LC_TELEPHONE=C            
## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C       
## 
## time zone: America/New_York
## tzcode source: system (glibc)
## 
## attached base packages:
## [1] parallel  stats4    stats     graphics  grDevices utils     datasets 
## [8] methods   base     
## 
## other attached packages:
##  [1] HDF5Array_1.30.0            rhdf5_2.46.0               
##  [3] ggraph_2.1.0                ggplot2_3.4.4              
##  [5] gplots_3.1.3                bestNormalize_1.9.1        
##  [7] RColorBrewer_1.1-3          bnstruct_1.0.14            
##  [9] igraph_1.5.1                bitops_1.0-7               
## [11] bnlearn_4.9                 TCGAutils_1.22.0           
## [13] curatedTCGAData_1.23.7      MultiAssayExperiment_1.28.0
## [15] SummarizedExperiment_1.32.0 Biobase_2.62.0             
## [17] GenomicRanges_1.54.0        GenomeInfoDb_1.38.0        
## [19] IRanges_2.36.0              S4Vectors_0.40.0           
## [21] BiocGenerics_0.48.0         MatrixGenerics_1.14.0      
## [23] matrixStats_1.0.0           IntOMICS_1.2.0             
## [25] BiocStyle_2.30.0           
## 
## loaded via a namespace (and not attached):
##   [1] splines_4.3.1                 later_1.3.1                  
##   [3] BiocIO_1.12.0                 filelock_1.0.2               
##   [5] tibble_3.2.1                  polyclip_1.10-6              
##   [7] hardhat_1.3.0                 XML_3.99-0.14                
##   [9] rpart_4.1.21                  lifecycle_1.0.3              
##  [11] doParallel_1.0.17             globals_0.16.2               
##  [13] lattice_0.22-5                MASS_7.3-60                  
##  [15] magrittr_2.0.3                sass_0.4.7                   
##  [17] rmarkdown_2.25                jquerylib_0.1.4              
##  [19] yaml_2.3.7                    httpuv_1.6.12                
##  [21] doRNG_1.8.6                   cowplot_1.1.1                
##  [23] DBI_1.1.3                     lubridate_1.9.3              
##  [25] abind_1.4-5                   zlibbioc_1.48.0              
##  [27] rvest_1.0.3                   purrr_1.0.2                  
##  [29] RCurl_1.98-1.12               nnet_7.3-19                  
##  [31] tweenr_2.0.2                  rappdirs_0.3.3               
##  [33] ipred_0.9-14                  lava_1.7.2.1                 
##  [35] GenomeInfoDbData_1.2.11       ggrepel_0.9.4                
##  [37] listenv_0.9.0                 nortest_1.0-4                
##  [39] parallelly_1.36.0             codetools_0.2-19             
##  [41] DelayedArray_0.28.0           xml2_1.3.5                   
##  [43] ggforce_0.4.1                 tidyselect_1.2.0             
##  [45] farver_2.1.1                  viridis_0.6.4                
##  [47] BiocFileCache_2.10.0          butcher_0.3.3                
##  [49] GenomicAlignments_1.38.0      jsonlite_1.8.7               
##  [51] ellipsis_0.3.2                tidygraph_1.2.3              
##  [53] survival_3.5-7                iterators_1.0.14             
##  [55] foreach_1.5.2                 tools_4.3.1                  
##  [57] progress_1.2.2                Rcpp_1.0.11                  
##  [59] glue_1.6.2                    BiocBaseUtils_1.4.0          
##  [61] prodlim_2023.08.28            GenomicDataCommons_1.26.0    
##  [63] gridExtra_2.3                 SparseArray_1.2.0            
##  [65] xfun_0.40                     dplyr_1.1.3                  
##  [67] withr_2.5.1                   BiocManager_1.30.22          
##  [69] fastmap_1.1.1                 rhdf5filters_1.14.0          
##  [71] fansi_1.0.5                   numbers_0.8-5                
##  [73] caTools_1.18.2                digest_0.6.33                
##  [75] timechange_0.2.0              R6_2.5.1                     
##  [77] mime_0.12                     colorspace_2.1-0             
##  [79] gtools_3.9.4                  biomaRt_2.58.0               
##  [81] RSQLite_2.3.1                 utf8_1.2.4                   
##  [83] tidyr_1.3.0                   generics_0.1.3               
##  [85] data.table_1.14.8             recipes_1.0.8                
##  [87] rtracklayer_1.62.0            class_7.3-22                 
##  [89] prettyunits_1.2.0             graphlayouts_1.0.1           
##  [91] httr_1.4.7                    S4Arrays_1.2.0               
##  [93] pkgconfig_2.0.3               gtable_0.3.4                 
##  [95] timeDate_4022.108             blob_1.2.4                   
##  [97] XVector_0.42.0                htmltools_0.5.6.1            
##  [99] bookdown_0.36                 scales_1.2.1                 
## [101] png_0.1-8                     gower_1.0.1                  
## [103] knitr_1.44                    rjson_0.2.21                 
## [105] tzdb_0.4.0                    curl_5.1.0                   
## [107] cachem_1.0.8                  stringr_1.5.0                
## [109] BiocVersion_3.18.0            KernSmooth_2.23-22           
## [111] AnnotationDbi_1.64.0          restfulr_0.0.15              
## [113] pillar_1.9.0                  grid_4.3.1                   
## [115] vctrs_0.6.4                   promises_1.2.1               
## [117] dbplyr_2.3.4                  xtable_1.8-4                 
## [119] evaluate_0.22                 magick_2.8.1                 
## [121] readr_2.1.4                   GenomicFeatures_1.54.0       
## [123] Rsamtools_2.18.0              cli_3.6.1                    
## [125] compiler_4.3.1                rlang_1.1.1                  
## [127] crayon_1.5.2                  rngtools_1.5.2               
## [129] future.apply_1.11.0           labeling_0.4.3               
## [131] stringi_1.7.12                BiocParallel_1.36.0          
## [133] viridisLite_0.4.2             munsell_0.5.0                
## [135] Biostrings_2.70.0             Matrix_1.6-1.1               
## [137] ExperimentHub_2.10.0          hms_1.1.3                    
## [139] bit64_4.0.5                   future_1.33.0                
## [141] Rhdf5lib_1.24.0               KEGGREST_1.42.0              
## [143] shiny_1.7.5.1                 interactiveDisplayBase_1.40.0
## [145] AnnotationHub_3.10.0          memoise_2.0.1                
## [147] bslib_0.5.1                   bit_4.0.5