Y-h. Taguchi1*
1Department of Physics, Chuo University, Tokyo 112-8551, Japan
#library(TDbasedUFEadv)
Since TDbasedUFEadv is an advanced package from TDbasedUFE (Taguchi 2023), please master the contents in TDbasedUFE prior to the trial of this package.
Since the publication of the book (Taguchi 2020) describing the methodology, I have published numerous papers using this method. In spite of that, very limited number of researcher used this method, possibly because of unfamiliarity with the mathematical concepts used in this methodology, tensors. Thus I decided to develop the packages by which users can use the methods without detailed knowledge about the tensor.
The main purpose of this package is to select features (typically genes) based upon provided omics data sets. In this sense, apparently the functionality of this package is similar to DESeq2 or limma, which have functionality that can identify differentially expressed genes. In contrast to those supervised methods, the present method is unsupervised one, which provides users what kind of profiles are observed over samples, and users are advised to select one of favorite features by which features are selected. In addition to this, the present method is suitable to small number of samples associated with large number of features. Since this situation is very common in genomics, the present method is supposed to be suitable to be applied to genomics, although it does not look liked the methods very specific to genomics science. Actually, we have published the number of papers using the methods implemented in the present package. I hope that one can make use of this package for his/her own researches.
Suppose we have two omics profiles \[ x_{ij} \in \mathbb{R}^{N \times M} \\ x_{ik} \in \mathbb{R}^{N \times K} \] that represent values of \(i\)th feature of \(j\)th and \(k\)th objects, respectively (i.r., these two profiles share the features). In this case, we generate a tensor, \(x_{ijk}\), by the product of two profiles as \[ x_{ijk} = x_{ij}x_{ik} \in \mathbb{R}^{N \times M \times K} \]
and HOSVD was applied to \(x_{ijk}\) to get \[ x_{ijk} = \sum_{\ell_1} \sum_{\ell_2} \sum_{ell_3} G(\ell_1 \ell_2 \ell_3) u_{\ell_1 i} u_{\ell_2 j} u_{\ell_3 k} \] After that we can follow the standard procedure to select features \(i\)s associated with the desired properties represented by the selected singular value vectors, \(u_{\ell_2 j}\) and \(u_{\ell_3 k}\), attributed to objects, \(j\)s and \(k\)s.
In the above, we dealt with full tensor. It is often difficult to treat full tensor, since it is as large as \(N \times M times K\). In this case, we can take the alternative approach. In order that we define reduced matrix with taking partial summation \[ x_{jk} = \sum_i x_{ijk} \] and apply SVD to \(x_{jk}\) as \[ x_{jk} = \sum_\ell \lambda_\ell u_{\ell j} v_{\ell k} \] and singular value vectors attributed to samples as \[ u^{(j)}_{\ell i} = \sum_j u_{\ell j} x_{ij} \\ u^{(k)}_{\ell i} = \sum_k v_{\ell k} x_{ik} \] In this case, singular value vectors are attributed separately to features associated with objects \(j\) and \(k\), respectively.
The feature selection can be done using these singular value vectors associated with selected singular value vectors attributed to samples, \(j\) and \(k\).
In the case where not features but samples are shared between two omics data, we can do something similar. \[ x_{ij} \in \mathbb{R}^{N \times M} \\ x_{kj} \in \mathbb{R}^{K \times M} \]
In this case, we generate a tensor, \(x_{ijk}\), by the product of two profiles as \[ x_{ijk} = x_{ij}x_{kj} \in \mathbb{R}^{N \times M \times K} \]
and HOSVD was applied to \(x_{ijk}\) to get \[ x_{ijk} = \sum_{\ell_1} \sum_{\ell_2} \sum_{ell_3} G(\ell_1 \ell_2 \ell_3) u_{\ell_1 i} u_{\ell_2 j} u_{\ell_3 k} \] After that we can follow the standard procedure to select features \(i\)s and \(k\)s associated with the desired properties represented by the selected singular value vectors, \(u_{\ell_2 j}\), attributed to objects, \(j\)s.
In the above, we dealt with full tensor. It is often difficult to treat full tensor, since it is as large as \(N \times M times K\). In this case, we can take the alternative approach. In order that we define reduced matrix with taking partial summation \[ x_{ik} = \sum_j x_{ijk} \] and apply SVD to \(x_{jk}\) as \[ x_{ik} = \sum_\ell \lambda_\ell u_{\ell i} v_{\ell k} \] \(i\)s and \(k\)s are selected with \(u_{\ell i}\) and \(v_{\ell k}\), respectively. Singular value vectors attributed to samples can be computed as \[ u^{(i)}_{\ell j} = \sum_i u_{\ell i} x_{ij} \\ u^{(k)}_{\ell j} = \sum_k v_{\ell k} x_{kj} \]
Here we would like to propose an alternative strategy to integrate multiple tensors using projection with SVD.
Suppose we have multiomics data as \[ x_{ijk} \in \mathbb{R}^{N_k \times M \times K} \] for \(i\)th feature of \(j\)th sample at \(k\)th omics data.
In order to bundle them into a tensor, we applied SVD to them as \[ x_{ijk} = \sum_{\ell} \lambda^{(k)}_\ell u_{\ell i_k} v^{(k)}_{\ell j} \]
Then apply HOSVD to \(v^{(k)}_{\ell j}\) as \[ v^{(k)}_{\ell j} = \sum_{\ell_1} \sum_{\ell_2} \sum_{\ell_3} G(\ell_1 \ell_2 \ell_3) u_{\ell_1 \ell } u_{\ell_2 j} u_{\ell_3 k} \] After identifying the \(u_{\ell_2j}\) and \(u_{\ell_3 k}\) of interest, we can compute \(u_{\ell i_k}\) as \[ u_{\ell_2 i_k} = \sum_j u_{\ell_2 j} x_{i_k j k} \] Then \(i_k\) can be selected as usual.
Suppose we have multiple sets of samples as \[ x_{ij_k k} \in \mathbb{R}^{N \times M_k \times K} \]
In order to bundle them into a tensor, we apply SVD to \(x_{i j_k k}\) as \[ x_{i j_k k} = \sum_\ell \lambda^{(k)}_\ell u^{(k)}_{\ell i} u_{\ell j_k} \] HOSVD is applied to \(u^{(k)}_{\ell i}\) as \[ u^{(k)}_{\ell i} = \sum_{\ell_1} \sum_{\ell_2} \sum_{\ell_3} G(\ell_1 \ell_2 \ell_3) u_{\ell_1 \ell} u_{\ell_2 i} u_{\ell_3 k} \] \(u_{\ell_2 j_k}\) is generated as \[ u_{\ell_2 j_k} = \sum_i u_{\ell_2 i}x_{i j_k k} \]
After identifying \(u_{\ell_2 j_k}\)s of interest, we select \(i\)s using \(u_{\ell_2 i}\).
sessionInfo()
#> R version 4.3.0 RC (2023-04-13 r84269)
#> Platform: x86_64-pc-linux-gnu (64-bit)
#> Running under: Ubuntu 22.04.2 LTS
#>
#> Matrix products: default
#> BLAS: /home/biocbuild/bbs-3.17-bioc/R/lib/libRblas.so
#> LAPACK: /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.10.0
#>
#> locale:
#> [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C
#> [3] LC_TIME=en_GB LC_COLLATE=C
#> [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
#> [7] LC_PAPER=en_US.UTF-8 LC_NAME=C
#> [9] LC_ADDRESS=C LC_TELEPHONE=C
#> [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
#>
#> time zone: America/New_York
#> tzcode source: system (glibc)
#>
#> attached base packages:
#> [1] stats graphics grDevices utils datasets methods base
#>
#> other attached packages:
#> [1] STRINGdb_2.12.0 enrichR_3.2
#> [3] RTCGA.clinical_20151101.29.0 RTCGA.rnaseq_20151101.29.0
#> [5] RTCGA_1.30.0 enrichplot_1.20.0
#> [7] DOSE_3.26.0 TDbasedUFEadv_1.0.0
#> [9] TDbasedUFE_1.0.0 BiocStyle_2.28.0
#>
#> loaded via a namespace (and not attached):
#> [1] rTensor_1.4.8 splines_4.3.0 later_1.3.0
#> [4] bitops_1.0-7 ggplotify_0.1.0 tibble_3.2.1
#> [7] polyclip_1.10-4 XML_3.99-0.14 lifecycle_1.0.3
#> [10] rstatix_0.7.2 lattice_0.21-8 MASS_7.3-59
#> [13] backports_1.4.1 magrittr_2.0.3 sass_0.4.5
#> [16] rmarkdown_2.21 jquerylib_0.1.4 yaml_2.3.7
#> [19] plotrix_3.8-2 httpuv_1.6.9 cowplot_1.1.1
#> [22] DBI_1.1.3 RColorBrewer_1.1-3 abind_1.4-5
#> [25] MOFAdata_1.15.0 zlibbioc_1.46.0 rvest_1.0.3
#> [28] GenomicRanges_1.52.0 purrr_1.0.1 ggraph_2.1.0
#> [31] BiocGenerics_0.46.0 RCurl_1.98-1.12 hash_2.2.6.2
#> [34] yulab.utils_0.0.6 WriteXLS_6.4.0 tweenr_2.0.2
#> [37] GenomeInfoDbData_1.2.10 IRanges_2.34.0 KMsurv_0.1-5
#> [40] S4Vectors_0.38.0 ggrepel_0.9.3 tidytree_0.4.2
#> [43] proto_1.0.0 codetools_0.2-19 xml2_1.3.3
#> [46] ggforce_0.4.1 tximportData_1.27.0 tidyselect_1.2.0
#> [49] aplot_0.1.10 farver_2.1.1 viridis_0.6.2
#> [52] stats4_4.3.0 jsonlite_1.8.4 ellipsis_0.3.2
#> [55] tidygraph_1.2.3 survival_3.5-5 tools_4.3.0
#> [58] chron_2.3-60 treeio_1.24.0 Rcpp_1.0.10
#> [61] glue_1.6.2 gridExtra_2.3 xfun_0.39
#> [64] qvalue_2.32.0 ggthemes_4.2.4 GenomeInfoDb_1.36.0
#> [67] dplyr_1.1.2 withr_2.5.0 BiocManager_1.30.20
#> [70] fastmap_1.1.1 fansi_1.0.4 caTools_1.18.2
#> [73] digest_0.6.31 R6_2.5.1 mime_0.12
#> [76] gridGraphics_0.5-1 colorspace_2.1-0 GO.db_3.17.0
#> [79] gtools_3.9.4 RSQLite_2.3.1 utf8_1.2.3
#> [82] tidyr_1.3.0 generics_0.1.3 data.table_1.14.8
#> [85] graphlayouts_0.8.4 httr_1.4.5 scatterpie_0.1.9
#> [88] sqldf_0.4-11 pkgconfig_2.0.3 gtable_0.3.3
#> [91] blob_1.2.4 XVector_0.40.0 survMisc_0.5.6
#> [94] shadowtext_0.1.2 htmltools_0.5.5 carData_3.0-5
#> [97] bookdown_0.33 fgsea_1.26.0 scales_1.2.1
#> [100] Biobase_2.60.0 png_0.1-8 ggfun_0.0.9
#> [103] knitr_1.42 km.ci_0.5-6 tzdb_0.3.0
#> [106] reshape2_1.4.4 rjson_0.2.21 nlme_3.1-162
#> [109] curl_5.0.0 cachem_1.0.7 zoo_1.8-12
#> [112] stringr_1.5.0 KernSmooth_2.23-20 parallel_4.3.0
#> [115] HDO.db_0.99.1 AnnotationDbi_1.62.0 pillar_1.9.0
#> [118] grid_4.3.0 vctrs_0.6.2 gplots_3.1.3
#> [121] promises_1.2.0.1 ggpubr_0.6.0 car_3.1-2
#> [124] xtable_1.8-4 tximport_1.28.0 evaluate_0.20
#> [127] readr_2.1.4 gsubfn_0.7 cli_3.6.1
#> [130] compiler_4.3.0 rlang_1.1.0 crayon_1.5.2
#> [133] ggsignif_0.6.4 labeling_0.4.2 survminer_0.4.9
#> [136] plyr_1.8.8 stringi_1.7.12 viridisLite_0.4.1
#> [139] BiocParallel_1.34.0 assertthat_0.2.1 munsell_0.5.0
#> [142] Biostrings_2.68.0 lazyeval_0.2.2 GOSemSim_2.26.0
#> [145] Matrix_1.5-4 hms_1.1.3 patchwork_1.1.2
#> [148] bit64_4.0.5 ggplot2_3.4.2 KEGGREST_1.40.0
#> [151] shiny_1.7.4 highr_0.10 igraph_1.4.2
#> [154] broom_1.0.4 memoise_2.0.1 bslib_0.4.2
#> [157] ggtree_3.8.0 fastmatch_1.1-3 bit_4.0.5
#> [160] ape_5.7-1
Taguchi, Y-H. 2020. Unsupervised Feature Extraction Applied to Bioinformatics. Springer International Publishing. https://doi.org/10.1007/978-3-030-22456-1.
———. 2023. TDbasedUFE: Tensor Decomposition Bassed Unsupervised Feature Extraction. https://github.com/tagtag/TDbasedUFE.