Galfrè Silvia Giulia
| Snapshot Date: 2025-11-05 13:40 -0500 (Wed, 05 Nov 2025) |
| git_url: https://git.bioconductor.org/packages/COTAN |
| git_branch: devel |
| git_last_commit: cf71097 |
| git_last_commit_date: 2025-10-29 11:14:37 -0500 (Wed, 29 Oct 2025) |
| Back to Build/check report for BioC 3.23: simplified long |
|
This page was generated on 2025-11-06 11:32 -0500 (Thu, 06 Nov 2025).
| Hostname | OS | Arch (*) | R version | Installed pkgs |
|---|---|---|---|---|
| nebbiolo1 | Linux (Ubuntu 24.04.3 LTS) | x86_64 | R Under development (unstable) (2025-10-20 r88955) -- "Unsuffered Consequences" | 4818 |
| Click on any hostname to see more info about the system (e.g. compilers) (*) as reported by 'uname -p', except on Windows and Mac OS X | ||||
| Package 450/2323 | Hostname | OS / Arch | INSTALL | BUILD | CHECK | BUILD BIN | ||||||||
| COTAN 2.11.0 (landing page) Galfrè Silvia Giulia
| nebbiolo1 | Linux (Ubuntu 24.04.3 LTS) / x86_64 | OK | OK | OK | | ||||||||
|
To the developers/maintainers of the COTAN package: - Allow up to 24 hours (and sometimes 48 hours) for your latest push to git@git.bioconductor.org:packages/COTAN.git to reflect on this report. See Troubleshooting Build Report for more information. - Use the following Renviron settings to reproduce errors and warnings. - If 'R CMD check' started to fail recently on the Linux builder(s) over a missing dependency, add the missing dependency to 'Suggests:' in your DESCRIPTION file. See Renviron.bioc for more information. |
| Package: COTAN |
| Version: 2.11.0 |
| Command: /home/biocbuild/bbs-3.23-bioc/R/bin/R CMD check --install=check:COTAN.install-out.txt --library=/home/biocbuild/bbs-3.23-bioc/R/site-library --timings COTAN_2.11.0.tar.gz |
| StartedAt: 2025-11-05 22:19:14 -0500 (Wed, 05 Nov 2025) |
| EndedAt: 2025-11-05 22:51:30 -0500 (Wed, 05 Nov 2025) |
| EllapsedTime: 1936.3 seconds |
| RetCode: 0 |
| Status: OK |
| CheckDir: COTAN.Rcheck |
| Warnings: 0 |
##############################################################################
##############################################################################
###
### Running command:
###
### /home/biocbuild/bbs-3.23-bioc/R/bin/R CMD check --install=check:COTAN.install-out.txt --library=/home/biocbuild/bbs-3.23-bioc/R/site-library --timings COTAN_2.11.0.tar.gz
###
##############################################################################
##############################################################################
* using log directory ‘/home/biocbuild/bbs-3.23-bioc/meat/COTAN.Rcheck’
* using R Under development (unstable) (2025-10-20 r88955)
* using platform: x86_64-pc-linux-gnu
* R was compiled by
gcc (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0
GNU Fortran (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0
* running under: Ubuntu 24.04.3 LTS
* using session charset: UTF-8
* checking for file ‘COTAN/DESCRIPTION’ ... OK
* checking extension type ... Package
* this is package ‘COTAN’ version ‘2.11.0’
* package encoding: UTF-8
* checking package namespace information ... OK
* checking package dependencies ... INFO
Imports includes 26 non-default packages.
Importing from so many packages makes the package vulnerable to any of
them becoming unavailable. Move as many as possible to Suggests and
use conditionally.
* checking if this is a source package ... OK
* checking if there is a namespace ... OK
* checking for hidden files and directories ... OK
* checking for portable file names ... OK
* checking for sufficient/correct file permissions ... OK
* checking whether package ‘COTAN’ can be installed ... OK
* checking installed package size ... OK
* checking package directory ... OK
* checking ‘build’ directory ... OK
* checking DESCRIPTION meta-information ... OK
* checking top-level files ... OK
* checking for left-over files ... OK
* checking index information ... OK
* checking package subdirectories ... OK
* checking code files for non-ASCII characters ... OK
* checking R files for syntax errors ... OK
* checking whether the package can be loaded ... OK
* checking whether the package can be loaded with stated dependencies ... OK
* checking whether the package can be unloaded cleanly ... OK
* checking whether the namespace can be loaded with stated dependencies ... OK
* checking whether the namespace can be unloaded cleanly ... OK
* checking loading without being on the library search path ... OK
* checking whether startup messages can be suppressed ... OK
* checking dependencies in R code ... OK
* checking S3 generic/method consistency ... OK
* checking replacement functions ... OK
* checking foreign function calls ... OK
* checking R code for possible problems ... OK
* checking Rd files ... OK
* checking Rd metadata ... OK
* checking Rd cross-references ... OK
* checking for missing documentation entries ... OK
* checking for code/documentation mismatches ... OK
* checking Rd \usage sections ... OK
* checking Rd contents ... OK
* checking for unstated dependencies in examples ... OK
* checking contents of ‘data’ directory ... OK
* checking data for non-ASCII characters ... OK
* checking data for ASCII and uncompressed saves ... OK
* checking files in ‘vignettes’ ... OK
* checking examples ... OK
Examples with CPU (user + system) or elapsed time > 5s
user system elapsed
UniformClusters 66.665 0.295 66.184
CalculatingCOEX 54.804 0.304 54.052
HandlingClusterizations 41.812 0.237 41.707
HeatmapPlots 31.646 0.430 31.316
ParametersEstimations 22.797 0.246 23.028
GenesStatistics 11.135 0.044 10.883
COTAN_ObjectCreation 10.312 0.207 10.236
Conversions 5.121 0.038 5.159
* checking for unstated dependencies in ‘tests’ ... OK
* checking tests ...
Running ‘outputTestDatasetCreation.R’
Running ‘spelling.R’
Running ‘testthat.R’
OK
* checking for unstated dependencies in vignettes ... OK
* checking package vignettes ... OK
* checking re-building of vignette outputs ... OK
* checking PDF version of manual ... OK
* DONE
Status: OK
COTAN.Rcheck/00install.out
############################################################################## ############################################################################## ### ### Running command: ### ### /home/biocbuild/bbs-3.23-bioc/R/bin/R CMD INSTALL COTAN ### ############################################################################## ############################################################################## * installing to library ‘/home/biocbuild/bbs-3.23-bioc/R/site-library’ * installing *source* package ‘COTAN’ ... ** this is package ‘COTAN’ version ‘2.11.0’ ** using staged installation ** R ** data ** inst ** byte-compile and prepare package for lazy loading ** help *** installing help indices ** building package indices ** installing vignettes ** testing if installed package can be loaded from temporary location ** testing if installed package can be loaded from final location ** testing if installed package keeps a record of temporary installation path * DONE (COTAN)
COTAN.Rcheck/tests/outputTestDatasetCreation.Rout
R Under development (unstable) (2025-10-20 r88955) -- "Unsuffered Consequences"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
>
> # Creates the files to be reloaded by the tests for comparisons
>
> outputTestDatasetCreation <-
+ function(testsDir = file.path("tests", "testthat")) {
+ utils::data("test.dataset", package = "COTAN")
+ options(parallelly.fork.enable = TRUE)
+ setLoggingLevel(3L)
+
+ obj <- COTAN(raw = test.dataset)
+ obj <- initializeMetaDataset(objCOTAN = obj, GEO = " ",
+ sequencingMethod = "artificial",
+ sampleCondition = "test")
+
+ obj <- proceedToCoex(objCOTAN = obj, cores = 6L, saveObj = FALSE)
+
+ if (FALSE) {
+ saveRDS(obj, file = file.path(testsDir,"test.COTAN.RDS"))
+ }
+
+ cells.names.test <-
+ getCells(objCOTAN = obj)[c(1L:10L, 591L:610L, 991L:1000L)]
+ genes.names.test <-
+ getGenes(objCOTAN = obj)[c(131L:140L, 291L:310L, 591L: 600L)]
+ saveRDS(cells.names.test, file.path(testsDir, "cells.names.test.RDS"))
+ saveRDS(genes.names.test, file.path(testsDir, "genes.names.test.RDS"))
+
+ pcaRaw <- runPCA(x = getRawData(objCOTAN = obj), rank = 10L,
+ BSPARAM = IrlbaParam(), get.rotation = FALSE)[["x"]]
+
+ pca.raw.test <- pcaRaw[genes.names.test, ]
+ saveRDS(pca.raw.test, file.path(testsDir, "pca.raw.test.RDS"))
+
+ dispersion.test <- getDispersion(objCOTAN = obj)[genes.names.test]
+ saveRDS(dispersion.test, file.path(testsDir, "dispersion.test.RDS"))
+
+ raw.norm.test <-
+ getNuNormData(objCOTAN = obj)[genes.names.test, cells.names.test]
+ saveRDS(raw.norm.test, file.path(testsDir, "raw.norm.test.RDS"))
+
+ coex.test <-
+ getGenesCoex(objCOTAN = obj, genes = genes.names.test, zeroDiagonal = FALSE)
+ saveRDS(coex.test, file.path(testsDir, "coex.test.RDS"))
+
+ lambda.test <- getLambda(objCOTAN = obj)[genes.names.test]
+ saveRDS(lambda.test, file.path(testsDir, "lambda.test.RDS"))
+
+ GDI.test <- calculateGDI(objCOTAN = obj)
+ GDI.test <- GDI.test[genes.names.test, ]
+ saveRDS(GDI.test, file.path(testsDir, "GDI.test.RDS"))
+
+ nu.test <- getNu(objCOTAN = obj)[cells.names.test]
+ saveRDS(nu.test, file.path(testsDir, "nu.test.RDS"))
+
+ pvalues.test <- calculatePValue(objCOTAN = obj,
+ geneSubsetCol = genes.names.test,
+ geneSubsetRow = genes.names.test)
+ saveRDS(pvalues.test, file.path(testsDir, "pvalues.test.RDS"))
+
+ groupMarkers <- list(G1 = c("g-000010", "g-000020", "g-000138"),
+ G2 = c("g-000300", "g-000330", "g-000660"),
+ G3 = c("g-000510", "g-000530", "g-000550",
+ "g-000570", "g-000590"))
+
+ gcsData <- genesCoexSpace(objCOTAN = obj,
+ primaryMarkers = unlist(groupMarkers),
+ numGenesPerMarker = 11L)
+
+ genes.coex.space.test <- gcsData[["GCS"]]
+ saveRDS(genes.coex.space.test,
+ file.path(testsDir, "genes.coex.space.test.RDS"))
+
+ genesClustersData <-
+ establishGenesClusters(objCOTAN = obj,
+ groupMarkers = groupMarkers,
+ numGenesPerMarker = 11L,
+ kCuts = 6L, distance = "cosine",
+ hclustMethod = "ward.D2")
+
+ pca.genes.clusters.test <- genesClustersData[["pca_clusters"]]
+ saveRDS(pca.genes.clusters.test,
+ file.path(testsDir, "pca.genes.clusters.test.RDS"))
+
+ # Make it a less strict check as it is only for testing
+ checker <- new("AdvancedGDIUniformityCheck")
+ checker <- shiftCheckerThresholds(checker, 0.1)
+
+ initialResolution <- 1.3
+ splitData <- cellsUniformClustering(objCOTAN = obj,
+ checker = checker,
+ initialResolution = initialResolution,
+ useCoexEigen = TRUE,
+ dataMethod = "LL",
+ numReducedComp = 50L,
+ cores = 6L, optimizeForSpeed = TRUE,
+ deviceStr = "cuda", saveObj = FALSE)
+
+ split.clusters.test <- splitData[["clusters"]]
+ saveRDS(split.clusters.test,
+ file = file.path(testsDir, "split.clusters.test.RDS"))
+
+ test.dataset.clusters1 <- split.clusters.test
+ save(test.dataset.clusters1, compress = TRUE,
+ file = file.path("data", "test.dataset.clusters1.rda"))
+
+ obj <- addClusterization(objCOTAN = obj,
+ clName = "split",
+ clusters = splitData[["clusters"]],
+ coexDF = splitData[["coex"]])
+
+ coex.clusters.test <- splitData[["coex"]][genes.names.test, ]
+ saveRDS(coex.clusters.test, file.path(testsDir, "coex.clusters.test.RDS"))
+
+ pvalDF <- pValueFromDEA(splitData[["coex"]],
+ getNumCells(objCOTAN = obj),
+ adjustmentMethod = "none")
+
+ pvalues.clusters.test <- pvalDF[genes.names.test, ]
+ saveRDS(pvalues.clusters.test,
+ file.path(testsDir, "pvalues.clusters.test.RDS"))
+
+ mergedData <- mergeUniformCellsClusters(objCOTAN = obj,
+ clusters = splitData[["clusters"]],
+ checkers = checker,
+ batchSize = 1L,
+ cores = 6L,
+ distance = "cosine",
+ hclustMethod = "ward.D2",
+ saveObj = FALSE)
+
+ merge.clusters.test <- mergedData[["clusters"]]
+ saveRDS(merge.clusters.test,
+ file = file.path(testsDir, "merge.clusters.test.RDS"))
+
+ test.dataset.clusters2 <- merge.clusters.test
+ save(test.dataset.clusters2, compress = TRUE,
+ file = file.path("data", "test.dataset.clusters2.rda"))
+
+ obj <- addClusterization(objCOTAN = obj,
+ clName = "merge",
+ clusters = mergedData[["clusters"]],
+ coexDF = mergedData[["coex"]])
+ }
>
> proc.time()
user system elapsed
0.153 0.044 0.185
COTAN.Rcheck/tests/spelling.Rout
R Under development (unstable) (2025-10-20 r88955) -- "Unsuffered Consequences"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> if (requireNamespace("spelling", quietly = TRUE))
+ spelling::spell_check_test(vignettes = TRUE, error = FALSE,
+ skip_on_cran = TRUE)
All Done!
>
> proc.time()
user system elapsed
0.148 0.041 0.178
COTAN.Rcheck/tests/testthat.Rout
R Under development (unstable) (2025-10-20 r88955) -- "Unsuffered Consequences"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> Sys.setenv(R_TESTS = "")
> library(testthat)
> library(COTAN)
> library(zeallot)
> test_check("COTAN")
Setting new log level to 4
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.742356300354
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.42348098754883
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000571250915527344
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00618886947631836
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.758508205413818
Total calculations elapsed time: 3.18874931335449
Calculate genes' COEX (legacy): DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 5 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 4 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 4.84523010253906
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 7 cells batches
Total calculations elapsed time: 0.830814123153687
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75595238095238 | median: 1.07156808035714 | mean: 1.07156808035714
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.77644753456116
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03734183779544 | max: 4.61112297272667 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.852433443069458
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0295487661210321 | median: 0.016072261901129 | mean: 0.016072261901129
`nu` mean: 1.69786080481514
Marginal errors | max: 1.95799528048 | median 1.32268477389029 | mean: 1.33563364783916
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.50078701972961
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.0585450475968788 | max: 3.52739274166646 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.889340400695801
Estimate `nu`: DONE
`nu` change (abs) | max: 0.417150556912302 | median: 0.240156504520849 | mean: 0.240156504520849
`nu` mean: 0.823005947608547
Marginal errors | max: 0.837672524335755 | median 0.704691669139065 | mean: 0.646575831699997
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.68782734870911
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.328845855849147 | max: 4.03031691940854 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.863057851791382
Estimate `nu`: DONE
`nu` change (abs) | max: 0.164439840041 | median: 0.0957105992188852 | mean: 0.0957105992188852
`nu` mean: 1.06872924082212
Marginal errors | max: 0.260109847946692 | median 0.21392791155499 | mean: 0.197565106613054
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.55292320251465
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.229469002841045 | max: 3.87206403670079 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.881200075149536
Estimate `nu`: DONE
`nu` change (abs) | max: 0.05539667181205 | median: 0.0321044921874999 | mean: 0.0321044921874999
`nu` mean: 0.97670782037545
Marginal errors | max: 0.095347789718808 | median 0.0796003827042702 | mean: 0.0725509735761708
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.59108328819275
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.263830434255107 | max: 3.92953043775907 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.780925512313843
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0196209299693411 | median: 0.0114037947200925 | mean: 0.0114037947200925
`nu` mean: 1.00821713524925
Marginal errors | max: 0.0329495161656741 | median 0.0273479725376324 | mean: 0.025029675152131
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.58435225486755
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.251734659898779 | max: 3.9096133246649 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.832213640213013
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0069104540740097 | median: 0.0040109538496062 | mean: 0.0040109538496062
`nu` mean: 0.997100499775596
Marginal errors | max: 0.0116950057438405 | median 0.00972280144873849 | mean: 0.00889105008777538
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.50147604942322
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.256009779031907 | max: 3.91667271750655 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.773811817169189
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00251004753849005 | median: 0.00146484374999994 | mean: 0.00146484374999994
`nu` mean: 1.00104520378849
Marginal errors | max: 0.00430755646112857 | median 0.00358203399504298 | mean: 0.00327684342604062
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.50215554237366
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.254429717857093 | max: 3.91406908073254 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.769206047058105
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00104629156456748 | median: 0.000592910406456731 | mean: 0.000592910406456731
`nu` mean: 0.999546618841889
Marginal errors | max: 0.00162038706091039 | median 0.00134441676098973 | mean: 0.00123030512553282
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.58145785331726
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255022049769696 | max: 3.91504587939868 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.795669317245483
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000418450901304768 | median: 0.000244140625000028 | mean: 0.000244140625000028
`nu` mean: 1.0001743102763
Marginal errors | max: 0.00071569233034019 | median 0.000597297218559056 | mean: 0.00054590699507937
Total calculations elapsed time: 43.4150536060333
Estimate `dispersion`/`nu`: DONE
Estimate `dispersion`/`nu`: START
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.57158827781677
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.58373308181763
Calculating genes' COEX normalization factor
Fraction of genes' with very low expected contingency tables: 0.181818181818182
Calculate genes' normalization factor elapsed time: 0.00068354606628418
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00294089317321777
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.832458019256592
Total calculations elapsed time: 3.41981554031372
Calculate genes' COEX (legacy): DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 2.75425601005554
Calculating cells' COEX normalization factor
Fraction of cells' with very low expected contingency tables: 0
Calculate cells' normalization factor elapsed time: 0.000715255737304688
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00222063064575195
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.806228160858154
Total calculations elapsed time: 3.56342005729675
Calculate cells' COEX (legacy): DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0100734233856201
Calculate `GDI`: DONE
Total calculations elapsed time: 2.58450031280518
Calculate GDI dataframe: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00317811965942383
Calculate `GDI`: DONE
Total calculations elapsed time: 2.500328540802
Calculate GDI dataframe: DONE
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Selected 5 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 5 genes using HVG_Seurat selector
Running genes' selection: DONE
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer data
Calculating gene means
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating gene variance to mean ratios
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Running genes' selection: START
Given 5 genes as input
Running genes' selection: DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 2.23894715309143
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.93040609359741
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Selected 8 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.78987765312195
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 8 genes using HVG_Seurat selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 2.94014406204224
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 2.63678240776062
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 2.3962709903717
Elaborating Reduced dimensionality Data Matrix - DONE
Initializing `COTAN` meta-data
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.78095746040344
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.839353799819946
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 1.735699617106 | median 1.37997441333659 | mean: 1.32181397451301
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.76870369911194
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.0655494303592343 | max: 3.54400580804152 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.93519115447998
Estimate `nu`: DONE
`nu` change (abs) | max: 0.402649984216273 | median: 0.231868788425666 | mean: 0.231868788425666
`nu` mean: 0.829218804209393
Marginal errors | max: 0.803248939260364 | median 0.677504196374571 | mean: 0.619386446933351
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.81289553642273
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.326019058449519 | max: 4.02612397202046 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.780860662460327
Estimate `nu`: DONE
`nu` change (abs) | max: 0.158004893526231 | median: 0.0919692884670312 | mean: 0.0919692884670312
`nu` mean: 1.0660356050592
Marginal errors | max: 0.25067700287536 | median 0.206241644985115 | mean: 0.190402167377958
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.8761305809021
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.230397316576369 | max: 3.87365659194104 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.858008146286011
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0532774732102337 | median: 0.0308837890624999 | mean: 0.0308837890624999
`nu` mean: 0.977606315852266
Marginal errors | max: 0.0916920322976189 | median 0.0765360853958175 | mean: 0.0697673030094085
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.69492769241333
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.263457616228195 | max: 3.928924407347 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.905836582183838
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0187878665732679 | median: 0.0109155550210726 | mean: 0.0109155550210726
`nu` mean: 1.0078723115522
Marginal errors | max: 0.0315207323253404 | median 0.0261635598193228 | mean: 0.0239435763640456
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.87703084945679
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.251890641847533 | max: 3.90987172241566 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.838915824890137
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00649137083358098 | median: 0.00376680890457393 | mean: 0.00376680890457393
`nu` mean: 0.997275438070993
Marginal errors | max: 0.0109748802265024 | median 0.00912386940474796 | mean: 0.00834350038184244
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.89854836463928
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255902752363649 | max: 3.91649655995187 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.0451340675354
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00230094227000666 | median: 0.00132529141000018 | mean: 0.00132529141000018
`nu` mean: 1.00097565086001
Marginal errors | max: 0.00376864912836616 | median 0.00313421412286008 | mean: 0.00286709489297579
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.75996017456055
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.254520292119112 | max: 3.91421850264948 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.805347442626953
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000837013154366462 | median: 0.000488281250000028 | mean: 0.000488281250000028
`nu` mean: 0.999651268095634
Marginal errors | max: 0.00144055320514802 | median 0.00119489364392944 | mean: 0.00109355439757213
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.71046590805054
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255046800817986 | max: 3.9150866760965 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.816853761672974
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000418448154490214 | median: 0.000244140624999917 | mean: 0.000244140624999917
`nu` mean: 1.00017430752949
Marginal errors | max: 0.000715683388516908 | median 0.0005972847342397 | mean: 0.00054589991652243
Total calculations elapsed time: 47.8328964710236
Estimate `dispersion`/`nu`: DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.40838599205017
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000620365142822266
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0015561580657959
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.831070184707642
Total calculations elapsed time: 3.24163269996643
Calculate genes' COEX (legacy): DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 2.38819193840027
Calculating cells' COEX normalization factor
Calculate cells' normalization factor elapsed time: 0.000560283660888672
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00144267082214355
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.874507188796997
Total calculations elapsed time: 3.2647020816803
Calculate cells' COEX (legacy): DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00307393074035645
Calculate `GDI`: DONE
Total calculations elapsed time: 2.60267853736877
Calculate GDI dataframe: DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.325
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 6.62342166900635
Calculate genes' partial COEX: DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 7.18791890144348
Calculate cells' partial COEX: DONE
Asked to drop 2 genes and 0 cells
Asked to drop 0 genes and 4 cells
Asked to drop 2 genes and 2 cells
Attaching package: 'rlang'
The following objects are masked from 'package:testthat':
is_false, is_null, is_true
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
calculating YY.. done
calculating YY.. done
calculating YN..NY..NN..t().. done
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.65890002250671
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
calculating NN.. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.63985109329224
Calculating genes' COEX normalization factor
Fraction of genes' with very low expected contingency tables: 0.181818181818182
Calculate genes' normalization factor elapsed time: 0.000784158706665039
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00146222114562988
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.809806823730469
Total calculations elapsed time: 3.451904296875
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.57723522186279
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000616788864135742
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0015709400177002
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.88233757019043
Total calculations elapsed time: 3.46176052093506
Calculate genes' COEX (legacy): DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.1
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 6.88946771621704
Calculate genes' partial COEX: DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.4
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 6.62275385856628
Calculate genes' partial COEX: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
calculating YY.. done
calculating YY.. done
calculating NY..YN..NN..t().. done
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.23355889320374
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.879249095916748
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 0.255290533439036 | median 0.080731376500534 | mean: 0.101968565509112
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.30466794967651
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03709166563768 | max: 4.61069655774133 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.821329116821289
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0273438105507502 | median: 0.0148852611818011 | mean: 0.0148852611818011
`nu` mean: 1.69735147626627
Marginal errors | max: 0.00330148418741594 | median 0.00111713187082163 | mean: 0.00132007186542964
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.46281290054321
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03887279473672 | max: 4.60974134092906 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.831136703491211
Estimate `nu`: DONE
`nu` change (abs) | max: 0 | median: 0 | mean: 0
`nu` mean: 1.69735147626627
Marginal errors | max: 5.14174422185931e-05 | median 1.6818224857218e-07 | mean: 5.57649710835051e-06
Total calculations elapsed time: 19.8820953369141
Estimate `dispersion`/`nu`: DONE
calculating NN.. done
calculating NN.. done
calculating YN..NY..YY..t().. done
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 2.49361324310303
Calculating cells' COEX normalization factor
Fraction of cells' with very low expected contingency tables: 0
Calculate cells' normalization factor elapsed time: 0.000716924667358398
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00145936012268066
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.831337451934814
Total calculations elapsed time: 3.32712697982788
Calculate cells' COEX (legacy): DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 7.43120384216309
Calculate cells' partial COEX: DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 7.19377684593201
Calculate cells' partial COEX: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.96754908561707
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.820236682891846
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 0.255290533439036 | median 0.080731376500534 | mean: 0.101968565509112
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.33823227882385
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03709166563768 | max: 4.61069655774133 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.861977100372314
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0273438105507502 | median: 0.0148852611818011 | mean: 0.0148852611818011
`nu` mean: 1.69735147626627
Marginal errors | max: 0.00330148418741594 | median 0.00111713187082163 | mean: 0.00132007186542964
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.27627325057983
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03887279473672 | max: 4.60974134092906 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.825000762939453
Estimate `nu`: DONE
`nu` change (abs) | max: 0 | median: 0 | mean: 0
`nu` mean: 1.69735147626627
Marginal errors | max: 5.14174422185931e-05 | median 1.6818224857218e-07 | mean: 5.57649710835051e-06
Total calculations elapsed time: 20.5350089073181
Estimate `dispersion`/`nu`: DONE
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.57525658607483
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000553607940673828
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00143790245056152
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.811987400054932
Total calculations elapsed time: 3.389235496521
Calculate genes' COEX (legacy): DONE
Calculating S: START
Calculating S: DONE
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 6.13958382606506
Calculating G: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and genome wide on rows
Total calculations elapsed time: 0.00224113464355469
calculating PValues: DONE
Using G
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 6.3738124370575
Calculating G: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 6.37521696090698
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00328826904296875
Calculate `GDI`: DONE
Total calculations elapsed time: 2.71789288520813
Calculate GDI dataframe: DONE
Calculate GDI dataframe: START
Using G
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 6.67051982879639
Calculating G: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00330400466918945
Calculate `GDI`: DONE
Total calculations elapsed time: 9.3421778678894
Calculate GDI dataframe: DONE
Calculate `GDI`: START
Calculating S: START
Calculating S: DONE
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00467085838317871
Calculate `GDI`: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00366044044494629
Calculate `GDI`: DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.898497581481934
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.03905057907104
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.96682119369507
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.19416546821594
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00554084777832031
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0617432594299316
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.871012210845947
Total calculations elapsed time: 4.13246178627014
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.21499824523926
Dataset analysis elapsed time: 9.08031702041626
COTAN dataset analysis: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.893470764160156
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.98556923866272
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.88014054298401
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.8473789691925
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00531172752380371
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0609593391418457
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.759302854537964
Total calculations elapsed time: 3.67295289039612
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.43911957740784
Dataset analysis elapsed time: 8.212730884552
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.0187315940856934
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0299053192138672
Calculate `GDI`: DONE
Total calculations elapsed time: 2.38946056365967
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.950291156768799
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.90834474563599
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.72057509422302
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.7144923210144
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0055241584777832
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0612828731536865
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.88192081451416
Total calculations elapsed time: 3.66322016716003
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.62000465393066
Dataset analysis elapsed time: 8.29087090492249
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.0147640705108643
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.030264139175415
Calculate `GDI`: DONE
Total calculations elapsed time: 2.43044757843018
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.83752965927124
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.85274767875671
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.69211006164551
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.9495575428009
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00591278076171875
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0618607997894287
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.840928316116333
Total calculations elapsed time: 3.85825943946838
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.67624545097351
Dataset analysis elapsed time: 8.20588517189026
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.00500798225402832
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0305979251861572
Calculate `GDI`: DONE
Total calculations elapsed time: 3.20305418968201
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Asked to drop 0 genes and 960 cells
COTAN dataset analysis: START
Asked to drop 83 genes and 0 cells
Genes/cells selection done: dropped [83] genes and [0] cells
Working on [517] genes and [40] cells
Dataset cleaning elapsed time: 1.13180232048035
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.13650012016296
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.267567793681876 | max: 101.923257389521 | % negative: 52.6112185686654
Model parameter estimation elapsed time: 3.44492387771606
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 1.34822940826416
Dataset analysis elapsed time: 5.92495560646057
COTAN dataset analysis: DONE
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.27213573455811
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0050203800201416
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0125348567962646
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.977057695388794
Total calculations elapsed time: 4.26674866676331
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.0140917301178
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00548863410949707
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0128841400146484
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.09734606742859
Total calculations elapsed time: 4.12981057167053
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.32450556755066
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00545144081115723
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0130629539489746
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.23066973686218
Total calculations elapsed time: 4.57368969917297
Calculate genes' COEX (legacy): DONE
Hangling COTAN object with condition: test
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.004180908203125
calculating PValues: DONE
Handling genes type: G2
Handling genes type: G3
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Clean plots: START
PCA: START
PCA: DONE
Hierarchical clustering: START
Hierarchical clustering: DONE
Total calculations elapsed time: 2.59804964065552
Clean plots: DONE
Dataset cleaning elapsed time: 5.17195916175842
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.74476337432861
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.86810350418091
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.28179526329041
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00613951683044434
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.064612865447998
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.967108249664307
Total calculations elapsed time: 4.31965589523315
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.37355208396912
Dataset analysis elapsed time: 14.4136147499084
COTAN dataset analysis: DONE
Saving elaborated data locally at: /tmp/RtmptTlKvv/test.cotan.RDS
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 4.20689582824707
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 44886
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.4008
Number of communities: 4
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 5.20355319976807
Creating new clusterization: DONE
Creating cells' uniform clustering: START
In iteration 1 the number of cells to re-cluster is 1000 cells belonging to 0 clusters
Asked to drop no genes or cells
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 4.15477895736694
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 36652
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.3743
Number of communities: 4
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 5.06963038444519
Creating new clusterization: DONE
Creating PDF UMAP in file: /tmp/RtmptTlKvv/test/reclustering/pdf_umap_1.pdf
UMAP plot: START
Calculating UMAP: START
22:34:51 UMAP embedding parameters a = 0.9922 b = 1.112
22:34:51 Read 1000 rows and found 65 numeric columns
22:34:51 Using Annoy for neighbor search, n_neighbors = 30
22:34:51 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:34:52 Writing NN index file to temp file /tmp/RtmptTlKvv/file244aeb281eff9c
22:34:52 Searching Annoy index using 1 thread, search_k = 3000
22:34:52 Annoy recall = 100%
22:34:53 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
22:34:56 Initializing from normalized Laplacian + noise (using RSpectra)
22:34:56 Commencing optimization for 500 epochs, with 39044 positive edges
22:34:56 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:34:59 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 7.39907240867615
UMAP plot: DONE
UMAP plot: START
Calculating UMAP: START
22:34:59 UMAP embedding parameters a = 0.9922 b = 1.112
22:34:59 Read 1000 rows and found 65 numeric columns
22:34:59 Using Annoy for neighbor search, n_neighbors = 30
22:34:59 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:34:59 Writing NN index file to temp file /tmp/RtmptTlKvv/file244aeb686495b2
22:34:59 Searching Annoy index using 1 thread, search_k = 3000
22:34:59 Annoy recall = 100%
22:35:01 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
22:35:04 Initializing from normalized Laplacian + noise (using RSpectra)
22:35:04 Commencing optimization for 500 epochs, with 39044 positive edges
22:35:04 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:35:07 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 8.0055456161499
UMAP plot: DONE
* checking uniformity of cluster '0' of 4 clusters
Asked to drop 0 genes and 687 cells
COTAN dataset analysis: START
Asked to drop 43 genes and 0 cells
Genes/cells selection done: dropped [43] genes and [0] cells
Working on [557] genes and [313] cells
Dataset cleaning elapsed time: 1.49464201927185
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 11 iterations
Total calculations elapsed time: 3.25146627426147
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.126565269702225 | max: 788.372048308528 | % negative: 38.5996409335727
Model parameter estimation elapsed time: 4.88107872009277
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 4.41213393211365
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0070347785949707
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0331830978393555
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.5202271938324
Total calculations elapsed time: 5.97257900238037
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 7.25404930114746
Dataset analysis elapsed time: 13.6297700405121
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0000' with 313 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0323820114135742
Calculate `GDI`: DONE
Total calculations elapsed time: 5.20945811271667
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0497255325317383
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0000, with size 313, is uniform
Cluster 01_0000's shift to uniformity: -0.0175178017151365
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.0412926391382406, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.37948219828486, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.0323159784560144, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.43089123341141, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.00179533213644524, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.44383613651627, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 1, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.47612588512221, isUniform = TRUE, clusterSize = 313
cluster 01_0000 is uniform
* checking uniformity of cluster '1' of 4 clusters
Asked to drop 0 genes and 743 cells
COTAN dataset analysis: START
Asked to drop 51 genes and 0 cells
Genes/cells selection done: dropped [51] genes and [0] cells
Working on [549] genes and [257] cells
Dataset cleaning elapsed time: 1.58238101005554
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 3.09705448150635
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.112503099391263 | max: 646.681464270838 | % negative: 40.8014571948998
Model parameter estimation elapsed time: 4.56677055358887
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 4.81553769111633
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00685501098632812
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.029923677444458
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.39521932601929
Total calculations elapsed time: 6.24753570556641
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 7.78235268592834
Dataset analysis elapsed time: 13.9315042495728
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0001' with 257 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0290384292602539
Calculate `GDI`: DONE
Total calculations elapsed time: 3.95831751823425
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0392792224884033
Clean plots: DONE
GDI plot
Removed 1 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0001, with size 257, is uniform
Cluster 01_0001's shift to uniformity: -0.0466523594846431
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00910746812386157, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35034764051536, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00728597449908925, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37278730407697, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38664163146849, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.45240567481124, isUniform = TRUE, clusterSize = 257
cluster 01_0001 is uniform
* checking uniformity of cluster '2' of 4 clusters
Asked to drop 0 genes and 758 cells
COTAN dataset analysis: START
Asked to drop 77 genes and 0 cells
Genes/cells selection done: dropped [77] genes and [0] cells
Working on [523] genes and [242] cells
Dataset cleaning elapsed time: 1.05541682243347
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.61853432655334
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.166254045792573 | max: 224.924342782861 | % negative: 42.6386233269598
Model parameter estimation elapsed time: 3.98024582862854
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.74261617660522
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00594687461853027
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0278522968292236
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.29219698905945
Total calculations elapsed time: 5.06861233711243
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 6.56053709983826
Dataset analysis elapsed time: 11.5961997509003
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0002' with 242 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0259604454040527
Calculate `GDI`: DONE
Total calculations elapsed time: 4.81233859062195
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0443086624145508
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0002, with size 242, is uniform
Cluster 01_0002's shift to uniformity: -0.0473527936300242
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00764818355640535, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.34964720636998, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00764818355640535, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37472946305404, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38771313919654, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.43097703442027, isUniform = TRUE, clusterSize = 242
cluster 01_0002 is uniform
* checking uniformity of cluster '3' of 4 clusters
Asked to drop 0 genes and 812 cells
COTAN dataset analysis: START
Asked to drop 79 genes and 0 cells
Genes/cells selection done: dropped [79] genes and [0] cells
Working on [521] genes and [188] cells
Dataset cleaning elapsed time: 1.34247136116028
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 6 iterations
Total calculations elapsed time: 3.09628248214722
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.210007411487223 | max: 67.8701314818728 | % negative: 45.6813819577735
Model parameter estimation elapsed time: 4.53185892105103
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 4.49286532402039
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00764369964599609
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0259575843811035
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.28972482681274
Total calculations elapsed time: 5.81619143486023
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 7.06284856796265
Dataset analysis elapsed time: 12.937178850174
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0003' with 188 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0271627902984619
Calculate `GDI`: DONE
Total calculations elapsed time: 4.62826943397522
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0403842926025391
Clean plots: DONE
GDI plot
Removed 4 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0003, with size 188, is uniform
Cluster 01_0003's shift to uniformity: -0.0672912272435866
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00383877159309021, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.32970877275641, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00191938579654511, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.35752445041521, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.37495297633956, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.4014884302523, isUniform = TRUE, clusterSize = 188
cluster 01_0003 is uniform
Found 4 uniform and 0 non-uniform clusters
Stopping: too few cells left to cluster
Unclustered cell left: 0
The final raw clusterization contains [ 4 ] different clusters: 01_0000, 01_0001, 01_0002, 01_0003
Differential Expression Analysis - START
* DEA on cluster '1' with 313 cells
* DEA on cluster '2' with 257 cells
* DEA on cluster '3' with 242 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0392017364501953
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 3, 2 -> 1, 3 -> 2, 4 -> 4
Total calculations elapsed time: 113.499676704407
Creating cells' uniform clustering: DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2, 3 -> 3, 4 -> 4
Asked to drop 0 genes and 812 cells
COTAN dataset analysis: START
Asked to drop 79 genes and 0 cells
Genes/cells selection done: dropped [79] genes and [0] cells
Working on [521] genes and [188] cells
Dataset cleaning elapsed time: 1.40407681465149
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 6 iterations
Total calculations elapsed time: 2.56810641288757
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.210007411487223 | max: 67.8701314818728 | % negative: 45.6813819577735
Model parameter estimation elapsed time: 4.16823029518127
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 5.04887580871582
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00764966011047363
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0266532897949219
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.55999612808228
Total calculations elapsed time: 6.64317488670349
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 8.07735586166382
Dataset analysis elapsed time: 13.6496629714966
COTAN dataset analysis: DONE
Checking uniformity for the cluster 'Cluster_4' with 188 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0262658596038818
Calculate `GDI`: DONE
Total calculations elapsed time: 4.39370822906494
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0441458225250244
Clean plots: DONE
GDI plot
Removed 4 low GDI genes (such as the fully-expressed) in GDI plot
Cluster Cluster_4, with size 188, is uniform
Cluster Cluster_4's shift to uniformity: -0.0672912272435866
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00383877159309021, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.32970877275641, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00191938579654511, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.35752445041521, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.37495297633956, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.4014884302523, isUniform = TRUE, clusterSize = 188
Differential Expression Analysis - START
* DEA on cluster '-1' with 50 cells
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 280 cells
* DEA on cluster '4' with 171 cells
Total calculations elapsed time: 0.0367569923400879
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 4, 2 -> 3, 3 -> 2, 4 -> 1, -1 -> -1
Applied reordering to clusterization is:
1 -> 1, 2 -> 2, 3 -> 3, 4 -> 4, -1 -> -1
Creating cells' uniform clustering: START
In iteration 1 the number of cells to re-cluster is 1000 cells belonging to 0 clusters
Asked to drop no genes or cells
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 600 genes using HVG_Seurat selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 4.71891164779663
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 67288
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.3650
Number of communities: 5
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 5.6603889465332
Creating new clusterization: DONE
Using passed in clusterization
Creating PDF UMAP in file: /tmp/RtmptTlKvv/test/reclustering/pdf_umap_1.pdf
UMAP plot: START
Calculating UMAP: START
22:37:09 UMAP embedding parameters a = 0.9922 b = 1.112
22:37:09 Read 1000 rows and found 40 numeric columns
22:37:09 Using Annoy for neighbor search, n_neighbors = 30
22:37:09 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:37:09 Writing NN index file to temp file /tmp/RtmptTlKvv/file244aeb131f36e8
22:37:09 Searching Annoy index using 1 thread, search_k = 3000
22:37:09 Annoy recall = 100%
22:37:11 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
22:37:14 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
22:37:14 Using 'irlba' for PCA
22:37:14 PCA: 2 components explained 36.15% variance
22:37:14 Scaling init to sdev = 1
22:37:14 Commencing optimization for 500 epochs, with 41630 positive edges
22:37:14 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:37:16 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 7.61733222007751
UMAP plot: DONE
UMAP plot: START
Calculating UMAP: START
22:37:17 UMAP embedding parameters a = 0.9922 b = 1.112
22:37:17 Read 1000 rows and found 40 numeric columns
22:37:17 Using Annoy for neighbor search, n_neighbors = 30
22:37:17 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:37:17 Writing NN index file to temp file /tmp/RtmptTlKvv/file244aeb6cefec5f
22:37:17 Searching Annoy index using 1 thread, search_k = 3000
22:37:17 Annoy recall = 100%
22:37:18 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
22:37:21 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
22:37:21 Using 'irlba' for PCA
22:37:21 PCA: 2 components explained 36.15% variance
22:37:21 Scaling init to sdev = 1
22:37:21 Commencing optimization for 500 epochs, with 41630 positive edges
22:37:21 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:37:23 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 6.76229691505432
UMAP plot: DONE
* checking uniformity of cluster '1' of 2 clusters
Asked to drop 0 genes and 500 cells
COTAN dataset analysis: START
Asked to drop 38 genes and 0 cells
Genes/cells selection done: dropped [38] genes and [0] cells
Working on [562] genes and [500] cells
Dataset cleaning elapsed time: 1.29027724266052
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 3.13358879089355
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.108871643378045 | max: 295.971778839086 | % negative: 35.0533807829181
Model parameter estimation elapsed time: 4.53198862075806
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 4.24484419822693
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00636744499206543
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0403704643249512
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.41906213760376
Total calculations elapsed time: 5.71064424514771
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 7.03632879257202
Dataset analysis elapsed time: 12.8585946559906
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0001' with 500 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0343174934387207
Calculate `GDI`: DONE
Total calculations elapsed time: 4.19191837310791
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0379230976104736
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0001, with size 500, is uniform
Cluster 01_0001's shift to uniformity: -0.041730199066494
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.0124555160142349, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35526980093351, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00889679715302491, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.38536328181495, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.40346106115492, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.42565794715045, isUniform = TRUE, clusterSize = 500
cluster 01_0001 is uniform
* checking uniformity of cluster '2' of 2 clusters
Asked to drop 0 genes and 500 cells
COTAN dataset analysis: START
Asked to drop 44 genes and 0 cells
Genes/cells selection done: dropped [44] genes and [0] cells
Working on [556] genes and [500] cells
Dataset cleaning elapsed time: 1.31543302536011
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.63474655151367
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0636486786621688 | max: 141.389145035675 | % negative: 36.1510791366906
Model parameter estimation elapsed time: 4.06846308708191
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.89537477493286
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00549459457397461
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0384857654571533
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.30669069290161
Total calculations elapsed time: 5.2460458278656
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 6.60239839553833
Dataset analysis elapsed time: 11.9862945079803
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0002' with 500 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0303399562835693
Calculate `GDI`: DONE
Total calculations elapsed time: 4.22120022773743
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0395638942718506
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0002, with size 500, is uniform
Cluster 01_0002's shift to uniformity: -0.0413872276843505
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00719424460431655, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35561277231565, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00359712230215827, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37204026755188, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38757136821537, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.40876953414106, isUniform = TRUE, clusterSize = 500
cluster 01_0002 is uniform
Found 2 uniform and 0 non-uniform clusters
Stopping: too few cells left to cluster
Unclustered cell left: 0
The final raw clusterization contains [ 2 ] different clusters: 01_0001, 01_0002
Differential Expression Analysis - START
* DEA on cluster '1' with 500 cells
* DEA on cluster '2' with 500 cells
Total calculations elapsed time: 0.0335659980773926
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Total calculations elapsed time: 65.5109314918518
Creating cells' uniform clustering: DONE
findClustersMarkers - START
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 6.56609034538269
Log Fold Change Analysis - DONE
Total calculations elapsed time: 6.57907938957214
findClustersMarkers - DONE
findClustersMarkers - START
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 6.57568073272705
Log Fold Change Analysis - DONE
Total calculations elapsed time: 6.58927035331726
findClustersMarkers - DONE
findClustersMarkers - START
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0394878387451172
Differential Expression Analysis - DONE
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 6.01426601409912
Log Fold Change Analysis - DONE
Total calculations elapsed time: 6.06522631645203
findClustersMarkers - DONE
[1] "Tested cluster: 1"
Asked to drop 0 genes and 743 cells
COTAN dataset analysis: START
Asked to drop 51 genes and 0 cells
Genes/cells selection done: dropped [51] genes and [0] cells
Working on [549] genes and [257] cells
Dataset cleaning elapsed time: 1.57024669647217
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 2.94021701812744
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.112503099391263 | max: 646.681464270838 | % negative: 40.8014571948998
Model parameter estimation elapsed time: 4.34582376480103
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 4.18666982650757
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00650811195373535
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0294187068939209
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.68697142601013
Total calculations elapsed time: 5.90956807136536
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 7.30432868003845
Dataset analysis elapsed time: 13.2203991413116
COTAN dataset analysis: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0317060947418213
Calculate `GDI`: DONE
Total calculations elapsed time: 4.56026029586792
Calculate GDI dataframe: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 3.74647045135498
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.61011600494385
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 3.67702484130859
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 5.23415946960449
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 1.67475891113281
Dataset analysis elapsed time: 8.51903438568115
COTAN dataset analysis: DONE
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Centering and scaling data matrix
|
| | 0%
|
|======================================================================| 100%
PC_ 1
Positive: g-000397, g-000525, g-000460, g-000458, g-000535, g-000217, g-000194, g-000497, g-000432, g-000383
g-000318, g-000486, g-000464, g-000588, g-000549, g-000368, g-000252, g-000151, g-000209, g-000538
g-000325, g-000514, g-000524, g-000244, g-000320, g-000201, g-000499, g-000309, g-000290, g-000483
Negative: g-000415, g-000506, g-000496, g-000579, g-000572, g-000421, g-000455, g-000328, g-000178, g-000567
g-000405, g-000296, g-000387, g-000501, g-000493, g-000481, g-000343, g-000528, g-000551, g-000414
g-000367, g-000594, g-000159, g-000517, g-000574, g-000229, g-000222, g-000533, g-000243, g-000306
PC_ 2
Positive: g-000141, g-000093, g-000089, g-000033, g-000123, g-000557, g-000330, g-000156, g-000142, g-000095
g-000061, g-000235, g-000032, g-000186, g-000056, g-000259, g-000027, g-000041, g-000333, g-000386
g-000009, g-000395, g-000048, g-000116, g-000340, g-000418, g-000035, g-000332, g-000086, g-000040
Negative: g-000088, g-000158, g-000255, g-000115, g-000054, g-000472, g-000554, g-000391, g-000253, g-000226
g-000051, g-000147, g-000541, g-000077, g-000224, g-000194, g-000290, g-000293, g-000313, g-000118
g-000121, g-000220, g-000467, g-000500, g-000341, g-000039, g-000091, g-000249, g-000426, g-000288
PC_ 3
Positive: g-000126, g-000083, g-000086, g-000117, g-000130, g-000010, g-000498, g-000333, g-000047, g-000179
g-000340, g-000035, g-000531, g-000140, g-000527, g-000049, g-000316, g-000031, g-000014, g-000073
g-000218, g-000445, g-000129, g-000175, g-000105, g-000581, g-000404, g-000025, g-000266, g-000354
Negative: g-000096, g-000575, g-000370, g-000337, g-000319, g-000364, g-000308, g-000293, g-000147, g-000307
g-000038, g-000492, g-000541, g-000185, g-000008, g-000482, g-000562, g-000097, g-000222, g-000084
g-000141, g-000377, g-000224, g-000223, g-000136, g-000434, g-000277, g-000426, g-000139, g-000093
PC_ 4
Positive: g-000006, g-000043, g-000462, g-000279, g-000180, g-000576, g-000087, g-000584, g-000498, g-000333
g-000189, g-000088, g-000451, g-000059, g-000135, g-000281, g-000106, g-000429, g-000316, g-000578
g-000303, g-000031, g-000581, g-000026, g-000122, g-000561, g-000546, g-000164, g-000353, g-000300
Negative: g-000072, g-000012, g-000129, g-000052, g-000097, g-000262, g-000080, g-000056, g-000025, g-000092
g-000354, g-000334, g-000423, g-000228, g-000002, g-000010, g-000086, g-000147, g-000185, g-000172
g-000124, g-000009, g-000077, g-000476, g-000126, g-000145, g-000065, g-000268, g-000152, g-000348
PC_ 5
Positive: g-000105, g-000037, g-000110, g-000054, g-000090, g-000389, g-000022, g-000578, g-000289, g-000147
g-000547, g-000011, g-000477, g-000433, g-000200, g-000348, g-000404, g-000003, g-000250, g-000109
g-000402, g-000241, g-000595, g-000341, g-000560, g-000385, g-000413, g-000352, g-000573, g-000265
Negative: g-000051, g-000150, g-000088, g-000476, g-000344, g-000116, g-000428, g-000012, g-000523, g-000394
g-000101, g-000127, g-000069, g-000214, g-000049, g-000357, g-000075, g-000081, g-000576, g-000342
g-000439, g-000018, g-000070, g-000079, g-000015, g-000550, g-000600, g-000247, g-000218, g-000331
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 68107
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.5999
Number of communities: 2
Elapsed time: 0 seconds
Clusterizations found: RNA_snn_res.0.8, seurat_clusters
Conditions found: orig.ident
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.56396651268005
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 3.3095874786377
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 4.96122860908508
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 1.68320107460022
Dataset analysis elapsed time: 8.20839619636536
COTAN dataset analysis: DONE
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.49043107032776
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 3.78644251823425
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 5.19442939758301
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 5.72424626350403
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.013350248336792
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.077430248260498
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.91797780990601
Total calculations elapsed time: 7.73300457000732
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 9.61817765235901
Dataset analysis elapsed time: 16.3030381202698
COTAN dataset analysis: DONE
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.010812520980835
calculating PValues: DONE
Number of selected secondary markers: 6
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0127334594726562
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 6
Number of rows (U set): 60
Total calculations elapsed time: 1.74587249755859
Calculating gene co-expression space - DONE
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.0104050636291504
calculating PValues: DONE
Number of selected secondary markers: 98
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00971364974975586
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 98
Number of rows (U set): 60
Total calculations elapsed time: 2.14843106269836
Calculating gene co-expression space - DONE
Establishing gene clusters - START
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.00965499877929688
calculating PValues: DONE
Number of selected secondary markers: 98
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00946998596191406
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 98
Number of rows (U set): 60
Total calculations elapsed time: 2.04546403884888
Calculating gene co-expression space - DONE
Total calculations elapsed time: 2.13064908981323
Establishing gene clusters - DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 2.04736757278442
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 3.84873700141907
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 5.56383228302002
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 2.00004696846008
Dataset analysis elapsed time: 9.61124682426453
COTAN dataset analysis: DONE
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0475430488586426
Differential Expression Analysis - DONE
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 7.02914333343506
Log Fold Change Analysis - DONE
clustersDeltaExpression - START
Handling cluster '1' with mean UDE 1.10997640736885
Handling cluster '2' with mean UDE 1.00770245700749
Handling cluster '3' with mean UDE 0.95940682189354
Handling cluster '4' with mean UDE 0.907328369455933
clustersDeltaExpression - DONE
In group G1 there are 3 detected over 3 genes
In group G2 there are 2 detected over 3 genes
In group G3 there are 5 detected over 5 genes
Merging cells' uniform clustering: START
The merge algorithm will use 2 passes
Start merging nearest clusters - the main threshold is: 1.297
Start merging nearest clusters: iteration 1
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.047999382019043
Differential Expression Analysis - DONE
Updating check results for the 0 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("1", "2")
*1_2-merge
Asked to drop 0 genes and 501 cells
COTAN dataset analysis: START
Asked to drop 16 genes and 0 cells
Genes/cells selection done: dropped [16] genes and [0] cells
Working on [584] genes and [499] cells
Dataset cleaning elapsed time: 1.67686033248901
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 3.27275633811951
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0608154544840047 | max: 1260.06995351592 | % negative: 35.6164383561644
Model parameter estimation elapsed time: 5.59318423271179
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 6.76235556602478
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00987339019775391
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0463936328887939
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.79471945762634
Total calculations elapsed time: 8.61334204673767
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 10.3770790100098
Dataset analysis elapsed time: 17.6471235752106
COTAN dataset analysis: DONE
Checking uniformity for the cluster '1_2-merge' with 499 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0412678718566895
Calculate `GDI`: DONE
Total calculations elapsed time: 5.33696579933167
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0428986549377441
Clean plots: DONE
GDI plot
Removed 1 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 1_2-merge, with size 499, is not uniform
Cluster 1_2-merge's shift to uniformity: 0.0566581136434114
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.297, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.178082191780822, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35365811364341, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.307, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.148972602739726, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37149326865972, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.4, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.00513698630136986, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38256306292787, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.4, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 3, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.42111642638124, isUniform = FALSE, clusterSize = 499
Clusters 1 and 2 cannot be merged
Finished the first batch - no merges were executed
Loop calculations elapsed time: 32.6771011352539
Start merging nearest clusters: iteration 2
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0551517009735107
Differential Expression Analysis - DONE
Updating check results for the 1 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("3", "4")
*3_4-merge
Asked to drop 0 genes and 499 cells
COTAN dataset analysis: START
Asked to drop 37 genes and 0 cells
Genes/cells selection done: dropped [37] genes and [0] cells
Working on [563] genes and [501] cells
Dataset cleaning elapsed time: 2.39715647697449
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 11 iterations
Total calculations elapsed time: 3.9545578956604
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.107568326617881 | max: 698.639334552754 | % negative: 32.1492007104796
Model parameter estimation elapsed time: 5.88564705848694
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 6.87785911560059
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.012866735458374
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0451838970184326
Estimating genes' COEX
Calculate genes' COEX elapsed time: 2.00489354133606
Total calculations elapsed time: 8.94080328941345
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 11.2391805648804
Dataset analysis elapsed time: 19.5219841003418
COTAN dataset analysis: DONE
Checking uniformity for the cluster '3_4-merge' with 501 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0376811027526855
Calculate `GDI`: DONE
Total calculations elapsed time: 6.57839155197144
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0478188991546631
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 3_4-merge, with size 501, is not uniform
Cluster 3_4-merge's shift to uniformity: 0.0813107504723223
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.297, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.259325044404973, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.37831075047232, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.307, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.216696269982238, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.41473792188166, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.4, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.0301953818827709, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.43341610223243, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.4, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 17, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.46173948790285, isUniform = FALSE, clusterSize = 501
Clusters 3 and 4 cannot be merged
No clusters will be merged
None of the remaining tested cluster pairs could be merged
Executed all merges for threshold 1.297 out of 2 checks
Start merging nearest clusters - the main threshold is: 1.397
Start merging nearest clusters: iteration 3
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0566573143005371
Differential Expression Analysis - DONE
Updating check results for the 2 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("2", "4")
*2_4-merge
Asked to drop 0 genes and 570 cells
COTAN dataset analysis: START
Asked to drop 9 genes and 0 cells
Genes/cells selection done: dropped [9] genes and [0] cells
Working on [591] genes and [430] cells
Dataset cleaning elapsed time: 1.69077801704407
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 3.71883988380432
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0739592351622374 | max: 400.051960722894 | % negative: 25.7191201353638
Model parameter estimation elapsed time: 5.70578598976135
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 5.35974645614624
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0106935501098633
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0433716773986816
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.81975555419922
Total calculations elapsed time: 7.233567237854
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 8.86874842643738
Dataset analysis elapsed time: 16.2653124332428
COTAN dataset analysis: DONE
Checking uniformity for the cluster '2_4-merge' with 430 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0363433361053467
Calculate `GDI`: DONE
Total calculations elapsed time: 5.52322745323181
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0388154983520508
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 2_4-merge, with size 430, is not uniform
Cluster 2_4-merge's shift to uniformity: 3.07228472969514
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.583756345177665, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 3.7954982715656, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.576988155668359, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 4.08354952912925, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.524534686971235, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 4.42722016730736, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 310, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 4.57228472969514, isUniform = FALSE, clusterSize = 430
Clusters 2 and 4 cannot be merged
Clusters 1 and 2 will be merged
Clusters 4 and 3 will be merged
Executed 2 merges
Loop calculations elapsed time: 30.3881430625916
Start merging nearest clusters: iteration 4
Differential Expression Analysis - START
* DEA on cluster '1_2-merge' with 499 cells
* DEA on cluster '3_4-merge' with 501 cells
Total calculations elapsed time: 0.0324535369873047
Differential Expression Analysis - DONE
Updating check results for the 3 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("1_2-merge", "3_4-merge")
*1_2-merge_3_4-merge-merge
Asked to drop no genes or cells
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.70061874389648
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 3.6581027507782
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 5.13742470741272
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 4.7721164226532
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00781536102294922
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0647993087768555
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.20686745643616
Total calculations elapsed time: 6.05159854888916
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 7.44357252120972
Dataset analysis elapsed time: 14.2816159725189
COTAN dataset analysis: DONE
Checking uniformity for the cluster '1_2-merge_3_4-merge-merge' with 1000 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0325427055358887
Calculate `GDI`: DONE
Total calculations elapsed time: 3.83029127120972
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0394806861877441
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 1_2-merge_3_4-merge-merge, with size 1000, is not uniform
Cluster 1_2-merge_3_4-merge-merge's shift to uniformity: 3.86988385120409
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.69, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 4.54596809454193, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.678333333333333, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 4.93144728766684, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.593333333333333, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 5.2532296852478, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 356, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 5.36988385120409, isUniform = FALSE, clusterSize = 1000
Clusters 1_2-merge and 3_4-merge cannot be merged
No clusters will be merged
None of the remaining tested cluster pairs could be merged
Executed all merges for threshold 1.397 out of 4 checks
The final merged clusterization contains [2] different clusters: 1_2-merge, 3_4-merge
Differential Expression Analysis - START
* DEA on cluster '1' with 499 cells
* DEA on cluster '2' with 501 cells
Total calculations elapsed time: 0.0307693481445312
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Total calculations elapsed time: 124.974381923676
Merging cells' uniform clustering: DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
Total calculations elapsed time: 2.76006174087524
Log Fold Change Analysis - DONE
[1] "Tested cluster: 1"
Asked to drop 0 genes and 501 cells
COTAN dataset analysis: START
Asked to drop 16 genes and 0 cells
Genes/cells selection done: dropped [16] genes and [0] cells
Working on [584] genes and [499] cells
Dataset cleaning elapsed time: 1.62822151184082
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 2.6577136516571
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0608154544840047 | max: 1260.06995351592 | % negative: 35.6164383561644
Model parameter estimation elapsed time: 3.91292214393616
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.84666538238525
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00665426254272461
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0399529933929443
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.1395583152771
Total calculations elapsed time: 5.03283095359802
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 6.45905661582947
Dataset analysis elapsed time: 12.0002002716064
COTAN dataset analysis: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0315787792205811
Calculate `GDI`: DONE
Total calculations elapsed time: 4.34943389892578
Calculate GDI dataframe: DONE
Dispersion bisection: straddling used 2 iterations
Dispersion bisection: used 8 iterations
Dispersion bisection: straddling used 1 iterations
Dispersion bisection: used 9 iterations
Dispersion Newton-Raphson: used up to 4 iterations
Dispersion Newton-Raphson: used up to 4 iterations
parallel dispersion bisection: straddling used up to 2 iterations
Parallel dispersion bisection: used up to 9 iterations
Parallel dispersion Newton-Raphson: used up to 4 iterations
[ FAIL 0 | WARN 3 | SKIP 0 | PASS 572 ]
[ FAIL 0 | WARN 3 | SKIP 0 | PASS 572 ]
>
> proc.time()
user system elapsed
855.662 9.423 861.202
COTAN.Rcheck/COTAN-Ex.timings
| name | user | system | elapsed | |
| COTAN_Legacy | 0.001 | 0.002 | 0.003 | |
| COTAN_ObjectCreation | 10.312 | 0.207 | 10.236 | |
| CalculatingCOEX | 54.804 | 0.304 | 54.052 | |
| ClustersList | 0.009 | 0.000 | 0.009 | |
| Conversions | 5.121 | 0.038 | 5.159 | |
| GenesStatistics | 11.135 | 0.044 | 10.883 | |
| HandleMetaData | 0.037 | 0.002 | 0.039 | |
| HandlingClusterizations | 41.812 | 0.237 | 41.707 | |
| HandlingConditions | 0.072 | 0.004 | 0.076 | |
| HeatmapPlots | 31.646 | 0.430 | 31.316 | |
| Installing_torch | 0.000 | 0.000 | 0.001 | |
| LoggingFunctions | 0.002 | 0.001 | 0.002 | |
| ParametersEstimations | 22.797 | 0.246 | 23.028 | |
| RawDataCleaning | 4.811 | 0.049 | 4.803 | |
| RawDataGetters | 0.037 | 0.009 | 0.046 | |
| UniformClusters | 66.665 | 0.295 | 66.184 | |
| getColorsVector | 0.001 | 0.000 | 0.001 | |