| Back to Multiple platform build/check report for BioC 3.22: simplified long |
|
This page was generated on 2025-11-15 11:58 -0500 (Sat, 15 Nov 2025).
| Hostname | OS | Arch (*) | R version | Installed pkgs |
|---|---|---|---|---|
| nebbiolo2 | Linux (Ubuntu 24.04.3 LTS) | x86_64 | 4.5.1 Patched (2025-08-23 r88802) -- "Great Square Root" | 4903 |
| taishan | Linux (openEuler 24.03 LTS) | aarch64 | 4.5.0 (2025-04-11) -- "How About a Twenty-Six" | 4668 |
| Click on any hostname to see more info about the system (e.g. compilers) (*) as reported by 'uname -p', except on Windows and Mac OS X | ||||
| Package 460/2361 | Hostname | OS / Arch | INSTALL | BUILD | CHECK | BUILD BIN | ||||||||
| COTAN 2.10.0 (landing page) Galfrè Silvia Giulia
| nebbiolo2 | Linux (Ubuntu 24.04.3 LTS) / x86_64 | OK | OK | OK | |||||||||
| taishan | Linux (openEuler 24.03 LTS) / aarch64 | OK | OK | OK | ||||||||||
|
To the developers/maintainers of the COTAN package: - Allow up to 24 hours (and sometimes 48 hours) for your latest push to git@git.bioconductor.org:packages/COTAN.git to reflect on this report. See Troubleshooting Build Report for more information. - Use the following Renviron settings to reproduce errors and warnings. - If 'R CMD check' started to fail recently on the Linux builder(s) over a missing dependency, add the missing dependency to 'Suggests:' in your DESCRIPTION file. See Renviron.bioc for more information. |
| Package: COTAN |
| Version: 2.10.0 |
| Command: /home/biocbuild/bbs-3.22-bioc/R/bin/R CMD check --install=check:COTAN.install-out.txt --library=/home/biocbuild/bbs-3.22-bioc/R/site-library --timings COTAN_2.10.0.tar.gz |
| StartedAt: 2025-11-14 22:33:57 -0500 (Fri, 14 Nov 2025) |
| EndedAt: 2025-11-14 23:00:51 -0500 (Fri, 14 Nov 2025) |
| EllapsedTime: 1613.4 seconds |
| RetCode: 0 |
| Status: OK |
| CheckDir: COTAN.Rcheck |
| Warnings: 0 |
##############################################################################
##############################################################################
###
### Running command:
###
### /home/biocbuild/bbs-3.22-bioc/R/bin/R CMD check --install=check:COTAN.install-out.txt --library=/home/biocbuild/bbs-3.22-bioc/R/site-library --timings COTAN_2.10.0.tar.gz
###
##############################################################################
##############################################################################
* using log directory ‘/home/biocbuild/bbs-3.22-bioc/meat/COTAN.Rcheck’
* using R version 4.5.1 Patched (2025-08-23 r88802)
* using platform: x86_64-pc-linux-gnu
* R was compiled by
gcc (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0
GNU Fortran (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0
* running under: Ubuntu 24.04.3 LTS
* using session charset: UTF-8
* checking for file ‘COTAN/DESCRIPTION’ ... OK
* checking extension type ... Package
* this is package ‘COTAN’ version ‘2.10.0’
* package encoding: UTF-8
* checking package namespace information ... OK
* checking package dependencies ... INFO
Imports includes 26 non-default packages.
Importing from so many packages makes the package vulnerable to any of
them becoming unavailable. Move as many as possible to Suggests and
use conditionally.
* checking if this is a source package ... OK
* checking if there is a namespace ... OK
* checking for hidden files and directories ... OK
* checking for portable file names ... OK
* checking for sufficient/correct file permissions ... OK
* checking whether package ‘COTAN’ can be installed ... OK
* checking installed package size ... OK
* checking package directory ... OK
* checking ‘build’ directory ... OK
* checking DESCRIPTION meta-information ... OK
* checking top-level files ... OK
* checking for left-over files ... OK
* checking index information ... OK
* checking package subdirectories ... OK
* checking code files for non-ASCII characters ... OK
* checking R files for syntax errors ... OK
* checking whether the package can be loaded ... OK
* checking whether the package can be loaded with stated dependencies ... OK
* checking whether the package can be unloaded cleanly ... OK
* checking whether the namespace can be loaded with stated dependencies ... OK
* checking whether the namespace can be unloaded cleanly ... OK
* checking loading without being on the library search path ... OK
* checking whether startup messages can be suppressed ... OK
* checking dependencies in R code ... OK
* checking S3 generic/method consistency ... OK
* checking replacement functions ... OK
* checking foreign function calls ... OK
* checking R code for possible problems ... OK
* checking Rd files ... OK
* checking Rd metadata ... OK
* checking Rd cross-references ... OK
* checking for missing documentation entries ... OK
* checking for code/documentation mismatches ... OK
* checking Rd \usage sections ... OK
* checking Rd contents ... OK
* checking for unstated dependencies in examples ... OK
* checking contents of ‘data’ directory ... OK
* checking data for non-ASCII characters ... OK
* checking data for ASCII and uncompressed saves ... OK
* checking files in ‘vignettes’ ... OK
* checking examples ... OK
Examples with CPU (user + system) or elapsed time > 5s
user system elapsed
UniformClusters 67.665 0.292 67.177
CalculatingCOEX 51.549 1.041 51.539
HandlingClusterizations 40.134 0.315 40.120
HeatmapPlots 30.604 0.472 30.293
ParametersEstimations 21.365 0.253 21.602
GenesStatistics 10.825 0.048 10.591
COTAN_ObjectCreation 8.892 0.492 9.097
* checking for unstated dependencies in ‘tests’ ... OK
* checking tests ...
Running ‘outputTestDatasetCreation.R’
Running ‘spelling.R’
Running ‘testthat.R’
OK
* checking for unstated dependencies in vignettes ... OK
* checking package vignettes ... OK
* checking re-building of vignette outputs ... OK
* checking PDF version of manual ... OK
* DONE
Status: OK
COTAN.Rcheck/00install.out
############################################################################## ############################################################################## ### ### Running command: ### ### /home/biocbuild/bbs-3.22-bioc/R/bin/R CMD INSTALL COTAN ### ############################################################################## ############################################################################## * installing to library ‘/home/biocbuild/bbs-3.22-bioc/R/site-library’ * installing *source* package ‘COTAN’ ... ** this is package ‘COTAN’ version ‘2.10.0’ ** using staged installation ** R ** data ** inst ** byte-compile and prepare package for lazy loading ** help *** installing help indices ** building package indices ** installing vignettes ** testing if installed package can be loaded from temporary location ** testing if installed package can be loaded from final location ** testing if installed package keeps a record of temporary installation path * DONE (COTAN)
COTAN.Rcheck/tests/outputTestDatasetCreation.Rout
R version 4.5.1 Patched (2025-08-23 r88802) -- "Great Square Root"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
>
> # Creates the files to be reloaded by the tests for comparisons
>
> outputTestDatasetCreation <-
+ function(testsDir = file.path("tests", "testthat")) {
+ utils::data("test.dataset", package = "COTAN")
+ options(parallelly.fork.enable = TRUE)
+ setLoggingLevel(3L)
+
+ obj <- COTAN(raw = test.dataset)
+ obj <- initializeMetaDataset(objCOTAN = obj, GEO = " ",
+ sequencingMethod = "artificial",
+ sampleCondition = "test")
+
+ obj <- proceedToCoex(objCOTAN = obj, cores = 6L, saveObj = FALSE)
+
+ if (FALSE) {
+ saveRDS(obj, file = file.path(testsDir,"test.COTAN.RDS"))
+ }
+
+ cells.names.test <-
+ getCells(objCOTAN = obj)[c(1L:10L, 591L:610L, 991L:1000L)]
+ genes.names.test <-
+ getGenes(objCOTAN = obj)[c(131L:140L, 291L:310L, 591L: 600L)]
+ saveRDS(cells.names.test, file.path(testsDir, "cells.names.test.RDS"))
+ saveRDS(genes.names.test, file.path(testsDir, "genes.names.test.RDS"))
+
+ pcaRaw <- runPCA(x = getRawData(objCOTAN = obj), rank = 10L,
+ BSPARAM = IrlbaParam(), get.rotation = FALSE)[["x"]]
+
+ pca.raw.test <- pcaRaw[genes.names.test, ]
+ saveRDS(pca.raw.test, file.path(testsDir, "pca.raw.test.RDS"))
+
+ dispersion.test <- getDispersion(objCOTAN = obj)[genes.names.test]
+ saveRDS(dispersion.test, file.path(testsDir, "dispersion.test.RDS"))
+
+ raw.norm.test <-
+ getNuNormData(objCOTAN = obj)[genes.names.test, cells.names.test]
+ saveRDS(raw.norm.test, file.path(testsDir, "raw.norm.test.RDS"))
+
+ coex.test <-
+ getGenesCoex(objCOTAN = obj, genes = genes.names.test, zeroDiagonal = FALSE)
+ saveRDS(coex.test, file.path(testsDir, "coex.test.RDS"))
+
+ lambda.test <- getLambda(objCOTAN = obj)[genes.names.test]
+ saveRDS(lambda.test, file.path(testsDir, "lambda.test.RDS"))
+
+ GDI.test <- calculateGDI(objCOTAN = obj)
+ GDI.test <- GDI.test[genes.names.test, ]
+ saveRDS(GDI.test, file.path(testsDir, "GDI.test.RDS"))
+
+ nu.test <- getNu(objCOTAN = obj)[cells.names.test]
+ saveRDS(nu.test, file.path(testsDir, "nu.test.RDS"))
+
+ pvalues.test <- calculatePValue(objCOTAN = obj,
+ geneSubsetCol = genes.names.test,
+ geneSubsetRow = genes.names.test)
+ saveRDS(pvalues.test, file.path(testsDir, "pvalues.test.RDS"))
+
+ groupMarkers <- list(G1 = c("g-000010", "g-000020", "g-000138"),
+ G2 = c("g-000300", "g-000330", "g-000660"),
+ G3 = c("g-000510", "g-000530", "g-000550",
+ "g-000570", "g-000590"))
+
+ gcsData <- genesCoexSpace(objCOTAN = obj,
+ primaryMarkers = unlist(groupMarkers),
+ numGenesPerMarker = 11L)
+
+ genes.coex.space.test <- gcsData[["GCS"]]
+ saveRDS(genes.coex.space.test,
+ file.path(testsDir, "genes.coex.space.test.RDS"))
+
+ genesClustersData <-
+ establishGenesClusters(objCOTAN = obj,
+ groupMarkers = groupMarkers,
+ numGenesPerMarker = 11L,
+ kCuts = 6L, distance = "cosine",
+ hclustMethod = "ward.D2")
+
+ pca.genes.clusters.test <- genesClustersData[["pca_clusters"]]
+ saveRDS(pca.genes.clusters.test,
+ file.path(testsDir, "pca.genes.clusters.test.RDS"))
+
+ # Make it a less strict check as it is only for testing
+ checker <- new("AdvancedGDIUniformityCheck")
+ checker <- shiftCheckerThresholds(checker, 0.1)
+
+ initialResolution <- 1.3
+ splitData <- cellsUniformClustering(objCOTAN = obj,
+ checker = checker,
+ initialResolution = initialResolution,
+ useCoexEigen = TRUE,
+ dataMethod = "LL",
+ numReducedComp = 50L,
+ cores = 6L, optimizeForSpeed = TRUE,
+ deviceStr = "cuda", saveObj = FALSE)
+
+ split.clusters.test <- splitData[["clusters"]]
+ saveRDS(split.clusters.test,
+ file = file.path(testsDir, "split.clusters.test.RDS"))
+
+ test.dataset.clusters1 <- split.clusters.test
+ save(test.dataset.clusters1, compress = TRUE,
+ file = file.path("data", "test.dataset.clusters1.rda"))
+
+ obj <- addClusterization(objCOTAN = obj,
+ clName = "split",
+ clusters = splitData[["clusters"]],
+ coexDF = splitData[["coex"]])
+
+ coex.clusters.test <- splitData[["coex"]][genes.names.test, ]
+ saveRDS(coex.clusters.test, file.path(testsDir, "coex.clusters.test.RDS"))
+
+ pvalDF <- pValueFromDEA(splitData[["coex"]],
+ getNumCells(objCOTAN = obj),
+ adjustmentMethod = "none")
+
+ pvalues.clusters.test <- pvalDF[genes.names.test, ]
+ saveRDS(pvalues.clusters.test,
+ file.path(testsDir, "pvalues.clusters.test.RDS"))
+
+ mergedData <- mergeUniformCellsClusters(objCOTAN = obj,
+ clusters = splitData[["clusters"]],
+ checkers = checker,
+ batchSize = 1L,
+ cores = 6L,
+ distance = "cosine",
+ hclustMethod = "ward.D2",
+ saveObj = FALSE)
+
+ merge.clusters.test <- mergedData[["clusters"]]
+ saveRDS(merge.clusters.test,
+ file = file.path(testsDir, "merge.clusters.test.RDS"))
+
+ test.dataset.clusters2 <- merge.clusters.test
+ save(test.dataset.clusters2, compress = TRUE,
+ file = file.path("data", "test.dataset.clusters2.rda"))
+
+ obj <- addClusterization(objCOTAN = obj,
+ clName = "merge",
+ clusters = mergedData[["clusters"]],
+ coexDF = mergedData[["coex"]])
+ }
>
> proc.time()
user system elapsed
0.158 0.038 0.185
COTAN.Rcheck/tests/spelling.Rout
R version 4.5.1 Patched (2025-08-23 r88802) -- "Great Square Root"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> if (requireNamespace("spelling", quietly = TRUE))
+ spelling::spell_check_test(vignettes = TRUE, error = FALSE,
+ skip_on_cran = TRUE)
All Done!
>
> proc.time()
user system elapsed
0.149 0.035 0.172
COTAN.Rcheck/tests/testthat.Rout
R version 4.5.1 Patched (2025-08-23 r88802) -- "Great Square Root"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> Sys.setenv(R_TESTS = "")
> library(testthat)
> library(COTAN)
> library(zeallot)
> test_check("COTAN")
Setting new log level to 4
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.60880541801453
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.56581330299377
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000501632690429688
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00570988655090332
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.794744968414307
Total calculations elapsed time: 3.36676979064941
Calculate genes' COEX (legacy): DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 5 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 4 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 4.81570601463318
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 7 cells batches
Total calculations elapsed time: 0.870843172073364
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75595238095238 | median: 1.07156808035714 | mean: 1.07156808035714
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.68243432044983
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03734183779544 | max: 4.61112297272667 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.745908975601196
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0295487661210321 | median: 0.016072261901129 | mean: 0.016072261901129
`nu` mean: 1.69786080481514
Marginal errors | max: 1.95799528048 | median 1.32268477389029 | mean: 1.33563364783916
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.6893002986908
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.0585450475968788 | max: 3.52739274166646 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.847014188766479
Estimate `nu`: DONE
`nu` change (abs) | max: 0.417150556912302 | median: 0.240156504520849 | mean: 0.240156504520849
`nu` mean: 0.823005947608547
Marginal errors | max: 0.837672524335755 | median 0.704691669139065 | mean: 0.646575831699997
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.72364830970764
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.328845855849147 | max: 4.03031691940854 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.827996730804443
Estimate `nu`: DONE
`nu` change (abs) | max: 0.164439840041 | median: 0.0957105992188852 | mean: 0.0957105992188852
`nu` mean: 1.06872924082212
Marginal errors | max: 0.260109847946692 | median 0.21392791155499 | mean: 0.197565106613054
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.59162712097168
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.229469002841045 | max: 3.87206403670079 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.750506639480591
Estimate `nu`: DONE
`nu` change (abs) | max: 0.05539667181205 | median: 0.0321044921874999 | mean: 0.0321044921874999
`nu` mean: 0.97670782037545
Marginal errors | max: 0.095347789718808 | median 0.0796003827042702 | mean: 0.0725509735761708
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.4417929649353
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.263830434255107 | max: 3.92953043775907 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.742331027984619
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0196209299693411 | median: 0.0114037947200925 | mean: 0.0114037947200925
`nu` mean: 1.00821713524925
Marginal errors | max: 0.0329495161656741 | median 0.0273479725376324 | mean: 0.025029675152131
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.53388714790344
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.251734659898779 | max: 3.9096133246649 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.746850967407227
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0069104540740097 | median: 0.0040109538496062 | mean: 0.0040109538496062
`nu` mean: 0.997100499775596
Marginal errors | max: 0.0116950057438405 | median 0.00972280144873849 | mean: 0.00889105008777538
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.59094667434692
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.256009779031907 | max: 3.91667271750655 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.747565269470215
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00251004753849005 | median: 0.00146484374999994 | mean: 0.00146484374999994
`nu` mean: 1.00104520378849
Marginal errors | max: 0.00430755646112857 | median 0.00358203399504298 | mean: 0.00327684342604062
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.56947374343872
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.254429717857093 | max: 3.91406908073254 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.720676898956299
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00104629156456748 | median: 0.000592910406456731 | mean: 0.000592910406456731
`nu` mean: 0.999546618841889
Marginal errors | max: 0.00162038706091039 | median 0.00134441676098973 | mean: 0.00123030512553282
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.49641966819763
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255022049769696 | max: 3.91504587939868 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.714764833450317
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000418450901304768 | median: 0.000244140625000028 | mean: 0.000244140625000028
`nu` mean: 1.0001743102763
Marginal errors | max: 0.00071569233034019 | median 0.000597297218559056 | mean: 0.00054590699507937
Total calculations elapsed time: 42.213995218277
Estimate `dispersion`/`nu`: DONE
Estimate `dispersion`/`nu`: START
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.46770048141479
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.47049617767334
Calculating genes' COEX normalization factor
Fraction of genes' with very low expected contingency tables: 0.181818181818182
Calculate genes' normalization factor elapsed time: 0.000667810440063477
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0031120777130127
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.795487403869629
Total calculations elapsed time: 3.26976346969604
Calculate genes' COEX (legacy): DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 2.45836424827576
Calculating cells' COEX normalization factor
Fraction of cells' with very low expected contingency tables: 0
Calculate cells' normalization factor elapsed time: 0.000703573226928711
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00212931632995605
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.793838739395142
Total calculations elapsed time: 3.25503587722778
Calculate cells' COEX (legacy): DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00983643531799316
Calculate `GDI`: DONE
Total calculations elapsed time: 2.56021285057068
Calculate GDI dataframe: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00297951698303223
Calculate `GDI`: DONE
Total calculations elapsed time: 2.41623711585999
Calculate GDI dataframe: DONE
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Selected 5 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 5 genes using HVG_Seurat selector
Running genes' selection: DONE
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer data
Calculating gene means
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating gene variance to mean ratios
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Running genes' selection: START
Given 5 genes as input
Running genes' selection: DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.75606155395508
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.56615376472473
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Selected 8 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.53687930107117
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 8 genes using HVG_Seurat selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 2.50551652908325
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 2.40620231628418
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 2.34418487548828
Elaborating Reduced dimensionality Data Matrix - DONE
Initializing `COTAN` meta-data
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.50711703300476
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.789927005767822
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 1.735699617106 | median 1.37997441333659 | mean: 1.32181397451301
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.54638981819153
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.0655494303592343 | max: 3.54400580804152 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.808911800384521
Estimate `nu`: DONE
`nu` change (abs) | max: 0.402649984216273 | median: 0.231868788425666 | mean: 0.231868788425666
`nu` mean: 0.829218804209393
Marginal errors | max: 0.803248939260364 | median 0.677504196374571 | mean: 0.619386446933351
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.83784604072571
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.326019058449519 | max: 4.02612397202046 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.804389238357544
Estimate `nu`: DONE
`nu` change (abs) | max: 0.158004893526231 | median: 0.0919692884670312 | mean: 0.0919692884670312
`nu` mean: 1.0660356050592
Marginal errors | max: 0.25067700287536 | median 0.206241644985115 | mean: 0.190402167377958
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.62635350227356
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.230397316576369 | max: 3.87365659194104 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.863490343093872
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0532774732102337 | median: 0.0308837890624999 | mean: 0.0308837890624999
`nu` mean: 0.977606315852266
Marginal errors | max: 0.0916920322976189 | median 0.0765360853958175 | mean: 0.0697673030094085
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.55503463745117
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.263457616228195 | max: 3.928924407347 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.775403499603271
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0187878665732679 | median: 0.0109155550210726 | mean: 0.0109155550210726
`nu` mean: 1.0078723115522
Marginal errors | max: 0.0315207323253404 | median 0.0261635598193228 | mean: 0.0239435763640456
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.55747008323669
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.251890641847533 | max: 3.90987172241566 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.801333665847778
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00649137083358098 | median: 0.00376680890457393 | mean: 0.00376680890457393
`nu` mean: 0.997275438070993
Marginal errors | max: 0.0109748802265024 | median 0.00912386940474796 | mean: 0.00834350038184244
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.47864079475403
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255902752363649 | max: 3.91649655995187 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.794284105300903
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00230094227000666 | median: 0.00132529141000018 | mean: 0.00132529141000018
`nu` mean: 1.00097565086001
Marginal errors | max: 0.00376864912836616 | median 0.00313421412286008 | mean: 0.00286709489297579
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.56494426727295
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.254520292119112 | max: 3.91421850264948 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.863101243972778
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000837013154366462 | median: 0.000488281250000028 | mean: 0.000488281250000028
`nu` mean: 0.999651268095634
Marginal errors | max: 0.00144055320514802 | median 0.00119489364392944 | mean: 0.00109355439757213
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.72103023529053
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255046800817986 | max: 3.9150866760965 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.746838092803955
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000418448154490214 | median: 0.000244140624999917 | mean: 0.000244140624999917
`nu` mean: 1.00017430752949
Marginal errors | max: 0.000715683388516908 | median 0.0005972847342397 | mean: 0.00054589991652243
Total calculations elapsed time: 43.1009478569031
Estimate `dispersion`/`nu`: DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.36189603805542
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000479698181152344
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00130081176757812
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.76765251159668
Total calculations elapsed time: 3.13132905960083
Calculate genes' COEX (legacy): DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 2.42450356483459
Calculating cells' COEX normalization factor
Calculate cells' normalization factor elapsed time: 0.000549077987670898
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00136804580688477
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.736472368240356
Total calculations elapsed time: 3.16289305686951
Calculate cells' COEX (legacy): DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00305438041687012
Calculate `GDI`: DONE
Total calculations elapsed time: 2.29430437088013
Calculate GDI dataframe: DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.325
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 6.44025492668152
Calculate genes' partial COEX: DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 6.26844644546509
Calculate cells' partial COEX: DONE
Asked to drop 2 genes and 0 cells
Asked to drop 0 genes and 4 cells
Asked to drop 2 genes and 2 cells
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
calculating YY.. done
calculating YY.. done
calculating YN..NY..NN..t().. done
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.10323429107666
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
calculating NN.. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.41888761520386
Calculating genes' COEX normalization factor
Fraction of genes' with very low expected contingency tables: 0.181818181818182
Calculate genes' normalization factor elapsed time: 0.000668764114379883
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00135040283203125
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.741032123565674
Total calculations elapsed time: 3.16193890571594
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.3690710067749
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000477075576782227
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00128602981567383
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.793020963668823
Total calculations elapsed time: 3.16385507583618
Calculate genes' COEX (legacy): DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.1
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 6.425696849823
Calculate genes' partial COEX: DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.4
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 6.38812637329102
Calculate genes' partial COEX: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
calculating YY.. done
calculating YY.. done
calculating NY..YN..NN..t().. done
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.079758644104
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.830948352813721
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 0.255290533439036 | median 0.080731376500534 | mean: 0.101968565509112
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.28587245941162
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03709166563768 | max: 4.61069655774133 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.805410861968994
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0273438105507502 | median: 0.0148852611818011 | mean: 0.0148852611818011
`nu` mean: 1.69735147626627
Marginal errors | max: 0.00330148418741594 | median 0.00111713187082163 | mean: 0.00132007186542964
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.25098323822021
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03887279473672 | max: 4.60974134092906 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.772096633911133
Estimate `nu`: DONE
`nu` change (abs) | max: 0 | median: 0 | mean: 0
`nu` mean: 1.69735147626627
Marginal errors | max: 5.14174422185931e-05 | median 1.6818224857218e-07 | mean: 5.57649710835051e-06
Total calculations elapsed time: 19.2927901744843
Estimate `dispersion`/`nu`: DONE
calculating NN.. done
calculating NN.. done
calculating YN..NY..YY..t().. done
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 2.23502612113953
Calculating cells' COEX normalization factor
Fraction of cells' with very low expected contingency tables: 0
Calculate cells' normalization factor elapsed time: 0.000636816024780273
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00132179260253906
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.760315895080566
Total calculations elapsed time: 2.99730062484741
Calculate cells' COEX (legacy): DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 6.03523302078247
Calculate cells' partial COEX: DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 6.18730735778809
Calculate cells' partial COEX: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.04882335662842
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.767644643783569
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 0.255290533439036 | median 0.080731376500534 | mean: 0.101968565509112
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.05765676498413
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03709166563768 | max: 4.61069655774133 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.795816659927368
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0273438105507502 | median: 0.0148852611818011 | mean: 0.0148852611818011
`nu` mean: 1.69735147626627
Marginal errors | max: 0.00330148418741594 | median 0.00111713187082163 | mean: 0.00132007186542964
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.12259483337402
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03887279473672 | max: 4.60974134092906 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.74101996421814
Estimate `nu`: DONE
`nu` change (abs) | max: 0 | median: 0 | mean: 0
`nu` mean: 1.69735147626627
Marginal errors | max: 5.14174422185931e-05 | median 1.6818224857218e-07 | mean: 5.57649710835051e-06
Total calculations elapsed time: 18.2756152153015
Estimate `dispersion`/`nu`: DONE
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.26344203948975
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000533103942871094
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00135898590087891
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.7489013671875
Total calculations elapsed time: 3.014235496521
Calculate genes' COEX (legacy): DONE
Calculating S: START
Calculating S: DONE
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 5.22192549705505
Calculating G: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and genome wide on rows
Total calculations elapsed time: 0.00209569931030273
calculating PValues: DONE
Using G
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 5.14556360244751
Calculating G: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 5.14669156074524
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00292801856994629
Calculate `GDI`: DONE
Total calculations elapsed time: 2.19856262207031
Calculate GDI dataframe: DONE
Calculate GDI dataframe: START
Using G
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 5.2098183631897
Calculating G: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00310182571411133
Calculate `GDI`: DONE
Total calculations elapsed time: 7.41486549377441
Calculate GDI dataframe: DONE
Calculate `GDI`: START
Calculating S: START
Calculating S: DONE
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00515341758728027
Calculate `GDI`: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00351476669311523
Calculate `GDI`: DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.741731882095337
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.6550989151001
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.39138579368591
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.53274869918823
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00530886650085449
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0605454444885254
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.742650270462036
Total calculations elapsed time: 3.34125328063965
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.07812929153442
Dataset analysis elapsed time: 7.21124696731567
COTAN dataset analysis: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.738459348678589
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.65236902236938
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.41149973869324
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.51262521743774
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00528454780578613
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0606503486633301
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.736329555511475
Total calculations elapsed time: 3.31488966941833
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.05330753326416
Dataset analysis elapsed time: 7.20326662063599
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.0191993713378906
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0298078060150146
Calculate `GDI`: DONE
Total calculations elapsed time: 2.2434139251709
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.727880239486694
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.63562440872192
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.35019207000732
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.48993229866028
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0053553581237793
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0605096817016602
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.748956680297852
Total calculations elapsed time: 3.30475401878357
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.06978416442871
Dataset analysis elapsed time: 7.14785647392273
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.0156269073486328
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0301234722137451
Calculate `GDI`: DONE
Total calculations elapsed time: 2.3213210105896
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.755306720733643
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.71458840370178
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.49361753463745
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.72555923461914
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00536775588989258
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0603771209716797
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.808812379837036
Total calculations elapsed time: 3.60011649131775
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.36294865608215
Dataset analysis elapsed time: 7.61187291145325
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.00504755973815918
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0305366516113281
Calculate `GDI`: DONE
Total calculations elapsed time: 2.45876550674438
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Asked to drop 0 genes and 960 cells
COTAN dataset analysis: START
Asked to drop 83 genes and 0 cells
Genes/cells selection done: dropped [83] genes and [0] cells
Working on [517] genes and [40] cells
Dataset cleaning elapsed time: 0.765328407287598
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.60670447349548
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.267567793681876 | max: 101.923257389521 | % negative: 52.6112185686654
Model parameter estimation elapsed time: 2.39846587181091
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.79963493347168
Dataset analysis elapsed time: 3.96342921257019
COTAN dataset analysis: DONE
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.50083518028259
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00473260879516602
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0122323036193848
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.768539428710938
Total calculations elapsed time: 3.28633952140808
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.36676907539368
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00452923774719238
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0121662616729736
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.749057531356812
Total calculations elapsed time: 3.13252210617065
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.31270503997803
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00451898574829102
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0121567249298096
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.768519163131714
Total calculations elapsed time: 3.09789991378784
Calculate genes' COEX (legacy): DONE
Hangling COTAN object with condition: test
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.00373601913452148
calculating PValues: DONE
Handling genes type: G2
Handling genes type: G3
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Clean plots: START
PCA: START
PCA: DONE
Hierarchical clustering: START
Hierarchical clustering: DONE
Total calculations elapsed time: 1.72723841667175
Clean plots: DONE
Dataset cleaning elapsed time: 3.8364520072937
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.93581128120422
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.76947212219238
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.79304456710815
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00751686096191406
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.065190315246582
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.808187484741211
Total calculations elapsed time: 3.67393922805786
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.48380661010742
Dataset analysis elapsed time: 11.0897307395935
COTAN dataset analysis: DONE
Saving elaborated data locally at: /tmp/RtmpaeuhNf/test.cotan.RDS
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 2.60767316818237
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 44886
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.4008
Number of communities: 4
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 3.56645154953003
Creating new clusterization: DONE
Creating cells' uniform clustering: START
In iteration 1 the number of cells to re-cluster is 1000 cells belonging to 0 clusters
Asked to drop no genes or cells
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 2.75926756858826
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 36652
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.3743
Number of communities: 4
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 3.61656928062439
Creating new clusterization: DONE
Creating PDF UMAP in file: /tmp/RtmpaeuhNf/test/reclustering/pdf_umap_1.pdf
UMAP plot: START
Calculating UMAP: START
22:48:34 UMAP embedding parameters a = 0.9922 b = 1.112
22:48:34 Read 1000 rows and found 65 numeric columns
22:48:34 Using Annoy for neighbor search, n_neighbors = 30
22:48:34 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:48:34 Writing NN index file to temp file /tmp/RtmpaeuhNf/file530326f5ece9
22:48:34 Searching Annoy index using 1 thread, search_k = 3000
22:48:34 Annoy recall = 100%
22:48:35 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
22:48:37 Initializing from normalized Laplacian + noise (using RSpectra)
22:48:37 Commencing optimization for 500 epochs, with 39044 positive edges
22:48:37 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:48:39 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 5.0782527923584
UMAP plot: DONE
UMAP plot: START
Calculating UMAP: START
22:48:39 UMAP embedding parameters a = 0.9922 b = 1.112
22:48:39 Read 1000 rows and found 65 numeric columns
22:48:39 Using Annoy for neighbor search, n_neighbors = 30
22:48:39 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:48:39 Writing NN index file to temp file /tmp/RtmpaeuhNf/file5303650763d3
22:48:39 Searching Annoy index using 1 thread, search_k = 3000
22:48:40 Annoy recall = 100%
22:48:40 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
22:48:42 Initializing from normalized Laplacian + noise (using RSpectra)
22:48:42 Commencing optimization for 500 epochs, with 39044 positive edges
22:48:42 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:48:44 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 5.06373453140259
UMAP plot: DONE
* checking uniformity of cluster '0' of 4 clusters
Asked to drop 0 genes and 687 cells
COTAN dataset analysis: START
Asked to drop 43 genes and 0 cells
Genes/cells selection done: dropped [43] genes and [0] cells
Working on [557] genes and [313] cells
Dataset cleaning elapsed time: 0.822833299636841
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 11 iterations
Total calculations elapsed time: 1.6714243888855
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.126565269702225 | max: 788.372048308528 | % negative: 38.5996409335727
Model parameter estimation elapsed time: 2.50756359100342
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.635094165802
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00629878044128418
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0315663814544678
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.833438396453857
Total calculations elapsed time: 3.50639772415161
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.34982800483704
Dataset analysis elapsed time: 7.68022489547729
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0000' with 313 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0302443504333496
Calculate `GDI`: DONE
Total calculations elapsed time: 2.613037109375
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0396745204925537
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0000, with size 313, is uniform
Cluster 01_0000's shift to uniformity: -0.0175178017151365
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.0412926391382406, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.37948219828486, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.0323159784560144, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.43089123341141, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.00179533213644524, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.44383613651627, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 1, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.47612588512221, isUniform = TRUE, clusterSize = 313
cluster 01_0000 is uniform
* checking uniformity of cluster '1' of 4 clusters
Asked to drop 0 genes and 743 cells
COTAN dataset analysis: START
Asked to drop 51 genes and 0 cells
Genes/cells selection done: dropped [51] genes and [0] cells
Working on [549] genes and [257] cells
Dataset cleaning elapsed time: 0.832396030426025
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 1.67250895500183
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.112503099391263 | max: 646.681464270838 | % negative: 40.8014571948998
Model parameter estimation elapsed time: 2.54511427879333
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.51351141929626
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00693511962890625
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.029200553894043
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.824011325836182
Total calculations elapsed time: 3.3736584186554
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.20016503334045
Dataset analysis elapsed time: 7.57767534255981
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0001' with 257 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0307943820953369
Calculate `GDI`: DONE
Total calculations elapsed time: 2.47393417358398
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0361857414245605
Clean plots: DONE
GDI plot
Removed 1 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0001, with size 257, is uniform
Cluster 01_0001's shift to uniformity: -0.0466523594846431
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00910746812386157, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35034764051536, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00728597449908925, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37278730407697, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38664163146849, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.45240567481124, isUniform = TRUE, clusterSize = 257
cluster 01_0001 is uniform
* checking uniformity of cluster '2' of 4 clusters
Asked to drop 0 genes and 758 cells
COTAN dataset analysis: START
Asked to drop 77 genes and 0 cells
Genes/cells selection done: dropped [77] genes and [0] cells
Working on [523] genes and [242] cells
Dataset cleaning elapsed time: 0.819684267044067
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.69507789611816
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.166254045792573 | max: 224.924342782861 | % negative: 42.6386233269598
Model parameter estimation elapsed time: 2.52973008155823
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.67969131469727
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00531435012817383
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0267734527587891
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.977422952651978
Total calculations elapsed time: 3.68920207023621
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.55481934547424
Dataset analysis elapsed time: 7.90423369407654
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0002' with 242 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0275623798370361
Calculate `GDI`: DONE
Total calculations elapsed time: 2.64340686798096
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0408899784088135
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0002, with size 242, is uniform
Cluster 01_0002's shift to uniformity: -0.0473527936300242
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00764818355640535, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.34964720636998, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00764818355640535, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37472946305404, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38771313919654, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.43097703442027, isUniform = TRUE, clusterSize = 242
cluster 01_0002 is uniform
* checking uniformity of cluster '3' of 4 clusters
Asked to drop 0 genes and 812 cells
COTAN dataset analysis: START
Asked to drop 79 genes and 0 cells
Genes/cells selection done: dropped [79] genes and [0] cells
Working on [521] genes and [188] cells
Dataset cleaning elapsed time: 0.894350528717041
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 6 iterations
Total calculations elapsed time: 1.75123023986816
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.210007411487223 | max: 67.8701314818728 | % negative: 45.6813819577735
Model parameter estimation elapsed time: 2.61132884025574
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.58501958847046
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00494146347045898
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0238127708435059
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.852536916732788
Total calculations elapsed time: 3.46631073951721
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.30969858169556
Dataset analysis elapsed time: 7.81537795066833
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0003' with 188 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0267348289489746
Calculate `GDI`: DONE
Total calculations elapsed time: 2.55211281776428
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0370066165924072
Clean plots: DONE
GDI plot
Removed 4 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0003, with size 188, is uniform
Cluster 01_0003's shift to uniformity: -0.0672912272435866
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00383877159309021, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.32970877275641, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00191938579654511, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.35752445041521, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.37495297633956, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.4014884302523, isUniform = TRUE, clusterSize = 188
cluster 01_0003 is uniform
Found 4 uniform and 0 non-uniform clusters
Stopping: too few cells left to cluster
Unclustered cell left: 0
The final raw clusterization contains [ 4 ] different clusters: 01_0000, 01_0001, 01_0002, 01_0003
Differential Expression Analysis - START
* DEA on cluster '1' with 313 cells
* DEA on cluster '2' with 257 cells
* DEA on cluster '3' with 242 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0422577857971191
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 3, 2 -> 1, 3 -> 2, 4 -> 4
Total calculations elapsed time: 70.1271162033081
Creating cells' uniform clustering: DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2, 3 -> 3, 4 -> 4
Asked to drop 0 genes and 812 cells
COTAN dataset analysis: START
Asked to drop 79 genes and 0 cells
Genes/cells selection done: dropped [79] genes and [0] cells
Working on [521] genes and [188] cells
Dataset cleaning elapsed time: 0.842451810836792
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 6 iterations
Total calculations elapsed time: 1.71150612831116
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.210007411487223 | max: 67.8701314818728 | % negative: 45.6813819577735
Model parameter estimation elapsed time: 2.54381322860718
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.60699725151062
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00790238380432129
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0253522396087646
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.836679458618164
Total calculations elapsed time: 3.47693133354187
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.320232629776
Dataset analysis elapsed time: 7.70649766921997
COTAN dataset analysis: DONE
Checking uniformity for the cluster 'Cluster_4' with 188 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0262739658355713
Calculate `GDI`: DONE
Total calculations elapsed time: 2.70753145217896
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0374665260314941
Clean plots: DONE
GDI plot
Removed 4 low GDI genes (such as the fully-expressed) in GDI plot
Cluster Cluster_4, with size 188, is uniform
Cluster Cluster_4's shift to uniformity: -0.0672912272435866
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00383877159309021, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.32970877275641, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00191938579654511, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.35752445041521, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.37495297633956, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.4014884302523, isUniform = TRUE, clusterSize = 188
Differential Expression Analysis - START
* DEA on cluster '-1' with 50 cells
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 280 cells
* DEA on cluster '4' with 171 cells
Total calculations elapsed time: 0.0412311553955078
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 4, 2 -> 3, 3 -> 2, 4 -> 1, -1 -> -1
Applied reordering to clusterization is:
1 -> 1, 2 -> 2, 3 -> 3, 4 -> 4, -1 -> -1
Creating cells' uniform clustering: START
In iteration 1 the number of cells to re-cluster is 1000 cells belonging to 0 clusters
Asked to drop no genes or cells
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 600 genes using HVG_Seurat selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 3.45201992988586
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 67288
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.3650
Number of communities: 5
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 4.34594058990479
Creating new clusterization: DONE
Using passed in clusterization
Creating PDF UMAP in file: /tmp/RtmpaeuhNf/test/reclustering/pdf_umap_1.pdf
UMAP plot: START
Calculating UMAP: START
22:49:59 UMAP embedding parameters a = 0.9922 b = 1.112
22:49:59 Read 1000 rows and found 40 numeric columns
22:49:59 Using Annoy for neighbor search, n_neighbors = 30
22:49:59 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:49:59 Writing NN index file to temp file /tmp/RtmpaeuhNf/file53035a5b1884
22:49:59 Searching Annoy index using 1 thread, search_k = 3000
22:49:59 Annoy recall = 100%
22:50:00 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
22:50:02 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
22:50:02 Using 'irlba' for PCA
22:50:02 PCA: 2 components explained 36.15% variance
22:50:02 Scaling init to sdev = 1
22:50:02 Commencing optimization for 500 epochs, with 41630 positive edges
22:50:02 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:50:04 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 5.26687097549438
UMAP plot: DONE
UMAP plot: START
Calculating UMAP: START
22:50:04 UMAP embedding parameters a = 0.9922 b = 1.112
22:50:04 Read 1000 rows and found 40 numeric columns
22:50:04 Using Annoy for neighbor search, n_neighbors = 30
22:50:04 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:50:04 Writing NN index file to temp file /tmp/RtmpaeuhNf/file5303778cee0c
22:50:04 Searching Annoy index using 1 thread, search_k = 3000
22:50:05 Annoy recall = 100%
22:50:06 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
22:50:07 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
22:50:07 Using 'irlba' for PCA
22:50:07 PCA: 2 components explained 36.15% variance
22:50:07 Scaling init to sdev = 1
22:50:07 Commencing optimization for 500 epochs, with 41630 positive edges
22:50:07 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
22:50:09 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 5.2321891784668
UMAP plot: DONE
* checking uniformity of cluster '1' of 2 clusters
Asked to drop 0 genes and 500 cells
COTAN dataset analysis: START
Asked to drop 38 genes and 0 cells
Genes/cells selection done: dropped [38] genes and [0] cells
Working on [562] genes and [500] cells
Dataset cleaning elapsed time: 0.850051641464233
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.87683320045471
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.108871643378045 | max: 295.971778839086 | % negative: 35.0533807829181
Model parameter estimation elapsed time: 2.79284572601318
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.8584144115448
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00693607330322266
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0399792194366455
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.874227285385132
Total calculations elapsed time: 3.7795569896698
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.64774012565613
Dataset analysis elapsed time: 8.29063749313354
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0001' with 500 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.030503511428833
Calculate `GDI`: DONE
Total calculations elapsed time: 2.72784519195557
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0370118618011475
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0001, with size 500, is uniform
Cluster 01_0001's shift to uniformity: -0.041730199066494
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.0124555160142349, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35526980093351, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00889679715302491, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.38536328181495, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.40346106115492, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.42565794715045, isUniform = TRUE, clusterSize = 500
cluster 01_0001 is uniform
* checking uniformity of cluster '2' of 2 clusters
Asked to drop 0 genes and 500 cells
COTAN dataset analysis: START
Asked to drop 44 genes and 0 cells
Genes/cells selection done: dropped [44] genes and [0] cells
Working on [556] genes and [500] cells
Dataset cleaning elapsed time: 0.92162013053894
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.95200800895691
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0636486786621688 | max: 141.389145035675 | % negative: 36.1510791366906
Model parameter estimation elapsed time: 2.81871557235718
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.82413935661316
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00646519660949707
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0388479232788086
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.907938480377197
Total calculations elapsed time: 3.77739095687866
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.65187525749207
Dataset analysis elapsed time: 8.39221096038818
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0002' with 500 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0316019058227539
Calculate `GDI`: DONE
Total calculations elapsed time: 2.70612072944641
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0360798835754395
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0002, with size 500, is uniform
Cluster 01_0002's shift to uniformity: -0.0413872276843505
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00719424460431655, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35561277231565, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00359712230215827, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37204026755188, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38757136821537, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.40876953414106, isUniform = TRUE, clusterSize = 500
cluster 01_0002 is uniform
Found 2 uniform and 0 non-uniform clusters
Stopping: too few cells left to cluster
Unclustered cell left: 0
The final raw clusterization contains [ 2 ] different clusters: 01_0001, 01_0002
Differential Expression Analysis - START
* DEA on cluster '1' with 500 cells
* DEA on cluster '2' with 500 cells
Total calculations elapsed time: 0.0345103740692139
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Total calculations elapsed time: 45.5468249320984
Creating cells' uniform clustering: DONE
findClustersMarkers - START
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 3.5900821685791
Log Fold Change Analysis - DONE
Total calculations elapsed time: 3.60139465332031
findClustersMarkers - DONE
findClustersMarkers - START
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 3.54458022117615
Log Fold Change Analysis - DONE
Total calculations elapsed time: 3.5554084777832
findClustersMarkers - DONE
findClustersMarkers - START
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0325112342834473
Differential Expression Analysis - DONE
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 3.59872722625732
Log Fold Change Analysis - DONE
Total calculations elapsed time: 3.64125180244446
findClustersMarkers - DONE
[1] "Tested cluster: 1"
Asked to drop 0 genes and 743 cells
COTAN dataset analysis: START
Asked to drop 51 genes and 0 cells
Genes/cells selection done: dropped [51] genes and [0] cells
Working on [549] genes and [257] cells
Dataset cleaning elapsed time: 0.872138261795044
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 1.84380125999451
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.112503099391263 | max: 646.681464270838 | % negative: 40.8014571948998
Model parameter estimation elapsed time: 2.7330379486084
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.88776206970215
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00555610656738281
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0283651351928711
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.879999399185181
Total calculations elapsed time: 3.80168271064758
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.69761514663696
Dataset analysis elapsed time: 8.30279135704041
COTAN dataset analysis: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0295281410217285
Calculate `GDI`: DONE
Total calculations elapsed time: 2.70552778244019
Calculate GDI dataframe: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.89766335487366
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.825929403305054
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.89407253265381
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.76337695121765
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.868558168411255
Dataset analysis elapsed time: 4.45786452293396
COTAN dataset analysis: DONE
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Centering and scaling data matrix
|
| | 0%
|
|======================================================================| 100%
PC_ 1
Positive: g-000397, g-000525, g-000460, g-000458, g-000535, g-000217, g-000194, g-000497, g-000432, g-000383
g-000318, g-000486, g-000464, g-000588, g-000549, g-000368, g-000252, g-000151, g-000209, g-000538
g-000325, g-000514, g-000524, g-000244, g-000320, g-000201, g-000499, g-000309, g-000290, g-000483
Negative: g-000415, g-000506, g-000496, g-000579, g-000572, g-000421, g-000455, g-000328, g-000178, g-000567
g-000405, g-000296, g-000387, g-000501, g-000493, g-000481, g-000343, g-000528, g-000551, g-000414
g-000367, g-000594, g-000159, g-000517, g-000574, g-000229, g-000222, g-000533, g-000243, g-000306
PC_ 2
Positive: g-000141, g-000093, g-000089, g-000033, g-000123, g-000557, g-000330, g-000156, g-000142, g-000095
g-000061, g-000235, g-000032, g-000186, g-000056, g-000259, g-000027, g-000041, g-000333, g-000386
g-000009, g-000395, g-000048, g-000116, g-000340, g-000418, g-000035, g-000332, g-000086, g-000040
Negative: g-000088, g-000158, g-000255, g-000115, g-000054, g-000472, g-000554, g-000391, g-000253, g-000226
g-000051, g-000147, g-000541, g-000077, g-000224, g-000194, g-000290, g-000293, g-000313, g-000118
g-000121, g-000220, g-000467, g-000500, g-000341, g-000039, g-000091, g-000249, g-000426, g-000288
PC_ 3
Positive: g-000126, g-000083, g-000086, g-000117, g-000130, g-000010, g-000498, g-000333, g-000047, g-000179
g-000340, g-000035, g-000531, g-000140, g-000527, g-000049, g-000316, g-000031, g-000014, g-000073
g-000218, g-000445, g-000129, g-000175, g-000105, g-000581, g-000404, g-000025, g-000266, g-000354
Negative: g-000096, g-000575, g-000370, g-000337, g-000319, g-000364, g-000308, g-000293, g-000147, g-000307
g-000038, g-000492, g-000541, g-000185, g-000008, g-000482, g-000562, g-000097, g-000222, g-000084
g-000141, g-000377, g-000224, g-000223, g-000136, g-000434, g-000277, g-000426, g-000139, g-000093
PC_ 4
Positive: g-000006, g-000043, g-000462, g-000279, g-000180, g-000576, g-000087, g-000584, g-000498, g-000333
g-000189, g-000088, g-000451, g-000059, g-000135, g-000281, g-000106, g-000429, g-000316, g-000578
g-000303, g-000031, g-000581, g-000026, g-000122, g-000561, g-000546, g-000164, g-000353, g-000300
Negative: g-000072, g-000012, g-000129, g-000052, g-000097, g-000262, g-000080, g-000056, g-000025, g-000092
g-000354, g-000334, g-000423, g-000228, g-000002, g-000010, g-000086, g-000147, g-000185, g-000172
g-000124, g-000009, g-000077, g-000476, g-000126, g-000145, g-000065, g-000268, g-000152, g-000348
PC_ 5
Positive: g-000105, g-000037, g-000110, g-000054, g-000090, g-000389, g-000022, g-000578, g-000289, g-000147
g-000547, g-000011, g-000477, g-000433, g-000200, g-000348, g-000404, g-000003, g-000250, g-000109
g-000402, g-000241, g-000595, g-000341, g-000560, g-000385, g-000413, g-000352, g-000573, g-000265
Negative: g-000051, g-000150, g-000088, g-000476, g-000344, g-000116, g-000428, g-000012, g-000523, g-000394
g-000101, g-000127, g-000069, g-000214, g-000049, g-000357, g-000075, g-000081, g-000576, g-000342
g-000439, g-000018, g-000070, g-000079, g-000015, g-000550, g-000600, g-000247, g-000218, g-000331
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 68107
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.5999
Number of communities: 2
Elapsed time: 0 seconds
Clusterizations found: RNA_snn_res.0.8, seurat_clusters
Conditions found: orig.ident
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.919338226318359
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.03692197799683
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.04927659034729
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.885017395019531
Dataset analysis elapsed time: 4.85363221168518
COTAN dataset analysis: DONE
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.893667697906494
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.02790689468384
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.93469715118408
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.92836737632751
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0057075023651123
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0641255378723145
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.850955486297607
Total calculations elapsed time: 3.84915590286255
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.77550768852234
Dataset analysis elapsed time: 8.60387253761292
COTAN dataset analysis: DONE
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.00540041923522949
calculating PValues: DONE
Number of selected secondary markers: 6
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00828003883361816
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 6
Number of rows (U set): 60
Total calculations elapsed time: 0.89075756072998
Calculating gene co-expression space - DONE
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.00756216049194336
calculating PValues: DONE
Number of selected secondary markers: 98
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00792574882507324
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 98
Number of rows (U set): 60
Total calculations elapsed time: 0.887863397598267
Calculating gene co-expression space - DONE
Establishing gene clusters - START
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.00752568244934082
calculating PValues: DONE
Number of selected secondary markers: 98
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00789046287536621
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 98
Number of rows (U set): 60
Total calculations elapsed time: 0.899046659469604
Calculating gene co-expression space - DONE
Total calculations elapsed time: 0.966251373291016
Establishing gene clusters - DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.923646450042725
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.03502249717712
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.89448022842407
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.897595405578613
Dataset analysis elapsed time: 4.71572208404541
COTAN dataset analysis: DONE
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0391378402709961
Differential Expression Analysis - DONE
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 3.69560766220093
Log Fold Change Analysis - DONE
clustersDeltaExpression - START
Handling cluster '1' with mean UDE 1.10997640736885
Handling cluster '2' with mean UDE 1.00770245700749
Handling cluster '3' with mean UDE 0.95940682189354
Handling cluster '4' with mean UDE 0.907328369455933
clustersDeltaExpression - DONE
In group G1 there are 3 detected over 3 genes
In group G2 there are 2 detected over 3 genes
In group G3 there are 5 detected over 5 genes
Merging cells' uniform clustering: START
The merge algorithm will use 2 passes
Start merging nearest clusters - the main threshold is: 1.297
Start merging nearest clusters: iteration 1
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0383999347686768
Differential Expression Analysis - DONE
Updating check results for the 0 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("1", "2")
*1_2-merge
Asked to drop 0 genes and 501 cells
COTAN dataset analysis: START
Asked to drop 16 genes and 0 cells
Genes/cells selection done: dropped [16] genes and [0] cells
Working on [584] genes and [499] cells
Dataset cleaning elapsed time: 0.88506031036377
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 1.90134310722351
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0608154544840047 | max: 1260.06995351592 | % negative: 35.6164383561644
Model parameter estimation elapsed time: 2.7722179889679
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.75890207290649
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00692868232727051
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0412404537200928
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.904064655303955
Total calculations elapsed time: 3.71113586425781
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.69518661499023
Dataset analysis elapsed time: 8.3524649143219
COTAN dataset analysis: DONE
Checking uniformity for the cluster '1_2-merge' with 499 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0306413173675537
Calculate `GDI`: DONE
Total calculations elapsed time: 2.74444580078125
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.036137580871582
Clean plots: DONE
GDI plot
Removed 1 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 1_2-merge, with size 499, is not uniform
Cluster 1_2-merge's shift to uniformity: 0.0566581136434114
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.297, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.178082191780822, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35365811364341, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.307, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.148972602739726, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37149326865972, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.4, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.00513698630136986, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38256306292787, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.4, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 3, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.42111642638124, isUniform = FALSE, clusterSize = 499
Clusters 1 and 2 cannot be merged
Finished the first batch - no merges were executed
Loop calculations elapsed time: 15.6680500507355
Start merging nearest clusters: iteration 2
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0291168689727783
Differential Expression Analysis - DONE
Updating check results for the 1 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("3", "4")
*3_4-merge
Asked to drop 0 genes and 499 cells
COTAN dataset analysis: START
Asked to drop 37 genes and 0 cells
Genes/cells selection done: dropped [37] genes and [0] cells
Working on [563] genes and [501] cells
Dataset cleaning elapsed time: 0.906075000762939
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 11 iterations
Total calculations elapsed time: 1.90269660949707
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.107568326617881 | max: 698.639334552754 | % negative: 32.1492007104796
Model parameter estimation elapsed time: 2.79058527946472
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.88574123382568
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00582146644592285
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0391256809234619
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.988543033599854
Total calculations elapsed time: 3.91923141479492
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.86020684242249
Dataset analysis elapsed time: 8.55686712265015
COTAN dataset analysis: DONE
Checking uniformity for the cluster '3_4-merge' with 501 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0286071300506592
Calculate `GDI`: DONE
Total calculations elapsed time: 2.72035193443298
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0364611148834229
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 3_4-merge, with size 501, is not uniform
Cluster 3_4-merge's shift to uniformity: 0.0813107504723223
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.297, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.259325044404973, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.37831075047232, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.307, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.216696269982238, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.41473792188166, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.4, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.0301953818827709, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.43341610223243, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.4, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 17, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.46173948790285, isUniform = FALSE, clusterSize = 501
Clusters 3 and 4 cannot be merged
No clusters will be merged
None of the remaining tested cluster pairs could be merged
Executed all merges for threshold 1.297 out of 2 checks
Start merging nearest clusters - the main threshold is: 1.397
Start merging nearest clusters: iteration 3
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0287199020385742
Differential Expression Analysis - DONE
Updating check results for the 2 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("2", "4")
*2_4-merge
Asked to drop 0 genes and 570 cells
COTAN dataset analysis: START
Asked to drop 9 genes and 0 cells
Genes/cells selection done: dropped [9] genes and [0] cells
Working on [591] genes and [430] cells
Dataset cleaning elapsed time: 0.900818347930908
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.82449579238892
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0739592351622374 | max: 400.051960722894 | % negative: 25.7191201353638
Model parameter estimation elapsed time: 2.69260334968567
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.79681158065796
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0056757926940918
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0392172336578369
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.897788047790527
Total calculations elapsed time: 3.73949265480042
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.64672899246216
Dataset analysis elapsed time: 8.24015069007874
COTAN dataset analysis: DONE
Checking uniformity for the cluster '2_4-merge' with 430 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0297434329986572
Calculate `GDI`: DONE
Total calculations elapsed time: 2.67678809165955
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0372257232666016
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 2_4-merge, with size 430, is not uniform
Cluster 2_4-merge's shift to uniformity: 3.07228472969514
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.583756345177665, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 3.7954982715656, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.576988155668359, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 4.08354952912925, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.524534686971235, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 4.42722016730736, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 310, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 4.57228472969514, isUniform = FALSE, clusterSize = 430
Clusters 2 and 4 cannot be merged
Clusters 1 and 2 will be merged
Clusters 4 and 3 will be merged
Executed 2 merges
Loop calculations elapsed time: 15.3707609176636
Start merging nearest clusters: iteration 4
Differential Expression Analysis - START
* DEA on cluster '1_2-merge' with 499 cells
* DEA on cluster '3_4-merge' with 501 cells
Total calculations elapsed time: 0.0262353420257568
Differential Expression Analysis - DONE
Updating check results for the 3 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("1_2-merge", "3_4-merge")
*1_2-merge_3_4-merge-merge
Asked to drop no genes or cells
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.934694766998291
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 1.97524285316467
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 2.91702055931091
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.96457433700562
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00543427467346191
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0609414577484131
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.851160049438477
Total calculations elapsed time: 3.88211011886597
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.76061391830444
Dataset analysis elapsed time: 8.61232924461365
COTAN dataset analysis: DONE
Checking uniformity for the cluster '1_2-merge_3_4-merge-merge' with 1000 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0308840274810791
Calculate `GDI`: DONE
Total calculations elapsed time: 2.70182156562805
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0380733013153076
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 1_2-merge_3_4-merge-merge, with size 1000, is not uniform
Cluster 1_2-merge_3_4-merge-merge's shift to uniformity: 3.86988385120409
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.69, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 4.54596809454193, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.678333333333333, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 4.93144728766684, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.593333333333333, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 5.2532296852478, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 356, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 5.36988385120409, isUniform = FALSE, clusterSize = 1000
Clusters 1_2-merge and 3_4-merge cannot be merged
No clusters will be merged
None of the remaining tested cluster pairs could be merged
Executed all merges for threshold 1.397 out of 4 checks
The final merged clusterization contains [2] different clusters: 1_2-merge, 3_4-merge
Differential Expression Analysis - START
* DEA on cluster '1' with 499 cells
* DEA on cluster '2' with 501 cells
Total calculations elapsed time: 0.0283322334289551
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Total calculations elapsed time: 62.8918297290802
Merging cells' uniform clustering: DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
Total calculations elapsed time: 1.85304117202759
Log Fold Change Analysis - DONE
[1] "Tested cluster: 1"
Asked to drop 0 genes and 501 cells
COTAN dataset analysis: START
Asked to drop 16 genes and 0 cells
Genes/cells selection done: dropped [16] genes and [0] cells
Working on [584] genes and [499] cells
Dataset cleaning elapsed time: 0.97443413734436
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 1.90290594100952
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0608154544840047 | max: 1260.06995351592 | % negative: 35.6164383561644
Model parameter estimation elapsed time: 2.77134966850281
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.808345079422
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00774955749511719
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0411272048950195
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.898061752319336
Total calculations elapsed time: 3.75528359413147
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 4.72377276420593
Dataset analysis elapsed time: 8.4695565700531
COTAN dataset analysis: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0309054851531982
Calculate `GDI`: DONE
Total calculations elapsed time: 2.88365173339844
Calculate GDI dataframe: DONE
Dispersion bisection: straddling used 2 iterations
Dispersion bisection: used 8 iterations
Dispersion bisection: straddling used 1 iterations
Dispersion bisection: used 9 iterations
Dispersion Newton-Raphson: used up to 4 iterations
Dispersion Newton-Raphson: used up to 4 iterations
parallel dispersion bisection: straddling used up to 2 iterations
Parallel dispersion bisection: used up to 9 iterations
Parallel dispersion Newton-Raphson: used up to 4 iterations
[ FAIL 0 | WARN 3 | SKIP 0 | PASS 572 ]
[ FAIL 0 | WARN 3 | SKIP 0 | PASS 572 ]
>
> proc.time()
user system elapsed
626.952 3.366 626.534
COTAN.Rcheck/COTAN-Ex.timings
| name | user | system | elapsed | |
| COTAN_Legacy | 0.001 | 0.001 | 0.002 | |
| COTAN_ObjectCreation | 8.892 | 0.492 | 9.097 | |
| CalculatingCOEX | 51.549 | 1.041 | 51.539 | |
| ClustersList | 0.007 | 0.000 | 0.008 | |
| Conversions | 4.637 | 0.036 | 4.674 | |
| GenesStatistics | 10.825 | 0.048 | 10.591 | |
| HandleMetaData | 0.034 | 0.002 | 0.037 | |
| HandlingClusterizations | 40.134 | 0.315 | 40.120 | |
| HandlingConditions | 0.068 | 0.003 | 0.071 | |
| HeatmapPlots | 30.604 | 0.472 | 30.293 | |
| Installing_torch | 0.001 | 0.000 | 0.001 | |
| LoggingFunctions | 0.002 | 0.000 | 0.002 | |
| ParametersEstimations | 21.365 | 0.253 | 21.602 | |
| RawDataCleaning | 4.660 | 0.034 | 4.611 | |
| RawDataGetters | 0.038 | 0.001 | 0.039 | |
| UniformClusters | 67.665 | 0.292 | 67.177 | |
| getColorsVector | 0.000 | 0.001 | 0.001 | |