Litcius/Paper detail

Swarm v3: towards tera-scale amplicon clustering

Frédéric Mahé, Lucas Czech, Alexandros Stamatakis, Christopher Quince, Colomban de Vargas, Micah Dunthorn, Torbjørn Rognes

2021Bioinformatics129 citationsDOIOpen Access PDF

Abstract

MOTIVATION: Previously we presented swarm, an open-source amplicon clustering programme that produces fine-scale molecular operational taxonomic units (OTUs) that are free of arbitrary global clustering thresholds. Here, we present swarm v3 to address issues of contemporary datasets that are growing towards tera-byte sizes. RESULTS: When compared with previous swarm versions, swarm v3 has modernized C++ source code, reduced memory footprint by up to 50%, optimized CPU-usage and multithreading (more than 7 times faster with default parameters), and it has been extensively tested for its robustness and logic. AVAILABILITY AND IMPLEMENTATION: Source code and binaries are available at https://github.com/torognes/swarm. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Topics & Concepts

Swarm behaviourTera-Computer scienceCluster analysisSource codeScalabilityRobustness (evolution)MultithreadingOpen sourceData miningParallel computingAmpliconBlacklistSoftwareArtificial intelligenceThread (computing)DatabaseOperating systemBiologyWorld Wide WebGeneBiochemistryPolymerase chain reactionGenomics and Phylogenetic StudiesBioinformatics and Genomic NetworksGenetics, Bioinformatics, and Biomedical Research