Benchmarking bacterial taxonomic classification using nanopore metagenomics data of several mock communities

Loading...
Thumbnail Image

Authors

Van Uffelen, Alexander
Posadas, Andres
Roosens, Nancy H.C.
Marchal, Kathleen
De Keersmaecker, Sigrid C. J.
Vanneste, Kevin

Journal Title

Journal ISSN

Volume Title

Publisher

Nature Research

Abstract

Taxonomic classification is crucial in identifying organisms within diverse microbial communities when using metagenomics shotgun sequencing. While second-generation Illumina sequencing still dominates, third-generation nanopore sequencing promises improved classification through longer reads. However, extensive benchmarking studies on nanopore data are lacking. We systematically evaluated performance of bacterial taxonomic classification for metagenomics nanopore sequencing data for several commonly used classifiers, using standardized reference sequence databases, on the largest collection of publicly available data for defined mock communities thus far (nine samples), representing different research domains and application scopes. Our results categorize classifiers into three categories: low precision/high recall; medium precision/medium recall, and high precision/medium recall. Most fall into the first group, although precision can be improved without excessively penalizing recall with suitable abundance filtering. No definitive ‘best’ classifier emerges, and classifier selection depends on application scope and practical requirements. Although few classifiers designed for long reads exist, they generally exhibit better performance. Our comprehensive benchmarking provides concrete recommendations, supported by publicly available code for reassessment and fine-tuning by other scientists.

Description

DATA AVAILABILITY : The datasets presented in this study originate from other studies and can be found under the run accessions in Table 1. The output reports with all metrics and plots are available on Zenodo (https://zenodo.org/doi/10.5281/zenodo.11371848)
CODE AVAILABILITY : The source code to perform the analysis and generate the output reports is publicly available on GitHub (https://github.com/BioinformaticsPlatformWIV-ISP/BenchmarkingClassifiers) accompanied by an example dataset showcasing the expected output structure and final output file.

Keywords

Classification and taxonomy, Metagenomics, SDG-15: Life on land

Sustainable Development Goals

SDG-15:Life on land

Citation

Van Uffelen, A., Posadas, A., Roosens, N.H.C. et al. Benchmarking bacterial taxonomic classification using nanopore metagenomics data of several mock communities. Scientific Data 11, 864 (2024). https://doi.org/10.1038/s41597-024-03672-8.