A new look at the dirichlet distribution : robustness, clustering, and both together
Loading...
Date
Journal Title
Journal ISSN
Volume Title
Publisher
Springer
Abstract
Compositional data have peculiar characteristics that pose significant challenges to traditional statistical methods and models. Within this framework, we use a convenient mode parametrized Dirichlet distribution across multiple fields of statistics. In particular, we propose finite mixtures of unimodal Dirichlet (UD) distributions for model-based clustering and classification. Then, we introduce the contaminated UD (CUD) distribution, a heavy-tailed generalization of the UD distribution that allows for a more flexible tail behavior in the presence of atypical observations. Thirdly, we propose finite mixtures of CUD distributions to jointly account for the presence of clusters and atypical points in the data. Parameter estimation is carried out by directly maximizing the maximum likelihood or by using an expectation-maximization (EM) algorithm. Two analyses are conducted on simulated data to illustrate the effects of atypical observations on parameter estimation and data classification, and how our proposals address both aspects. Furthermore, two real datasets are investigated and the results obtained via our models are discussed.
Description
DATA AVAILABILITY : The real datasets used in this manuscript are publicly available as described in the manuscript.
CHANGE HISTORY : 24 November 2024. Missing Open Access funding information has been added in the Funding Note.
Keywords
Compositional data, Dirichlet distribution, Mode, Model-based clustering, Robustness
Sustainable Development Goals
SDG-04: Quality Education
Citation
Tomarchio, S.D., Punzo, A., Ferreira, J.T. et al. A New Look at the Dirichlet Distribution: Robustness, Clustering, and Both Together. Journal of Classification 42, 31–53 (2025). https://doi.org/10.1007/s00357-024-09480-4.