A new look at the dirichlet distribution : robustness, clustering, and both together

Abstract

Compositional data have peculiar characteristics that pose significant challenges to traditional statistical methods and models. Within this framework, we use a convenient mode parametrized Dirichlet distribution across multiple fields of statistics. In particular, we propose finite mixtures of unimodal Dirichlet (UD) distributions for model-based clustering and classification. Then, we introduce the contaminated UD (CUD) distribution, a heavy-tailed generalization of the UD distribution that allows for a more flexible tail behavior in the presence of atypical observations. Thirdly, we propose finite mixtures of CUD distributions to jointly account for the presence of clusters and atypical points in the data. Parameter estimation is carried out by directly maximizing the maximum likelihood or by using an expectation-maximization (EM) algorithm. Two analyses are conducted on simulated data to illustrate the effects of atypical observations on parameter estimation and data classification, and how our proposals address both aspects. Furthermore, two real datasets are investigated and the results obtained via our models are discussed.

Description

DATA AVAILABILITY : The real datasets used in this manuscript are publicly available as described in the manuscript. CHANGE HISTORY : 24 November 2024. Missing Open Access funding information has been added in the Funding Note.

Keywords

Compositional data, Dirichlet distribution, Mode, Model-based clustering, Robustness

Sustainable Development Goals

SDG-04: Quality Education

Citation

Tomarchio, S.D., Punzo, A., Ferreira, J.T. et al. A New Look at the Dirichlet Distribution: Robustness, Clustering, and Both Together. Journal of Classification 42, 31–53 (2025). https://doi.org/10.1007/s00357-024-09480-4.