Do not smile when acquiring consumer selfies for multi-attribute skin profiling and baseline deep learning evaluation.

Authors

Dennis Hartmann, Dominik Müller, Florian Auer, Gabriele Marie Lehner, Laura Gockeln, Anna Rottenkolber, Gabriel Duttler, Julia Welzel, Frank Kramer

Published in

Scientific reports. Volume 16. Issue 1. Aug 08, 2026. Epub Aug 08, 2026.

Abstract

The increasing demand for personalized skincare solutions highlights a significant gap: many consumers struggle to find suitable products without professional guidance. While the commercial potential for tailored product recommendations is vast, a key challenge remains the lack of effective methods for skin profiling via image classification. To address this challenge, this paper introduces a comprehensive benchmark dataset of 3203 standardized facial consumer selfies, annotated across eight primary cosmetic skin features. We establish a transparent baseline evaluation utilizing the open-source medical image classification framework AUCMEDI. A variety of deep learning architectures were trained to recognize and classify various skin features, including sagging skin, wrinkles, under-eye circles, redness, shine, pigment spots, acne, and pore size. The baseline model's performance was evaluated using the mean absolute error (e), which appropriately accounts for the ordinal distance in cosmetic grading. Utilizing standard deep learning architectures, the baseline benchmark established promising performance in structural categories like sagging skin ([Formula: see text]) and wrinkles ([Formula: see text]). While achieving satisfactory results for under-eye circles ([Formula: see text]), redness ([Formula: see text]), and shine ([Formula: see text]), the baseline models encountered significant architectural limitations when resolving highly localized or imbalanced features such as acne ([Formula: see text]), pore size ([Formula: see text]), and pigment spots ([Formula: see text]), the latter three underperforming a trivial constant-mean predictor.

PMID:
42570980
Bibliographic data and abstract were imported from PubMed on 09 Aug 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.