Article 2026-04-22 under-review v1

Do not smile: Selfie Skin Profiling using Deep Learning

D
Dennis Hartmann University of Augsburg
F
Florian Auer University of Augsburg
D
Dominik Müller University of Augsburg
G
Gabriele Marie Lehner University Hospital Augsburg
L
Laura Gockeln University Hospital Augsburg
A
Anna Rottenkolber Grandel the Beautyness Company
G
Gabriel Duttler Grandel the Beautyness Company
J
Julia Welzel University Hospital Augsburg
F
Frank Kramer University of Augsburg

Abstract

The increasing demand for personalized skincare solutions highlights a significant gap: many consumers struggle to findsuitable products without professional guidance. While the commercial potential for tailored product recommendations is vast,a key challenge remains the lack of effective methods for skin profiling via image classification. To work on this challenge, adeep learning-based approach was developed. For this, we utilized the AUCMEDI framework, an open-source tool designedfor automated classification of medical images. The framework was applied to a dataset consisting of 3,203 facial images asselfies. A variety of architectures were trained to recognize and classify various skin features, including sagging skin, wrinkles,under-eye circles, redness, shine, pigment spots, acne, and pore size. The model’s performance was evaluated using theaverage absolute error (e) . By employing sophisticated image classification techniques, we have demonstrated promisingperformance in classifying sagging skin (e = 1.71) and wrinkles (e = 1.40). While achieving satisfactory results for under-eyecircles(e = 0.32), redness (e = 2.22), shine (e = 0.23), and pigment spots (e = 2.20), we encountered greater challenges inclassifying acne (e = 2.59) and pore size (e = 2.57). This paper introduces a novel approach to automated skin analysis andprofiling, which lays the groundwork for more objective tools in dermatological assessment.

Citation Information

@article{dennishartmann2026,
  title={Do not smile: Selfie Skin Profiling using Deep Learning},
  author={Dennis Hartmann and Florian Auer and Dominik Müller and Gabriele Marie Lehner and Laura Gockeln and Anna Rottenkolber and Gabriel Duttler and Julia Welzel and Frank Kramer},
  journal={Scientific Reports},
  year={2026},
  doi={https://doi.org/10.21203/rs.3.rs-8840276/v1}
}
Back to Top
Home
Paper List
Submit
0.026531s