Recognition and classification of skin condition

Deep neural network detecting and classifying skin tone evenness for the purpose of recommending appropriate cosmetics

Meet our client


CUSTOMEROne of the world’s
largest manufacturers
of beauty products

How we did it

The beauty industry offers tens of thousands of cosmetics and treatments. An individual approach to consumers’ beauty needs is key to maintaining their interest.

The challenge

Our client - one of the world’s largest manufacturers of beauty products – was looking for a tool that automates recognition and classification of the clients’ skin to measure its attributes, such as evenness or hydration.

The solution created a system that analyzes photos of skin to automate the process of suggesting cosmetics. The system recognizes and classifies the skin tone and evenness of the client’s face. The assessment is preceded by very careful data preparation including face detection, normalization and controlled adaptation through various image augmentations. A deep neural network then processes the photos to provide the skin grading. The solution produced robust outputs despite the varying photo quality and lighting conditions, making it suitable for working with studio-quality photos and hand-made selfies.

The effect

Our solution is 91% accurate*, significantly outperforming humans. Further improvements to be made to the system may include the ability to recognize other customers’ skin attributes such as hydration, shine, pores, acne scarring and wrinkles.
*measured by mean average error

Contact us

The administrator of the personal data provided by you in the registration form is sp. z o.o., headquartered at al. Jerozolimskie 44, 00-024 Warsaw, Poland. Your personal data will be processed for the purpose of directing marketing content to you.
Detailed information about the processing of your personal data, including your rights, can be found in our privacy policy.
* This consent is required to receive email communication from sp. z o.o. regarding the company and its offerings.
  •, Inc.
  • 2100 Geng Road, Suite 210
  • Palo Alto, CA 94303
  • United States of America
  • Sp. z o.o.
  • al. Jerozolimskie 44
  • 00-024 Warsaw
  • Poland
  • ul. Łęczycka 59
  • 85-737 Bydgoszcz
  • Poland
Let us know how we can help