Label Distribution-Based Facial Attractiveness Computation by Deep Residual Learning

Yang Yu Fan, Shu Liu, Bo Li, Zhe Guo, Ashok K Samal, Jun Wan, Stan Z. Li

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Two key challenges lie in the facial attractiveness computation research: the lack of discriminative face representations, and the scarcity of sufficient and complete training data. Motivated by recent promising work in face recognition using deep neural networks to learn effective features, the first challenge is expected to be addressed from a deep learning point of view. A very deep residual network is utilized to enable automatic learning of hierarchical aesthetics representation. The inspiration to deal with the second challenge comes from the natural representation of the training data, where each training face can be associated with a label (score) distribution given by human raters rather than a single label (average score). This paper, therefore, recasts facial attractiveness computation as a label distribution learning problem. Integrating these two ideas, an end-to-end attractiveness learning framework is established. We also perform feature-level fusion by incorporating the low-level geometric features to further improve the computational performance. Extensive experiments are conducted on a standard benchmark, the SCUT-FBP dataset, where our approach shows significant advantages over the other state-of-the-art work.

Original languageEnglish (US)
Pages (from-to)2196-2208
Number of pages13
JournalIEEE Transactions on Multimedia
Volume20
Issue number8
DOIs
StatePublished - Aug 2018

Fingerprint

Labels
Face recognition
Fusion reactions
Experiments
Deep neural networks
Deep learning

Keywords

  • Facial attractiveness computation
  • SCUT-FBP
  • deep residual network
  • feature fusion
  • label distribution

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Label Distribution-Based Facial Attractiveness Computation by Deep Residual Learning. / Fan, Yang Yu; Liu, Shu; Li, Bo; Guo, Zhe; Samal, Ashok K; Wan, Jun; Li, Stan Z.

In: IEEE Transactions on Multimedia, Vol. 20, No. 8, 08.2018, p. 2196-2208.

Research output: Contribution to journalArticle

Fan, Yang Yu ; Liu, Shu ; Li, Bo ; Guo, Zhe ; Samal, Ashok K ; Wan, Jun ; Li, Stan Z. / Label Distribution-Based Facial Attractiveness Computation by Deep Residual Learning. In: IEEE Transactions on Multimedia. 2018 ; Vol. 20, No. 8. pp. 2196-2208.
@article{be7d95ebcb804e15895fc8c7c3f9311d,
title = "Label Distribution-Based Facial Attractiveness Computation by Deep Residual Learning",
abstract = "Two key challenges lie in the facial attractiveness computation research: the lack of discriminative face representations, and the scarcity of sufficient and complete training data. Motivated by recent promising work in face recognition using deep neural networks to learn effective features, the first challenge is expected to be addressed from a deep learning point of view. A very deep residual network is utilized to enable automatic learning of hierarchical aesthetics representation. The inspiration to deal with the second challenge comes from the natural representation of the training data, where each training face can be associated with a label (score) distribution given by human raters rather than a single label (average score). This paper, therefore, recasts facial attractiveness computation as a label distribution learning problem. Integrating these two ideas, an end-to-end attractiveness learning framework is established. We also perform feature-level fusion by incorporating the low-level geometric features to further improve the computational performance. Extensive experiments are conducted on a standard benchmark, the SCUT-FBP dataset, where our approach shows significant advantages over the other state-of-the-art work.",
keywords = "Facial attractiveness computation, SCUT-FBP, deep residual network, feature fusion, label distribution",
author = "Fan, {Yang Yu} and Shu Liu and Bo Li and Zhe Guo and Samal, {Ashok K} and Jun Wan and Li, {Stan Z.}",
year = "2018",
month = "8",
doi = "10.1109/TMM.2017.2780762",
language = "English (US)",
volume = "20",
pages = "2196--2208",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "8",

}

TY - JOUR

T1 - Label Distribution-Based Facial Attractiveness Computation by Deep Residual Learning

AU - Fan, Yang Yu

AU - Liu, Shu

AU - Li, Bo

AU - Guo, Zhe

AU - Samal, Ashok K

AU - Wan, Jun

AU - Li, Stan Z.

PY - 2018/8

Y1 - 2018/8

N2 - Two key challenges lie in the facial attractiveness computation research: the lack of discriminative face representations, and the scarcity of sufficient and complete training data. Motivated by recent promising work in face recognition using deep neural networks to learn effective features, the first challenge is expected to be addressed from a deep learning point of view. A very deep residual network is utilized to enable automatic learning of hierarchical aesthetics representation. The inspiration to deal with the second challenge comes from the natural representation of the training data, where each training face can be associated with a label (score) distribution given by human raters rather than a single label (average score). This paper, therefore, recasts facial attractiveness computation as a label distribution learning problem. Integrating these two ideas, an end-to-end attractiveness learning framework is established. We also perform feature-level fusion by incorporating the low-level geometric features to further improve the computational performance. Extensive experiments are conducted on a standard benchmark, the SCUT-FBP dataset, where our approach shows significant advantages over the other state-of-the-art work.

AB - Two key challenges lie in the facial attractiveness computation research: the lack of discriminative face representations, and the scarcity of sufficient and complete training data. Motivated by recent promising work in face recognition using deep neural networks to learn effective features, the first challenge is expected to be addressed from a deep learning point of view. A very deep residual network is utilized to enable automatic learning of hierarchical aesthetics representation. The inspiration to deal with the second challenge comes from the natural representation of the training data, where each training face can be associated with a label (score) distribution given by human raters rather than a single label (average score). This paper, therefore, recasts facial attractiveness computation as a label distribution learning problem. Integrating these two ideas, an end-to-end attractiveness learning framework is established. We also perform feature-level fusion by incorporating the low-level geometric features to further improve the computational performance. Extensive experiments are conducted on a standard benchmark, the SCUT-FBP dataset, where our approach shows significant advantages over the other state-of-the-art work.

KW - Facial attractiveness computation

KW - SCUT-FBP

KW - deep residual network

KW - feature fusion

KW - label distribution

UR - http://www.scopus.com/inward/record.url?scp=85038352518&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85038352518&partnerID=8YFLogxK

U2 - 10.1109/TMM.2017.2780762

DO - 10.1109/TMM.2017.2780762

M3 - Article

AN - SCOPUS:85038352518

VL - 20

SP - 2196

EP - 2208

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 8

ER -