SynFER: Towards Boosting Facial Expression Recognition with Synthesis Data
Facial Experssion Recognition;Synthesis Data
I have read and agree with the venue's withdrawal policy on behalf of myself and my co-authors.
We propose SynFER, a synthetic data framework to boost facial expression recognition.
@misc{
he2024synfer,
title={Syn{FER}: Towards Boosting Facial Expression Recognition with Synthesis Data},
author={Xilin He and Cheng Luo and Xiaole Xian and Bing Li and Siyang Song and Muhammad Haris Khan and Weicheng Xie and Zongyuan Ge and Linlin Shen},
year={2024},
url={https://openreview.net/forum?id=H3u2vA0bdi}
}
Facial expression datasets remain limited in scale due to privacy concerns, the subjectivity of annotations, and the labor-intensive nature of data collection. This limitation poses a significant challenge for developing modern deep learning-based facial expression analysis models, particularly foundation models, that rely on large-scale data for optimal performance. To tackle the overarching and complex challenge, we introduce SynFER (Synthesis of Facial Expressions with Refined Control), a novel framework for synthesizing facial expression image data based on high-level textual descriptions as well as more fine-grained and precise control through facial action units.
To ensure the quality and reliability of the synthetic data, we propose a semantic guidance technique to steer the generation process and a pseudo-label generator to help rectify the facial expression labels for the synthetic images.
To demonstrate the generation fidelity and the effectiveness of the synthetic data from SynFER, we conduct extensive experiments on representation learning using both synthetic data and real-world data. Experiment results validate the efficacy of the proposed approach and the synthetic data. 
Notably, our approach achieves a 67.23\% classification accuracy on AffectNet when training solely with synthetic data equivalent to the AffectNet training set size, which increases to 69.84\% when scaling up to five times the original size.
Our code will be made publicly available.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
~Xilin_He1 ~Cheng_Luo4 ~Xiaole_Xian1 ~Bing_Li13 ~Siyang_Song1 ~Muhammad_Haris_Khan3 ~Weicheng_Xie1 ~Zongyuan_Ge1 ~Linlin_Shen1
Xilin He Cheng Luo Xiaole Xian Bing Li Siyang Song Muhammad Haris Khan Weicheng Xie Zongyuan Ge Linlin Shen
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Facial Experssion Recognition Synthesis Data
I certify that there is no acknowledgement section in this submission for double blind review.
he|synfer_towards_boosting_facial_expression_recognition_with_synthesis_data
/pdf/c5e2cca9b11d213d9838fff124b8d73724c97958.pdf
unsupervised, self-supervised, semi-supervised, and supervised representation learning
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
SynFER: Towards Boosting Facial Expression Recognition with Synthesis Data
ICLR 2025 Conference Withdrawn Submission
ICLR.cc/2025/Conference/Withdrawn_Submission