bioRxivBioinformaticsPreprint
UniFacePoint-FM: A Foundation Model for Generalizable 3D Facial Representation Learning and Multi-Attribute Prediction
Abstract
The human face is a rich medium for biometric, behavioral, and clinical information. However, 2D facial images based technologies lack critical geometric details and are susceptible to pose and illumination interference, while 3D facial deep learning frameworks are hindered by complex annotation, preprocessing, and task-specific designs with poor cross-domain generalization. To address these challenges, we propose UniFacePoint-FM, a 3D facial foundation model built on a self-supervised Point-MAE framework, tailored for high-fidelity point cloud representation learning. The model was pretrained on a self-constructed dataset of high-resolution 3D facial scans, followed by supervised fine-tuning and comprehensive evaluation across three independent datasets for diverse downstream tasks. Experimental results demonstrate that UniFacePoint-FM is both pretraining-efficient and highly generalizable: it achieves state-of-the-art performance on gender classification, age regression, and BMI prediction, and matches the accuracy of the ResMLP model (while outperforming other baselines) in facial expression recognition. Notably, by learning high-quality, fine-grained representations directly from raw point clouds, UniFacePoint-FM delivers robust generalization and transferability across tasks, datasets, and even different face scanning platforms. Overall, our work establishes an effective foundation model paradigm for 3D facial analysis, with promising implications for biometric security, health monitoring, and advanced human-computer interaction systems.
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A Method for the Automatic Normalization and 3D Facial Mesh Extraction from Head Magnetic Resonance Imaging
Xavier Sevillano, David Ureña, … Neus Martínez‐Abadías·bioRxiv·Jul 20, 2020
- Signatures of personality on dense 3D facial images
Sile Hu, Jieyi Xiong, … Kun Tang·bioRxiv·May 30, 2016
- Automated 3D Landmarking of the Skull: A Novel Approach for Craniofacial Analysis
Franziska Wilke, Harold S. Matthews, … Susan Walsh·bioRxiv·Feb 9, 2024
- Efficient task generalization and humanlike face perception in models that learn to discriminate face geometry
Seojin Lee, Josh Ying, … Elias B. Issa·bioRxiv·Feb 3, 2026
- PrimateFace: A Machine Learning Resource for Automated Face Analysis in Human and Non-human Primates
Felipe Parodi, Jordan Matelsky, … Konrad Paul Kording·bioRxiv·Aug 12, 2025
- A general method for bootstrapping dense 3D segmentations from sparse 2D annotations
Vijay Venu Thiyagarajan, Arlo Sheridan, … Uri Manor·bioRxiv·Jun 14, 2024