Pretraining Objective Shapes Cross-Category Generalization in Affective Image Prediction: A Geometric Comparison of Vision Transformer Encoders
Shohei Tsuchimoto, Yuka O. Okazaki, Kenichi Yuasa, Sakura Nishijima, Mebuki Izumiya, Makoto Hagihara, Ryo Fujihira, Keiichi Kitajo
This paper compares how different pretraining objectives affect the generalization of Vision Transformers in affective image prediction, finding that contrastive learning outperforms classification pretraining in cross-category generalization.
bioRxiv · May 13, 2026 · PreprintNeuroscience