Loss-functions matter, on optimizing score functions for the estimation of protein models accuracy
Abstract
MotivationMethods for protein structure prediction (PSP) generate multiple alternative structural models (aka decoys). Thus, supervised learning methods for the evaluation and ranking of these models are crucial elements of PSP. Supervised learning involves optimization of loss functions, but their influence on performance is typically overlooked. Here we put the loss functions in the spotlight, and study their effect on prediction performance.\n\nResultsHere we report the performances of three variants of MESHI-score, a supervised learning method for the estimation of model accuracy (EMA). Each variant was trained with a different loss function and showed better performance in different aspects of the EMA problem. Most importantly, better discrimination between models of the same target, is gained by target centered loss functions.\n\nAvailabilityAll data is available at http://meshi1.cs.bgu.ac.il/SidiAndKeasar2018Data_download/. The MESHI-package (version 9.412) is available at https://github.com/meshiprot/meshi/releases).\n\nContactchen.keasar@gmail.com
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Improved protein model quality assessments by changing the target function
Karolis Uziela, David Menéndez Hurtado, … Arne Elofsson·Proteins Structure Function and BioinformaticsPeer-reviewed·Mar 9, 2018
- Hermes: an ensemble machine learning architecture for protein secondary structure prediction
Larry Bliss, Ben Pascoe, Samuel Keir Sheppard·bioRxiv·May 17, 2019
- SEQUENCE VS. STRUCTURE: DELVING DEEP INTO DATA DRIVEN PROTEIN FUNCTION PREDICTION
Xiaochen Tian, Ziyin Wang, … Fajie Yuan·bioRxiv·Apr 2, 2023
- Training data composition affects performance of protein structure analysis algorithms
Alexander Derry, Kristy A. Carpenter, Russ Biagio Altman·bioRxiv·Sep 30, 2021
- RemoteFoldSet: Benchmarking Structural Awareness of Protein Language Models
Zinnia Ma, Neville P. Bethel·bioRxiv·Sep 23, 2025
- So ManyFolds, So Little Time: Efficient Protein Structure Prediction With pLMs and MSAs
Thomas D. Barrett, Amelia Villegas-Morcillo, … Arthur Flajolet·bioRxiv·Oct 15, 2022