Paired-unit activation steering for context-aware protein design
Abstract
Activation steering in protein language models enables controllable sequence generation without changing the model weights. However, existing methods typically construct steering vectors from global differences between property-positive and property-negative protein populations, overlooking how property-improving directions vary across different protein sequence backgrounds. To address this, we propose \textit{Paired-Unit local steering of embeddings (PULSE)}, which matches positive- and negative-property proteins by maximizing their representation cosine similarity and constructs steering vectors by aggregating similarity-weighted, unit-normalized differences between matched pairs. Across three protein optimization objectives--solubility, immunogenicity, and toxicity--PULSE consistently outperforms global population-centroid steering in both final predicted property scores and optimization success rates. Further analysis reveals that conventional static steering-vector diagnostics cannot adequately explain optimization performance. To characterize steering reliability during iterative sequence editing, we introduce \textit{Local Directional Support (LDS)}, which measures how well successive representation changes align with property-improving directions from similar protein backgrounds. We show that LDS captures differences in trajectory reliability and enables predictor-free candidate prioritization, enriching successful protein designs without requiring property predictions during candidate selection. Together, these findings demonstrate the importance of context-aware steering and trajectory-level evaluation for controllable protein sequence optimization.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Adapting protein language models for structure-conditioned design
Jeffrey A. Ruffolo, Aadyot Bhatnagar, … Ali Madani·bioRxiv·Aug 3, 2024
- Protein Language Models: Learning From Evolution, Designing Beyond It
Maurice Brenner, Julius Schlensok, … Michael Heinzinger·bioRxiv·Sep 24, 2026
- Advancing Protein Design via Multi-Agent Reinforcement Learning with Pareto-Based Collaborative Optimization
Mingming Zhu, Jiahua Rao, … Yuedong Yang·Proceedings of the AAAI Conference on Artificial IntelligencePeer-reviewed·Mar 14, 2026
- ST-PARM: Pareto-Complete Inference-Time Alignment for Multi-Objective Protein Design
- Identifying promising sequences for protein engineering using a deep Transformer Protein Language Model
T. S. Frisby, C. J. Langmead·Proteins: Structure, Function, and BioinformaticsPeer-reviewed·Jun 20, 2023
- Functional alignment of protein language models via reinforcement learning
Nathaniel Blalock, Srinath Seshadri, … Philip A. Romero·Nature CommunicationsPeer-reviewed·Sep 12, 2026