Biological Continued Pretraining Reshapes the Capability Profile of a Foundation Model Without Catastrophic Forgetting
This paper re-analyzes a foundation model's checkpoints to show biological continued pretraining improves general knowledge, code generation, and reasoning without catastrophic forgetting, but subsequent fine-tuning reverses these gains.