ProtGPT3, a new open-source family of protein language models, from 112M to 10B parameters.
We're releasing models:
• ProtGPT3-112M, 1.3B, 10B (single-sequence) + the RL-aligned versions to reduce low-complexity generations while preserving diversity.
• ProtGPT3-MSA (112M, homolog-conditioned)

The big finding: a 112M MSA model prompted with as few as 15 homologs outperforms supervised fine-tuning (SFT) of models up to 10B parameters on target family generation — across sequence, structure, AND family-level consistency metrics.