A protein language model for MSAs. Likely relevant for the 'trunk' part of the AlphaFold2 model. Basically just an axial transformer with tied row attention, but they see a rather dramatic jump in performance.