Invasion and extinction dynamics of mating types under facultative sexual reproduction

In sexually reproducing isogamous species, syngamy between gametes is generally not indiscriminate, but rather restricted to occurring between complementary self-incompatible mating types. A longstanding question regards the evolutionary pressures that control the number of mating types observed in natural populations, which ranges from two to many thousands. Here, we describe a population genetic null model of this reproductive system and derive expressions for the stationary probability distribution of the number of mating types, the establishment probability of a newly arising mating type and the mean time to extinction of a resident type. Our results yield that the average rate of sexual reproduction in a population correlates positively with the expected number of mating types observed. We further show that the low number of mating types predicted in the rare-sex regime is primarily driven by low invasion probabilities of new mating type alleles, with established resident alleles being very stable over long evolutionary periods. Moreover, our model naturally exhibits varying selection strength dependent on the number of present mating types. This results in higher extinction and lower invasion rates for an increasing number of residents.