About 10% of women of reproductive age are unable to conceive or carry a pregnancy to term. Female factors alone account for at least 35% of all infertility cases and comprise a wide range of causes affecting ovarian development, maturation of oocytes, and fertilization competence, as well as the potential of a fertilized egg for preimplantation development, implantation, and fetal growth. Genetic abnormalities leading to infertility in females comprise large chromosome abnormalities, submicroscopic chromosome deletion and duplications, and DNA sequence variations in the genes that control numerous biological processes implicated in oogenesis, maintenance of ovarian reserve, hormonal signaling, and anatomical and functional development of female reproductive organs. Despite the great number of genes implicated in reproductive physiology by the study of animal models, only a subset of these genes is associated with human infertility. In this review, we mainly focus on genetic alterations identified in humans and summarize recent knowledge on the molecular pathways of oocyte development and maturation, the crucial role of maternal-effect factors during embryogenesis, and genetic conditions associated with ovarian dysgenesis, primary ovarian insufficiency, early embryonic lethality, and infertility.