Early hystricognathous rodents from Africa are primarily documented by two basal and extinct groups, the paraphyletic “Phiomyidae” and the Gaudeamuridae, which were particularly well diversified through the late Eocene and the early Oligocene. However, in the absence of a comprehensive late Oligocene fossil record, the evolutionary history of African hystricognathous rodents during the end of the Paleogene is unclear. Continuing field efforts in the Lokichar Basin of Kenya (western Turkana Basin) have led to the discovery of dental remains of a ‘phiomyid’ from the Lokone site LOK 13. The dental pattern of this rodent is unusual among ‘phiomyids,’ which led us to propose here a new taxon: Turkanamys hexalophus, gen. et sp. nov. Turkanamys shares a similar dental bauplan with early Afro-Asian hystricognaths (early ‘phiomyids’ and ‘baluchimyines’), and as such appears evolutionarily conservative with respect to some Oligocene and all the Miocene hystricognaths. Conversely, Turkanamys is also highly autapomorphic in developing a hexalophodont pattern on upper molars. The discovery of this peculiar rodent highlights the persistence of this ancestral ‘phiomorph’ group at the end of the Paleogene. Given the great familial diversity of hystricognaths in the early Miocene of East Africa, the virtual absence of their stem representatives in the late Oligocene record of the same province suggests either important taphonomic/sampling biases or a real absence of these families in this province at that time. This would suggest that hystricognathous rodents diversified elsewhere and colonized East Africa by the late Oligocene—early Miocene transition.