The bitterling Acheilognathus melanogaster is a critically endangered primary freshwater fish endemic to the Pacific side of eastern Japan. To elucidate A. melanogaster genetic structure, we investigated phylogeography in nine populations, using gene sequences of mitochondrial Cytochrome b (Cytb), as well as nuclear Rhodopsin (Rho) and glycosyltransferase (Glyt). We found four Cytb-based geographical clusters unevenly divided between the northern and southern regions, with smaller groups in the south. Of the nuclear genes, Glyt did not show geographical differentiation, whereas Rho formed two clusters: one widely occurring and another restricted to central regions. Genetic diversity was generally higher in southern than in northern populations. Our results suggest that conservation of southern local populations is particularly important in maintaining the genetic diversity of this endangered fish.