A fossil rhinocerotid tooth from the Yage Formation (Middle to Late Pleistocene), Yage in Shizuoka Prefecture, is described. The present specimen shows the following characteristics of the second lower incisor: tusk-like shape, enamel on the labial side, a teardrop-shaped cross section of the tooth crown, and an oval cross section of the root. The specimen is similar to the genus Rhinoceros in having a large and robust shape. However, owing to a lack of other elements, generic and specific identification are not possible. Previously, several large mammal fossils had been reported from the Yage area, but there were no rhinocerotids among them. Thus, this report is the first record of a rhinocerotid from the area. The Yage specimen suggests rhinocerotids were widely distributed during the Pleistocene of Far East Asia.