Many insect herbivores can only use hosts during a specific phenological stage, i.e., a phenological window. Previous studies have primarily examined the effects of these windows on insect herbivores, but relatively little is known about the mechanisms controlling the phenological windows. In most gall insect systems, phenological windows have been attributed to the short duration of physiologically active plant tissues that induce gall formation (reactive plant tissue). In the fruit gall midge, Asphondylia aucubae Yukawa and Ohsaki, and the host plant (i.e., Aucuba japonica) system, the disappearance of reactive plant tissue closes the phenological window, but its presence does not define the opening of the window. The hard endocarp of the fruit covers most potential oviposition sites just before the midge emergence season, but decreases in proportional cover during the emergence season. We experimentally manipulated the timing of oviposition relative to fruit development. Midges that emerged earliest and attacked fruits during their earliest developmental stages were unable to oviposit because of intact, hard endocarps, whereas their counterparts that emerged later could oviposit more readily through cracks in the endocarp. We noted possible oviposition avoidance behavior and the necessity of more frequent (repeated) ovipositor insertions to intensively stimulate the decreased reactive tissues during the latter half of the emergence season. Overall, our results indicated that the fragmentation of the defensive, hard endocarp of the host plant defines the opening of the phenological window in this plant-herbivore system.