Among several types of parental care behavior, incubation behavior in passerine birds offers an ideal opportunity to study the link between female parental care and male ornamentation, because males generally lack an incubation patch, and thus rarely incubate. Although preceding studies have focused mainly on on-bout duration (or its total amount, i.e., nest attentiveness), it has recently been established that off-bout durations, independent of on-bout durations, are also important for embryo development and thus for efficient incubation. Using Barn Swallows Hirundo rustica, we found that the duration of female incubation off-bouts increased with a sexually selected trait, male throat coloration, independent of female nest attentiveness. A longer female off-bout was positively correlated with the incubation period, indicating that colorful males had reproductive disadvantage because of their mates’ inefficient incubation. Together with a previous study in which females demonstrated a higher amount of incubation when their mates had large white tail spots, another sexually selected trait, our findings indicated that the different aspects of parental care are differently related to male ornaments. Multiple aspects of parental care should be considered when examining the reproductive (dis)advantage of male ornamentation during parental care.