Theory predicts that habitat generalist species are excluded by specialist species in optimal habitat for specialists, and empirical data commonly show a shift from specialist- to generalist-dominated communities following disturbance. We investigated co-occurrence patterns of habitat generalist and specialist terrestrial rodents at two spatial scales in the Atlantic Forest, aiming at evaluating the following hypotheses: 1) within-patch spatial niche partitioning promotes coexistence of generalists and specialists, leading to checkerboard presence-absence patterns at small (within-patch) rather than large (among-patch) scales; and 2) the decrease in abundance of specialists due to habitat loss promotes a competitive release of generalists, leading to negative covariance in abundance between generalists and specialists among patches. Drawing on a large data set including 363 sites within three patches in continuous forest, and 45 patches within three landscapes, we used C-scores based on presence-absence and abundance data to evaluate spatial segregation. We found consistent segregation between specialists and generalists at the within-patch rather than among-patch scale, but no consistent negative covariance in abundance between generalists and specialists among patches (as covarying species pairs varied across landscapes). Our findings suggest that spatial patterns caused by competition are scale-dependent, and coexistence of generalists and specialists is promoted by within-patch spatial niche partitioning. However, the influence of competitive release on the proliferation of generalists may be outweighed by other factors in fragmented landscapes.