The Yabello rangeland is a semi-arid area in Borana, Ethiopia that is facing great degradation challenges. Increasing infestation of vegetation cover, over grazing and high seasonal variation have significantly affected the herbage composition and biomass in the Yabello rangeland. This study focused on assessing the effect of vegetation cover, grazing and season on both herbage composition and biomass in the Yabello rangeland. An experiment was conducted using randomized plots of 1 m × 1 m. Sites were selected based on vegetation cover type and grazing variation, and seasonal impacts were also assessed. Data on herbage composition, height and mass with respect to those parameters were analyzed using SAS statistical software version 9.1 (SAS Institute, 2001) and Microsoft Excel. A total of 26 grass species were recorded and Chloris roxburghiana Chrysopogon aucheri and Chrysopogon aucheri grass species showed the highest average single species cover height and biomass production, for all the sites among all parameters. As a result, those grass species are highly recommended for the rehabilitation of degraded rangeland in the study area. This study also showed that vegetation cover type grazing and seasonal variation were the key factors in determining herbage species composition, height and biomass production. Finally, we recommended that sustainable management which controls bush vegetation cover and balances grazing levels is essential for sustainable herbage production and biodiversity conservation in the area.