During rapid urbanization and industrialization process, non-farm employment of rural laborers has emerged as a prevalent phenomenon in rural areas of China and become an important driving factor for changes in agricultural land use. This article attempts to theoretically analyze the impacts of non-farm employment of rural laborers on agricultural land use based on economic frameworks. As rational agents, farmers aim to maximize their income and follow equilibrium principles when they decide how to allocate their labor forces (or working time) in two departments (farm and non-farm) and how to use their agricultural land with different quality and location. The income earned by non-farm employment is higher, and there exists a comparative advantage between labors, as a result the quantity and quality of labor input in agricultural land use decreases. With the limitation of labor input during agricultural land use decision-making of farm households, on the one hand, land with higher quality is still utilized by farmers. On the other hand, poor quality land will be less well managed and is more likely to be abandoned. Non-farm employment of rural laborers and the rising of opportunity costs will result in abandonment of poor quality land, and great importance should be attached to this by policy makers.