Fallow deer meat (venison) is a new product acquired from farm-raised and wild animals. Nowadays, people are more concerned about their health, and therefore, they search for high quality, “healthy” products. Farming of fallow deer is ecological and friendly to the environment. Animals are kept in pasture conditions which resemble their natural environment. Venison is considered healthy meat, low in fat and cholesterol, and high in protein. The aim of this review was to gather and discuss the available literature on factors influencing the quality of venison such as sex, age, slaughter method and housing system, feeding, hanging method, animal condition, muscle type, and ageing of meat, considering both farm-raised and wild fallow deer.