The objective of our work was to verify the value of the vegetation corridor in the conservation of small mammals in fragmented tropical landscapes, using a model system in the southeastern Minas Gerais. We evaluated and compared the composition and structure of small mammals in a vegetation corridor, forest fragments and a coffee matrix. A total of 15 species were recorded, and the highest species richness was observed in the vegetation corridor (13 species), followed by the forest fragments (10) and the coffee matrix (6). The absolute abundance was similar between the vegetation corridor and fragments (F = 22.94; p = 0.064), and the greatest differences occurred between the vegetation corridor and the matrix (F = 22.94; p = 0.001) and the forest fragments and the matrix (F = 22.94; p = 0.007). Six species showed significant habitat preference possibly related to the sensitivity of the species to the forest disturbance. Marmosops incanus was the species most sensitive to disturbance; Akodon montensis, Cerradomys subflavus, Gracilinanus microtarsus and Rhipidomys sp. displayed little sensitivity to disturbance, with a high relative abundance in the vegetation corridor. Calomys sp. was the species least affected by habitat disturbance, displaying a high relative abundance in the coffee matrix. Although the vegetation corridors are narrow (4 m width), our results support the hypothesis in which they work as a forest extension, share most species with the forest fragment and support species richness and abundance closer to forest fragments than to the coffee matrix. Our work highlights the importance and cost-effectiveness of these corridors to biodiversity management in the fragmented Atlantic Forest landscapes and at the regional level.