Aging manifests with architectural alteration and functional decline of multiple organs throughout an organism. In mammals, aged skin is accompanied by a marked reduction in hair cycling and appearance of bald patches, leading researchers to propose that hair follicle stem cells (HFSCs) are either lost, differentiate, or change to an epidermal fate during aging. Here, we employed single-cell RNA-sequencing to interrogate aging-related changes in the HFSCs. Surprisingly, although numbers declined, aging HFSCs were present, maintained their identity, and showed no overt signs of shifting to an epidermal fate. However, they did exhibit prevalent transcriptional changes particularly in extracellular matrix genes, and this was accompanied by profound structural perturbations in the aging SC niche. Moreover, marked age-related changes occurred in many nonepithelial cell types, including resident immune cells, sensory neurons, and arrector pili muscles. Each of these SC niche components has been shown to influence HF regeneration. When we performed skin injuries that are known to mobilize young HFSCs to exit their niche and regenerate HFs, we discovered that aged skin is defective at doing so. Interestingly, however, in transplantation assays in vivo, aged HFSCs regenerated HFs when supported with young dermis, while young HFSCs failed to regenerate HFs when combined with aged dermis. Together, our findings highlight the importance of SC:niche interactions and favor a model where youthfulness of the niche microenvironment plays a dominant role in dictating the properties of its SCs and tissue health and fitness.