Housing is a key social determinant of health that contributes to the well-documented relationship between socioeconomic status and health. This study explored how individuals with histories of unstable and precarious housing perceive their housing or shelter situations, and the impact of these settings on their health and well-being. Participants were recruited from the Health and Housing in Transition study (HHiT), a longitudinal, multi-city study that tracked the health and housing status of people with unstable housing histories over a 5-year period. For the current study, one-time semi-structured interviews were conducted with a subset of HHiT study participants (n = 64), living in three cities across Canada: Ottawa, Toronto, and Vancouver. The findings from an analysis of the interview transcripts suggested that for many individuals changes in housing status are not associated with significant changes in health due to the poor quality and precarious nature of the housing that was obtained. Whether housed or living in shelters, participants continued to face barriers of poverty, social marginalization, inadequate and unaffordable housing, violence, and lack of access to services to meet their personal needs.