The Social Research and Demonstration Corporation just released a new report about “motivational interviewing” for welfare recipients. The link to the full report is here, and the link to the executive summary is here.
Authored by Reuben Ford, Jenn Dixon, Shek-wai Hui, Isaac Kwakye and Danielle Patry, the study reports on a recent randomized controlled trial done on long-term recipients of social assistance in British Columbia. The research took place between September 2012 and March 2013. There were a total of 154 research participants; 76 of the individuals were in the “treatment group,” while 78 were in the “control group.”
Earlier this year, I was invited to be a discussant on the study at the Annual Conference of the Canadian Economics Association. Here are 10 things I think you should know about this report:
- The “intervention” being studied was the Motivational Interviewing (MI) technique. MI is “a method of interacting with clients who are ambivalent about making change in their lives.” It has “wide application in behavioural change: addictions, health, behaviour wellness, chronic disease management, and most recently in the employment field.” For more on MI, see this web link.
- Research participants were on welfare upon enrollment in the study. By “welfare,” I mean last-resort social assistance. For most eligible residents in British Columbia, this is known as “income assistance (IA).” Upon being recruited for the study, most research participants were receiving approximately $1,000 per month to live on; this amount included “health supplements,” as well as “general supplements” for such things as transportation. Research participants had also been identified by British Colombia’s Ministry of Social Development as being “employment obligated,” which means they were expected to be actively searching for paid employment. (For more on benefit levels available under social assistance programs administered by provincial and territorial governments, see this 2013 report. Readers should be mindful that, across Canada, there are separate social assistance systems for First Nations; a 2007 evaluation of the federally-administered “income assistance” program for First Nations can be found here.)
- Research participants had been on welfare for at least one year at the study’s outset. The rationale behind this recruitment strategy was to identify social assistance recipients who were most likely to be facing motivational challenges.
- Most of the research participants reported health problems. According to the report, more than 70% of study participants “reported activity limitations that affected their ability to work.” For example, just one-quarter of members of the treatment group reported that “their health was ‘good’ or ‘very good…’” With this in mind, it’s not entirely clear to me why British Columbia’s Ministry of Social Development considers these individuals to be “employment obligated.”
- The “intervention” was provided by welfare officials (specifically, by Employment and Assistance Workers and case managers). Remarkably, each staff person received fewer than 70 hours of training before delivering the intervention (specifically, 60 hours of training in how to deliver MI and then nine hours of coaching as the intervention was being delivered). The training of staff was provided by Empowering Change Inc., a Canadian-based organization that (perhaps not surprisingly) specializes in training people on how to deliver MI. Members of the study’s control group “received the range of services and treatment which they would typically receive” as long-term recipients of social assistance.
- The results of this study suggest that Motivational Interviewing can be effective. By the end of the three-month study period, the difference in the respective employment rates of the treatment group and the control group was statistically significant. The precise size of the difference in the employment rate between the two groups was 7.8%. (For the research wonks: the level of statistical significance attained on this was 5%. Put differently, the likelihood that this finding occurred by chance is less than 5%.) This finding raises a question for me though: what would outcomes have been for members of the treatment group after 12 and 24 months respectively? Three months is not a long time.
- Fewer than half of the members of the study’s treatment group actually took in even one (hour-long) Motivational Interviewing session. Just 36 of the members of the study’s 76 treatment group members chose to go through with a Motivational Interview. And only about one in five members of the treatment group took in more than one such session. Ergo: the success of the treatment group as a whole appears to have been carried by a minority of its membership. This suggests to me that the success of the treatment group is actually being understated; had every single member of the treatment group actually received the intervention (and not merely been offered it) I suspect the treatment group as a whole would have performed even more favourably compared with the control group.
- The research was funded by Employment and Social Development Canada (ESDC). On the one hand, I suspect that most readers will not be surprised to learn that the federal government wants most people on welfare to ‘look harder’ for work. On the other hand, it may come as a surprise to some readers (especially those who remember the Harper government’s decision to end the mandatory long-form census) that the federal government has funded research looking at what is effective in this regard.
- The study took place at a time when, throughout Canada, there were considerably more unemployed persons than job vacancies. Across Canada there are roughly six unemployed persons for every job vacancy (a ratio that varies considerably across provinces). This raises an important question: in a country where the number of unemployed persons vastly outnumbers job vacancies, why does the federal government want to study the feasibility of long-term recipients of social assistance (many of whom have serious health problems) trying harder to find low-wage work? Some readers will remember a Toronto study conducted in 2001 that followed more than 800 individuals who had left welfare within the previous year. Fewer than half of those individuals “felt things had improved financially” for them since leaving social assistance; on the whole, after leaving social assistance, individuals “reported incomes at approximately 92% of Statistics Canada’s 2001 Low Income Cut-Offs.” (Further analysis of this Toronto study can be found here.)
- This study took place at the same time that the federal government is aggressively bringing in more temporary migrant workers. As Jim Stanford has recently noted: “Migrant employment [in Canada] rose 140 per cent between 2005 and 2012.” Further, “[o]ne in every five net new paid jobs created in Canada between 2007 and 2012 was filled by a migrant worker.” This raises yet another question for me: why is the federal government interested in exploring how to encourage more welfare recipients to look harder for low-wage jobs while (simultaneously) ‘importing’ competition for many of those same jobs at an aggressive pace? Don’t the two objectives work at cross purposes?
This post is part of our Friday "Ask the Hub" blog series. Have a homeless-related question you want answered? E-mail us at email@example.com and we will provide a research-based answer.
This post was republished with permission from The Progressive Economics Forum.