Teaching Applied Research Methods at Oregon State University through Collaboration with Corvallis Community Outreach Inc. Professor Dwaine Plaza School of Public Policy/ Department of Sociology NASPAA Conference October 19-22 2011 Kansas City Missouri Presentation Overview Overview of the Applied Research Methods Class Introduction to Community Outreach Inc partnership A discussion of the various methods of data collection An overview of the logistical lessons learned working with a community partner An examination of the pedagogical benefits of applied research methods for students Conclusions 1
Applied Research Methods Course Overview This course will explore how social science research methods can be used for effective problem solving and informed social policy development. This term we will be carrying out a research project with Community Outreach Inc. in Corvallis. Using both quantitative and qualitative research methods we will collect primary data and we will also do some comparison with secondary data that has been collected by others. The course is organized around five modes of learning: lectures, presentations, primary data collection, practical field exercises, and small group discussions. The lectures will provide an introduction to the theoretical underpinnings of quantitative and qualitative research methods while the practical data collection of the course will give students experience in understanding how consultants work with clients to understand problems. Attention is paid to the different kinds of data that result from quantitative and qualitative methods, leading to an emphasis on selecting methods that match the researchers' and clients larger purposes. At the end of the course, you should be able to design a client-focused research project using multiple methods and apply those skills to real life situations. Student Learning Outcomes for the Applied Research Methods Class a) To comprehend and then be able to carry out an annotated review of the literature. b) To know how applied researchers integrate theory, research, and practice. c) To comprehend and then be able to apply both quantitative and qualitative research methods for carrying out a research project. d) To be able to construct and then implement a survey. e) To be able to comprehend and then carry out interviews and focus group meetings. f) To be able to synthesis and present qualitative and quantitative research findings to a client through multiple media. 2
Student Requirements for Applied Research Methods Development of a statement of work Development of an on-line survey Participation in Focus Group/ Interviews Annotated Literature Review Class Participation Collaborative Research Project Threaded Discussions Ethics Certification Public Presentation of Research Findings 10 percent 10 percent 10 percent 20 percent 10 percent 20 percent 5 percent 5 percent 10 percent Course Text Book for Applied Research Methods Gray, David (2009) Doing Research in the Real World. California: SAGE Publications. 3
Logistical Hurdles Needed to be Overcome by the Faculty Member Need to find a community partner who can accommodate the class size (n=31). Community partner needs to be amicable to having students examine the organization and ultimately making recommendations. The partner has to be transparent in terms of giving access to clients, workers and community stakeholders who work with them (Other NGOs). The community partner cannot be afraid of what others might say about them. Community Partners need to allow students to gain behind the scenes access to their previous consultants reports, strategic plans, press coverage etc.. Background 9 Weeks 1 Class An opportunity to strengthen Community Outreach 4
Background to Community Partner Community Outreach Inc. has been providing for the basic human needs of the mid-willamette Valley's homeless and poor since 1971- stabilizing those in crisis, feeding the hungry, housing the homeless, healing the sick, and counseling the mentally ill and substance addicted. Community Outreach offers an emergency shelter program in Corvallis for up to 7 days for homeless men, women, and families. The shelter program is designed to meet two basic goals: to provide a safety net shelter and basic needs to the homeless as a first step in getting off of the streets, and to provide concentrated, temporary assistance to help make a permanent transition from homelessness to stability. Community Outreach Inc. Corvallis Oregon 5
Research Questions What does the Corvallis community know about what Community Outreach, Inc. does? How do the clients at Community Outreach, Inc. use the services? How can Community Outreach, Inc. form better partnerships with other organizations? How can Community Outreach, Inc. do better as an organization in Corvallis and the county? How can the Corvallis community learn more about Community Outreach, Inc.? What are some best practices in the existing literature? Timeline for Applied Research Methods Class 6
Levels of Data Analysis & Methods Used for Research Literature/ Media Community Clients Staff Compiling the Literature Review For each of the service areas at Community Outreach (Such as Housing, Mental Health, Therapeutic Child Care, Food, etc.) the students looked for articles that would: 1. Describe best practices, marketing, outreach, and demographic trends 2. Validate existing approaches, programs, and services at Community Outreach 3. Help Community Outreach brainstorm and develop new or improved services The students provided Community Outreach with an annotated bibliography for each of these service areas. 7
A Content Analysis of the Media coverage The students worked as a team to examine the media footprint of Community Outreach. Using a content analyis method the students were very concerned in understanding how the Benton County community and Oregon in general perceived the organization. Themes and trends in print media Themes and trends in online media Examination of internet accessibility to Community Outreach Focus Group Data Collection Method How is Community Outreach perceived by their client base? How effective they are in providing essential services to their clients? Focus group method obtains an accurate portrayal of attitudes and beliefs of the clients. Critical opportunity for the clients to share their personal experiences in a confidential manner. 8
Immersion Method for Data Collection A very small group of students was interested and had enough courage to do an immersion into the world of homeless men/women in Corvallis. This group spent a few weeks observing and interacting with the homeless who did not use the service of COI. Purpose Participant observation Central Park Six weeks Sampling Methodology The students wanted to find out what people in Corvallis knew and felt about the services offered by COI. To find out about this they conducted a paper and pencil survey of the city. They soon discovered how difficult it was to get respondents to complete surveys. What we proposed What was practical Interview every 5th house 3 individuals per ward Interview target of 20 per student Attempt to integrate apartment complexes Stratification of sample Limitations on time and feasibility led to constraints on initial parameters First 5 surveys done as prescribed previously Following 15 surveys collected within ward businesses and other convenient locations 9
Survey Sampling Methodology Measurement Instrument In person interviews Units of Analysis Corvallis Households Operational Sample Frame Corvallis Wards Sample Size: 249 Interviews & Online Survey of Staff at COI The students were interested in understanding what the staff felt about their jobs and the services they provided at Community Outreach Inc. A literature review was carried out which led to an online anonymous survey and then volunteers came forward to participate in confidential one to one interviews. Literature Review Job satisfaction indices Volunteer satisfaction indices Organizational commitment Human resources assessments Internet Questionnaire 17 Staff Members Staff Interviews 4 Staff Members 6 supervisors, 11 non-supervisors All service areas represented 2 Interns 2 Volunteers 10
Interviews with Community Partners Students were responsible for carrying out interviews with organizations and individuals who work or have interacted with Community Outreach on a regular basis. These community partners included: the Mayor, the police chief, other nonprofit NGOs, Veterans Administration, hospital officials, etc (22 in all).. The hope was that the students would find out what the community thought about the services of COI. Publ ic Offic ials 22 Partn ers Nonprofit Organiza tions Pedagogical Lessons Learned Students This practical research and data collection exposes students to the real difficulties of collecting primary data. They get to see how difficult it is to create a dataset and what to do with raw data collected. This ultimately prepares them for their MPP thesis and also for the real world of consulting. Students learned how difficult it is to work on a multiple layered teams to meet set deadlines. Some students took on significant leadership roles within the class and this showed them just how difficult it can be to motivate and keep a group all moving in the same direction for ten weeks. 11
Pedagogical Lessons Learned by the Students Students had to carry out practical data collection using existing methods focus group, interviews, survey data collection, immersion (participant observation). Students had to learn how to use the literature review to formulate survey pilot test the survey implement the survey code the data and then analyze the findings. Students feel a sense of significant accomplishment after the public presentation and the client indicates their approval with the outcome Pedagogical Lessons Learned as a Faculty Member Its very important to deal upfront with the stereotypes and misconceptions about the minority group the students will be working with lectures, group exercises (on privilege) videos, guest speakers. Its very important to alleviate students fears of the other in terms of the clients they may be interviewing or interacting with. The instructor has to be fully committed to the project. This means going to the focus group meetings, going out into the field with the students collecting data (surveys, immersion etc. ), rehearsals, being available throughout the course to process with the students. The instructor has to become familiar with the strengths and weaknesses of all the students. This then allows for harnessing of their energy and leadership ability in all kinds of ways. The Instructor has to work within the group to make sure that tensions are defused. 12
Pedagogical Lessons Learned as a Faculty Member Need to use a communication medium that connects everyone in real time Blackboard discussion board posts Facebook social media. Students need IRB certification and training and this type of project gives them a practical application of the process Students can get very excited about carrying out a meaningful and practical research project if they know what they produce will be taken seriously. Giving the students an orientation to the community organization through a visit to the site and also meeting with the directors of the center is very important to contextualize the project. Conclusions and Final Lessons Learned The community partner benefits from being studied by the students who are committed to making recommendations that are sustainable and meaningful. Students have to be willing to work hard for a sustained ten week period. Faculty member has to be willing to take on a teaching load that is very turbulent and not a linear process. The faculty member has to act as the go between the students and the community partner. This means frequent visits and constant communication with the community partner. The faculty member has to be aware of the strengths and human resources/ skills capacity among the students. Need to put into play social media and other technology to keep the group on track This is a meaningful way for MPP students to transition into their final year they will have experienced an applied research methods scenario. 13
Questions THANK YOU 14