Running head: MULTI-METHOD APPROACHES. Triangulation and Multi-method Approaches. H. Paul LeBlanc III, PhD. Dept. of Communication

Similar documents
Growth of empowerment in career science teachers: Implications for professional development

Calculators in a Middle School Mathematics Classroom: Helpful or Harmful?

HOLISTIC LESSON PLAN Nov. 15, 2010 Course: CHC2D (Grade 10, Academic History)

Last Editorial Change:

A cautionary note is research still caught up in an implementer approach to the teacher?

Practical Research. Planning and Design. Paul D. Leedy. Jeanne Ellis Ormrod. Upper Saddle River, New Jersey Columbus, Ohio

Master s Programme in European Studies

Practices Worthy of Attention Step Up to High School Chicago Public Schools Chicago, Illinois

TU-E2090 Research Assignment in Operations Management and Services

CHAPTER 4: RESEARCH DESIGN AND METHODOLOGY

The Indices Investigations Teacher s Notes

Karla Brooks Baehr, Ed.D. Senior Advisor and Consultant The District Management Council

Just Because You Can t Count It Doesn t Mean It Doesn t Count: Doing Good Research with Qualitative Data

10.2. Behavior models

Refer to the MAP website ( for specific textbook and lab kit requirements.

Further, Robert W. Lissitz, University of Maryland Huynh Huynh, University of South Carolina ADEQUATE YEARLY PROGRESS

DT + Self-Awareness. PDXScholar

This Performance Standards include four major components. They are

The SREB Leadership Initiative and its

The term globalization is very popular nowadays >>>CLICK HERE<<<

A GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING

Unpacking a Standard: Making Dinner with Student Differences in Mind

Providing student writers with pre-text feedback

Pedagogical Content Knowledge for Teaching Primary Mathematics: A Case Study of Two Teachers

Planning a Dissertation/ Project

How People Learn Physics

School Size and the Quality of Teaching and Learning

GRADUATE CURRICULUM REVIEW REPORT

Assessment and Evaluation

PATTERNS OF ADMINISTRATION DEPARTMENT OF BIOMEDICAL EDUCATION & ANATOMY THE OHIO STATE UNIVERSITY

IDS 240 Interdisciplinary Research Methods

Using a Multiple Case Studies Design to Investigate the Information-Seeking Behavior of Arts Administrators

Inquiry Learning Methodologies and the Disposition to Energy Systems Problem Solving

Ph.D. in Behavior Analysis Ph.d. i atferdsanalyse

Texas Woman s University Libraries

SHARLENE NAGY HESSE-BIBER

General syllabus for third-cycle courses and study programmes in

Introduction. 1. Evidence-informed teaching Prelude

Evidence for Reliability, Validity and Learning Effectiveness

Interpreting Graphs Middle School Science

Improving the impact of development projects in Sub-Saharan Africa through increased UK/Brazil cooperation and partnerships Held in Brasilia

Why Do They Fail? An Experimental Assessment of the Role of Reputation and Effort in the Public s Response to Foreign Policy Failures.

b) Allegation means information in any form forwarded to a Dean relating to possible Misconduct in Scholarly Activity.

Research as Design-Design as Research

The Common European Framework of Reference for Languages p. 58 to p. 82

Preparation for Leading a Small Group

1GOOD LEADERSHIP IS IMPORTANT. Principal Effectiveness and Leadership in an Era of Accountability: What Research Says

B.A., Amherst College, Women s and Gender Studies, Magna Cum Laude (2001)

Author's response to reviews

Graduate Program in Education

POLITICAL SCIENCE 315 INTERNATIONAL RELATIONS

2017- Part-Time Professor Department of Political Science, Concordia University, Montréal, Canada

Introduction. Background. Social Work in Europe. Volume 5 Number 3

UNIVERSITY OF THESSALY DEPARTMENT OF EARLY CHILDHOOD EDUCATION POSTGRADUATE STUDIES INFORMATION GUIDE

College of Business University of South Florida St. Petersburg Governance Document As Amended by the College Faculty on February 10, 2014

Approaches to control phenomena handout Obligatory control and morphological case: Icelandic and Basque

USING SOFT SYSTEMS METHODOLOGY TO ANALYZE QUALITY OF LIFE AND CONTINUOUS URBAN DEVELOPMENT 1

URBANIZATION & COMMUNITY Sociology 420 M/W 10:00 a.m. 11:50 a.m. SRTC 162

What is Thinking (Cognition)?

Utilizing Soft System Methodology to Increase Productivity of Shell Fabrication Sushant Sudheer Takekar 1 Dr. D.N. Raut 2

Blended Learning Module Design Template

Room: Office Hours: T 9:00-12:00. Seminar: Comparative Qualitative and Mixed Methods

General study plan for third-cycle programmes in Sociology

Rottenberg, Annette. Elements of Argument: A Text and Reader, 7 th edition Boston: Bedford/St. Martin s, pages.

Using portfolio assessment as an innovation to assess problembased learning in Hong Kong schools

Academic Employment Emporia State University, Associate Professor with tenure, 2012 present Emporia State University, Assistant Professor,

Concept Acquisition Without Representation William Dylan Sabo

LEAD 612 Advanced Qualitative Research Fall 2015 Dr. Lea Hubbard Camino Hall 101A

E-Portfolio: Opportunities and Challenges in Higher Education

MIAO WANG. Articles in Refereed Journals and Book Volumes. Department of Economics Marquette University 606 N. 13 th Street Milwaukee, WI 53233

Executive Summary: Tutor-facilitated Digital Literacy Acquisition

Evidence-based Practice: A Workshop for Training Adult Basic Education, TANF and One Stop Practitioners and Program Administrators

Meeting the Challenges of No Child Left Behind in U.S. Immersion Education

WORK OF LEADERS GROUP REPORT

Students Understanding of Graphical Vector Addition in One and Two Dimensions

The lab is designed to remind you how to work with scientific data (including dealing with uncertainty) and to review experimental design.

Notes on The Sciences of the Artificial Adapted from a shorter document written for course (Deciding What to Design) 1

2020 Strategic Plan for Diversity and Inclusive Excellence. Six Terrains

Tun your everyday simulation activity into research

Education as a Means to Achieve Valued Life Outcomes By Carolyn Das

eportfolio Trials in Three Systems: Training Requirements for Campus System Administrators, Faculty, and Students

Principles of Public Speaking

AN INTRODUCTION (2 ND ED.) (LONDON, BLOOMSBURY ACADEMIC PP. VI, 282)

UCLA Issues in Applied Linguistics

Sheryl L. Skaggs, Ph.D. Curriculum Vitae

Research Update. Educational Migration and Non-return in Northern Ireland May 2008

Common Core State Standards for English Language Arts

A. What is research? B. Types of research

Developing an Assessment Plan to Learn About Student Learning

CURRENT POSITION: Angelo State University, San Angelo, Texas

Key concepts for the insider-researcher

Is operations research really research?

Social Emotional Learning in High School: How Three Urban High Schools Engage, Educate, and Empower Youth

The Economic Impact of College Bowl Games

A Survey of Authentic Assessment in the Teaching of Social Sciences

Sociology. M.A. Sociology. About the Program. Academic Regulations. M.A. Sociology with Concentration in Quantitative Methodology.

What Teachers Are Saying

Individual Interdisciplinary Doctoral Program Faculty/Student HANDBOOK

THE INFORMATION SYSTEMS ANALYST EXAM AS A PROGRAM ASSESSMENT TOOL: PRE-POST TESTS AND COMPARISON TO THE MAJOR FIELD TEST

12 th ICCRTS Adapting C2 to the 21st Century. COAT: Communications Systems Assessment for the Swedish Defence

Transcription:

Multi-Method Approaches 1 Running head: MULTI-METHOD APPROACHES Triangulation and Multi-method Approaches H. Paul LeBlanc III, PhD Dept. of Communication University of Texas at San Antonio 6900 North Loop 1604 West San Antonio, TX 78249-0643 (210) 458-7724, (210) 458-5991 fax pleblanc@utsa.edu Paper presented at the eighty-eighth Annual Meeting of the National Communication Association, New Orleans November 20, 2002

Multi-Method Approaches 2 Abstract Family communication is a developing field with a consciousness regarding the importance of researching phenomena from a multitude of perspectives. This position paper argues for the importance of conducting programmatic triangulated or multi-method research. Issues discussed include the nature of the phenomena of interest in the field of family communication, underlying assumptions of the historical dualism between qualitative and quantitative approaches, and practical considerations of multi-method approaches.

Multi-Method Approaches 3 Triangulation and Multi-Method Approaches Introduction As a communication scholar, I have been exposed to many different approaches to the investigation of communication phenomena. Different approaches seem to answer different kinds of questions about communication. Therefore, I have attempted to learn about the different approaches and use them in my studies depending, of course, on the nature of the question asked. Subsequently, I have developed ideas about broader-based approaches to studying communication. In 1994, I presented my first paper utilizing multiple approaches to the Family Communication Commission at the National Communication Association convention in New Orleans (see LeBlanc, 1994). In 1995, I chaired a methods panel and presented a theoretical paper on methodological triangulation at the Family Communication Division's preconvention conference in San Antonio. The following year in San Diego, I presented a paper demonstrating several examples of multi-method research. Finally, last year in Atlanta I presented a paper based on my dissertation research (see LeBlanc, 2001). That research utilized a quantitatively designed survey, based on previous qualitative research (see LeBlanc, 1996b; 1996c). For the past year and a half I have been teaching an undergraduate research methods class and have had more time to reflect on the nature and ramifications of inquiry. I have become convinced that methodological triangulation and multi-method approaches are necessary to fully understand the subtleties and nuances of communication in a family context. First, I would like to tell a short story that I believe illustrates some of the difficulties facing communication scholars. A couple of years back I participated in an orientation program for students. The dean of another college introduced herself and asked what was my area of specialty. My response of communication was greeted with, "Well, that's useful."

Multi-Method Approaches 4 As I later explained to my students, in physics the more variables in a system, the more unpredictable the system becomes. The example I give my students involves a comparison between a two variable and three variable system: or in communication terms, the difference between a dyad and a triad. In a two variable system, movement of information from source to destination can travel in one of two possible directions. If one knows the source, and movement is guaranteed, predicting the destination is a fairly straightforward matter. In simplest terms, barring other intervening variables (which we will get to in a moment), dyads are fairly predictable. Triads are another matter. Even if one knew the originating source and knew that movement was guaranteed, predicting to which of two possible destinations the information would flow becomes more problematical. If you add intervening variables such as free will, multiple possible fields of experience for members of the triad, differing levels or forms of intent and/or impact, differing situational contexts, then causal prediction becomes nearly-if not completely-impossible. Particles in physics experiments do not have free will. Communication scholars are interested in investigating message production, transmission and interpretation between and among human actors, who as luck would have it, have free will. Family communication scholars may have a more difficult time as the family context often involves multiple interdependent actors, with free will. How communication scholars have dealt with these inherent complexities of the phenomena of interest is to utilize different approaches in the investigation process. The problem has been, however, these various approaches have not been integrated. The most obvious reason for not integrating the various approaches to researching communication phenomena is the historical dualism between various approaches. Popularly, scholars have debated the distinction between social scientific and humanistic traditions. I have

Multi-Method Approaches 5 come to believe more and more that the distinction is a false one. However, distasteful it may be to some, inquiry, whether qualitative or quantitative in methodology, must be scientific. To unpack that claim, one must understand what is meant by science. Science is simply systematic observation. A holistic approach to scientific inquiry would and should understand the purposes and goals of various approaches. If the global purpose of scientific inquiry is to theorize, that is to explain phenomena, ultimately what we are talking about is the ability to tell another about our experience in a way they can understand. The dualism between quantitative and qualitative approaches is about how one goes about explaining. Put another way, each approach makes assumptions about the relationship between the knower and the known. As alluded to in earlier essays (see LeBlanc, 1995; LeBlanc, 1996a), scientific inquiry requires honesty and humility about our place in the epistemological project. The debate centers around the question: Where is the locus of truth? For the subjectivist, truth is reality. For the objectivist, reality is truth. Both approaches have historically assumed direct access to either of these two: truth and/or reality. Neither assumption practices honesty or humility. What we have access to in that project is the phenomena (the-appearance-of-the-thing), and not the noumena (the-thing-in-itself) (see Husserl, Heidegger). While it may be apparent to casual observation that "reality" is socially constructed, in fact what is actually occurring is the social construction of the "perception of reality." We make meaning about our experience through our interaction. What is "apparent" is the phenomena of meaning-making. However, neither is meaning reality. Meaning is phenomenal. As knower, we do not have direct access to the noumena, only to the phenomena, and only to part of that phenomena.

Multi-Method Approaches 6 If what we have access to is the phenomena, then what sense (pardon the pun) does it make to proceed with the debate of procedure. We are about understanding (describing and predicting) the methods of "doing" human relationships, which is interaction. That is our charge. The question is no longer why or when, but rather how. In the final analysis, all research begins in observation -- formal or informal. That is science at its root: systematic observation. Therefore, we should be about the business of systematic observation. The question is: how do we do observation? Therefore, the purpose of the remainder of this essay is to describe how to effectively design a program of study that effectively examines the phenomena of interest. How to proceed with research design first starts with an examination of what is known. The known may be evidence-based theory, or pre-theoretical evidence. Given what we have theorized about communication to date, the next step requires the development of sophisticated multi-perspective, for example, multi-method-ological research designs. (As I was formulating that last statement, it occurred to me that the root of sophisticated is sophist. Given that the history of our discipline dates back to the Age of Pericles, it is interesting to note that the arguments regarding the relationship between the knower and the known, within the academy, first began there with the rhetoricians and philosphers. Those who took the position that truth was at best probable, as opposed to absolute, were known as sophists.) One caveat regarding the development of these triangulated designs is that such designs may be too complex or cumbersome to complete in a single study. The answer to that problem is to design a program of study. As I stated earlier, my dissertation research involved a programmatic approach. The dissertation itself was a quantitative study. However, the test instrument that was utilized for data collection was based on characteristics of family interaction that was first described in a

Multi-Method Approaches 7 conversation analytic study. The qualitative approach afforded the opportunity to ground items on the survey instrument with directly observed phenomena. Secondarily, my dissertation was interested in looking at subjects' perceptions of the characteristics of their family interactions across families. To do this, multiple subjects from participating families were surveyed. With some families under investigation being comprised of dyads, while others were comprised of triads, a complex matrix design known as a randomized block design ANOVA was utilized to analyze the data. While the study did not utilize a multi-method approach per se, it did require a design that included multiple perspectives from earlier studies. This is not meant to suggest that qualitative approaches serve as the servant to the goal of quantitative prediction. In general, it does point to a direction for scientific inquiry: observation, interpretation, categorization, prediction. Prediction methods require observation, interpretation, and categorization. Indeed, as subjectivists like to point out, researchers cannot separate themselves from their biases. No matter how hard the researcher tries, the overall goal of understanding motivates the researcher to ask questions, make assumptions, and come to conclusions (even small ones) during every step of the process. The issue of subjective bias has even influenced qualitative researchers to debate who to privilege in the interviewing process. Do we privilege the researcher's perspective in his or her interpretation of the co-participant's responses? Or, do we simply report the co-participant's responses. If we do the latter, do we know if the co-participant is reflexively or reflectively responding. If we do the former, how do we judge if we are reflexively or reflectively processing? We don't, really.

Multi-Method Approaches 8 Yet, engaging in the process allows for serendipitous discovery. For example, in an earlier study (see LeBlanc, 1994) I intended to interview couples about their marriages. The interviews were conducted. Initially, the intent was to collect participants' descriptions of their experience. But by interviewing couples together, it provided an opportunity for couples to co-create meaning in the interview process. After transcribing the interviews, minute details of the interaction process itself became available. Unintentionally, the interview served multiple duties as ethnographic, ethnomethodological, phenomenological and conversation analytic data collection. It seems to me after observing the process of doing research, doing meta-research, that thinking carefully and clearly about what the overall goal of a research project might be allows the scholar to plan the building of the program of study. By doing so, we can begin to understand better the character and quality of complex phenomena, such as family interaction, and also answer more effectively when someone outside the discipline tells us our discipline is "useful."

Multi-Method Approaches 9 References LeBlanc, H. P., III. (2001, November). Comparison of self reports of inclusion in parentadolescent interaction. Paper presented at the eighty-seventh annual meeting of the National Communication Association, Atlanta, GA. LeBlanc, H. P., III. (1996, November). Building the house: Examples of multi-method research in marital and family communication. Paper presented at the eighty-second annual meeting of the Speech Communication Association, San Diego, CA. (ERIC Document Reproduction Service No. ED 401 583). LeBlanc, H. P., III. (1996, April). Disconfirming conversational acts. Paper presented at the sixty-fourth annual meeting of the Central States Communication Association, Minneapolis, MN. (ERIC Document Reproduction Service No. ED 402 633). LeBlanc, H. P., III. (1996, March). Inclusion and dinner conversation: An analysis of family "doing" family. Paper presented at the sixty-sixth annual meeting of the Southern States Communication Association, Memphis, TN. LeBlanc, H. P., III. (1995, November). Syncretism of qualitative and quantitative research paradigms: The case for methodological triangulation. Paper presented at the Family Communication Division pre-convention conference of the eighty-first annual meeting of the Speech Communication Association, San Antonio, TX. (ERIC Document Reproduction Service No. ED 392 074). LeBlanc, H. P., III. (1994, November). Building little communities: Relational communication and early parenthood in two young couples. Paper presented at the eightieth annual meeting of the Speech Communication Association, New Orleans, LA. (ERIC Document Reproduction Service No. ED 401 584).