|
Qualitative Validity and Reliability
Stebbins (2001) outlines three problems for validity in exploratory research.
These include: (a) reactive effects of the presence of the observer on the central subject of the study; (b) personal bias and selective perception and interpretation of the observer; and, (c) limitations on the ability of the observer to witness all aspects of the central subject of the study. Given these problems to validity and the methods employed in this exploratory study, the researcher looked for evidence that might contradict or refute identified codes and emerging themes throughout all stages of data analysis following collection of both quantitative and qualitative data. In addition, the researcher constantly assessed whether there was a sufficient number of instances of an event, process, or activity to make a valid generalization. Still, as Stebbins (2001) notes, the most effective way to ensure validity in exploratory research is to build upon inductively generated theory using a research process in the area of inquiry.
Maxwell (2013) points to triangulation as a strategy for dealing with threats to validity. For the purposes of this study, multiple sources of evidence were collected to aid
in triangulation. In addition, data analysis involved matching patterns across multiple forms of acquired data to enhance internal validity. Emerging themes were identified based on a careful review and synthesis of all forms of data collected and analyzed. Furthermore, theory was used to explain presidential decision making in KCTCS. Finally, the researcher protected the reliability of the results by using prescribed data collection instruments that minimize error and bias.
Summary
As an exploratory study, the researcher used both quantitative and qualitative data collection and analysis procedures to examine presidential decision making in KCTCS. A survey was administered to 6 consenting participants in phase one of the study.
Preliminary survey analysis was conducted to inform the development of a semi- structured interview protocol. The researcher conducted semi-structured interviews with 3 consenting participants in phase two of the study.
The goal of exploratory research is the production of generalizations about the phenomenon that are derived from the data through a process of induction (Stebbins, 2001). Final survey analysis was conducted to calculate descriptive statistics, followed by interview data transcription and coding. The researcher gathered documents during interview data transcription. During coding, evidence from documents was used to build an understanding of presidential decision making within KCTCS, and to further refine codes and themes emerging from interview data.
As an exploratory study using inductive reasoning, findings were developed through an analysis of participant responses to a survey and interview, as well as through documents, which enabled the researcher to arrive at her own interpretations and
generalizations about the central subject of the study, but which also echoed the perceptions and voices of participants as they described their reality.
CHAPTER IV RESULTS
The purpose of this exploratory study was to explore presidential decision making in KCTCS by examining the location of decision making in the system and how presidential decision making is shared between the KCTCS president and college presidents for academic, administrative, and personnel decision areas.
The first phase of this study used quantitative procedures to examine the location of decision making in the system in order to answer the first research question. Survey data showing areas where decision making was shared between the system and colleges, as well as decision items for which participants perceived differently the location of decision making, were used to develop a semi-structured interview protocol used in the second phase of the study. The second phase explored shared decision making involving the KCTCS president and college presidents in areas where phase one study results indicated decision making was shared between the system and colleges. The following two primary research questions guided the study:
What is the location of decision making in the Kentucky Community and Technical College System for specified academic, administrative, and personnel decisions?
How do the KCTCS president and college presidents in the Kentucky Community and Technical College System share academic, administrative, and personnel decisions for the system and colleges?
Additional questions helped guide the study and aided in exploring presidential decision making in the system. These questions attend to particular contextual and
situational factors relevant to presidential decision making based on the review of literature.
How do the state economic, political, or social contexts influence academic, administrative, and personnel decision making within the community college system?
What roles do the KCTCS Board of Regents and college boards of directors play in system-level and college-level decision making?
As an exploratory study, the researcher used an inductive approach to inquiry in analyzing surveys, interviews, and documents. The researcher conducted descriptive statistics, including frequencies, means, and the range. Descriptive statistics allowed the researcher to assess the degree to which decisions within the academic, administrative, and personnel decision areas occur at the local community college; primarily at the college, with some input from the state community college system; are shared equally between the college and the state system; primarily the state system, with some input from the college; or, the state system.
Qualitative data were collected through interviews with participants consenting to participate in phase two of the study and through documents. The researcher transcribed interview data and collected documents. The researcher coded interview data through an iterative process of reading and coding, followed by a categorical aggregation of codes and emerging themes. During coding, the researcher read documents to provide deeper understanding, answer clarifying questions generated from coding, and to confirm, inform, and shape interview data coding.
Creswell and Plano Clark (2007) suggest that mixing quantitative and qualitative data provides the researcher a better understanding of the phenomenon than if only quantitative or qualitative data were used. Following qualitative analysis of interviews and documents, quantitative data were reintroduced to refine codes and emerging themes. At that point, both quantitative and qualitative data were combined for analysis and interpretation.
This chapter will provide a description of the Kentucky Community and Technical College System to help contextualize findings of this study. In addition, this chapter will describe in detail the findings of quantitative and qualitative analyses. The major sections of this chapter include an overview of the system, as well as quantitative and qualitative findings separated by research question.
Do'stlaringiz bilan baham: |
