Agreement Qualitative Research

Crabtree BF, Miller WL (William L. Doing qualitative research. Wise publications; Results: First, a coding scheme was developed with a comprehensive inductive and deductive approach. Second, 10 transcripts were coded independently of two researchers, and the ROI was calculated. The resulting cappa value of 0.67 can be considered satisfactory on firm. In addition, different approval rates helped identify problems in the coding system. For example, low approval rates suggest that the relevant codes are too broad and need to be clarified. In a third phase, the results of the analysis were used to improve the coding system, resulting in consistent, high-quality results. The objective of qualitative analysts is always to reach the highest possible level of correspondence between independent coders.

However, it does not focus on achieving a standard coefficient, which is statistically necessary, as is the case in quantitative research. On the contrary, the emphasis is on a practical improvement in the quality of coding. For this reason, the focus is not on the coefficient or percentage of the agreement (i.e. the percentage of matching code allocations). Instead, qualitative researchers want to address and edit code attributions that do not match, so that they can continue with the coded material more precisely. The following dialog box is displayed, where you can customize the settings for checking the intercoder chord. The first reading of a sample of raw data was conducted as a result of literary research and the suggestion of themes for inclusion in the early code book. The first reading of the data revealed units of text or “codable” that, according to the researcher, could become a “codable” moment.

The comments were inserted into the margins with the first thoughts and ideas. “P observed” is the single match percentage displayed in the “” line of the code-specific result table. For the calculation of “P Chance,” or chance of agreement, MAXQDA uses a proposal by Brennan and Prediger (1981), which is heavily interested in the optimal use of Cohenkappa and its problems of uneven margin distribution. In this calculation, random match is determined by the number of different categories used by the two coders. This is the number of codes in the code-specific result table. In the field of qualitative research, the replication of thematic analysis methods can be a challenge, as many articles leave a detailed overview of the qualitative process; This makes it difficult for an inexperienced researcher to effectively reflect analysis strategies and processes, and for experienced researchers to fully understand the rigor of the study. Although there are descriptions of the evolution of the code book in the literature [2, 3], there remains an important debate on what constitutes reliability and rigour in qualitative coding [1]. Indeed, the idea of demonstrating rigour and reliability is often overlooked or briefly discussed, creating conditions for replication.