Table 6 Interrater-Reliability (Cohen’s Kappa) for each category (N = 11)
Domain | Category | Cohen’s κ | |
|---|---|---|---|
Block – RO 1 | Professional Competence | Disposition | 1.0 |
Situation-Specific skills | 0 | ||
Performance | .63 | ||
Argumentation Competence – Focal Issues | Structure | N/A | |
Content | N/A | ||
Justification | N/A | ||
Argumentation competence – Analysis | Form | .01 | |
Strategy | .30 | ||
Goal | 0 | ||
Argumentation competence – Assessment | Metacognitive Knowledge | .01 | |
Metastrategic Knowledge | .28 | ||
Epistemological Knowledge | 0 | ||
Block – RO 2 | Active learning | Practical experience with students | .81 |
Block – RO 3 | Reasons for results (authors) | Systematisation of reasons | .69 |