Refine
Year of publication
- 2017 (3) (remove)
Document Type
- Article (3)
Has Fulltext
- yes (3)
Is part of the Bibliography
- no (3)
Keywords
- OSCE (2)
- OSPE (2)
- Dentistry (1)
- E-Learning (1)
- Evidence-based dentistry (1)
- Evidence-based medicine (1)
- National catalogue of competence-based learning objectives in dentistry (1)
- Prädiktive Validität (1)
- Reliabilität (1)
- Replication study (1)
Institute
Introduction: The aim of this study was to ascertain whether the testing format of an OSPE (Objective Structured Practical Examination) in conservative dentistry (sixth semester) predicts the scores on the practical section of the state examination (11th semester) in the same subject. Taking general student profiles into consideration (score on the school-leaving exam [Abitur], score on the preliminary exam in dental medicine [Physikum], length of university study, cohorts, and sex), we also investigated if any correlations or differences exist in regard to the total and partial scores on the OSPE and the corresponding state examination.
Methods: Within the scope of this longitudinal retrospective study, exam-specific data spanning 11 semesters for dental students (N=223) in Frankfurt am Main were collected and analyzed. Statistical analysis was carried out by calculating Spearman rank correlations, partial correlations, Pearson’s correlation coefficients, and multiple regressions (SPSS Statistics 21, IBM Corporation, New York).
Results: The results show that the OSPE (Cronbach’s α=.87) correlates with level of success on the practical section of the state exam in conservative dentistry (p=.01, r=.17). Length of university study also emerged to correlate significantly with the state exam score (p=.001, r=.23). Together, these two variables contribute significantly to predicting the state exam score (p=.001, R2=.076). This was seen extensively among female students. It was also discovered that these female students had higher school-leaving exam scores than male students (F=6.09, p=.01, η2=.027), and that a significant correlation between scores on the Physikum (preliminary exam in dental medicine) and OSPE scores existed only for male students (r=.17, p=.01).
Conclusion: This study was able to demonstrate the predictive effect of a clinical OSPE regarding scores achieved on the state exam. Taking the limitations of this study into account, we are able to recommend using the OSPE testing format in the sixth semester during the clinical phase of dental study.
Einleitung: Ziel dieser Studie war es zu evaluieren, ob das Prüfungsformat einer OSPE (Objective Structured Practical Examination) durchgeführt im Fach Zahnerhaltungskunde (6. Fachsemester) den Studienerfolg im praktischen Teil des Staatsexamens (11. Fachsemester) im selben Fach prädiziert. Ferner sollte unter Berücksichtigung allgemeiner Angaben der StudienteilnehmerInnen (Abitursnote, Physikumsnote, Studiendauer, Kohorte und Geschlecht) analysiert werden, ob bezüglich der Gesamt- sowie Teilnoten der OSPE und der adäquaten Staatsexamensprüfung Zusammenhänge oder Unterschiede bestehen.
Methoden: Im Rahmen dieser longitudinalen, retrospektiven Studie wurden für einen Zeitraum von 11 Semestern prüfungsbezogene Daten von Studierenden (N=223) des Fachbereichs Zahnmedizin in Frankfurt am Main erhoben und untersucht. Für die statistische Auswertung der Daten wurden Spearman Rangkorrelationen, Partialkorrelationen, Korrelationskoeffizienten nach Pearson, und Multiple Regressionen (SPSS Statistics 21, IBM Corporation, New York) berechnet.
Ergebnisse: Die Ergebnisse zeigen, dass OSPE (Cronbachs α=.87) mit dem Erfolg im praktischen Teil des Staatsexamens im Fach Zahnerhaltungskunde korreliert (p=.01, r=.17). Als eine weitere signifikante Korrelation mit der Examensleistung erwies sich die Dauer des Studiums (p=.001, r=.23). Gemeinsam leisten diese beiden Variablen einen signifikanten Beitrag zur Vorhersage der Examensnote (p=.001, R2=.076). Das zeigte sich im größeren Umfang bei weiblichen Studierenden. Zudem wurde festgestellt, dass diese bessere Abiturnoten als männliche Studierende aufweisen (F=6.09, p=.01, η2=.027) und dass es lediglich bei männlichen Studierenden eine signifikante Korrelation zwischen der Physikumsnote (Zahnärztliche Vorprüfung) und der OSPE-Benotung gab (r=.17, p=.01).
Schlussfolgerung: In der vorliegenden Untersuchung konnte der prädiktive Effekt einer klinischen OSPE auf die Prüfungsleistung im Staatsexamen gezeigt werden. Unter Berücksichtigung der Limitation der Studie empfiehlt sich aus unserer Sicht die Durchführung eines solchen Prüfungsformats im Rahmen des klinischen Studienabschnitts im 6. Semester im Fach Zahnmedizin.
Background: In the area of education research, it is well-known that studies of a defi ned question are seldom replicated. Furthermore, e-learning resources with evidence-based content in dentistry have received relatively little attention from researchers.
The Context and Purpose of the Study: The aim of this clinical study was to evaluate how dentistry students from two consecutive cohorts in their fi rst clinical semester rate a long-standing evidencebased dentistry (EbD) resource in an e-learning environment using a questionnaire of 43 specifi c items on 1) general questions regarding user-friendliness and acceptability, as well as 2) specifi c questions on content and functional range (A), handling and technical aspects (B), and didactics and educational value (C) based on a Likert scale from 0 = ‘strongly disagree’ to 3 = ‘strongly agree’, and how this compares to a primary study in which the resource was addressed as a novelty. The data were analyzed statistically using a one-way ANOVA followed by a Kruskal-Wallis multiple-comparison Z-test.
Results: A response rate of 100% was achieved. The majority of the users thought the topic of EbD to be important. The e-learning resource was rated with a score of 2.40 ± 0.66 (on a Likert scale from 1-6 where 1 = "very good" and 6 = "insuffi cient"). 86.15% of the students stated that they consider the resource benefi cial for their study in clinical simulation and in patient treatment courses. The results averaged for A: 1.92 (±0.57; median: 1.928), B: 1.48 (±0.60), and C: 2.27 (±0.67). The obtained results in the replication study showed no statistical signifi cant differences to the primary study.
Conclusions: The e-learning resource with dentistry vignettes cases and learning components on evidence-based principles was consistently rated positively by the students. Owing to their agreement with the data of the primary study, the results of the present study point to the remarkable validity of the method of evaluation. This should be addressed in future studies with larger cohorts.