Refine
Document Type
- Article (3)
Language
- English (3)
Has Fulltext
- yes (3)
Is part of the Bibliography
- no (3)
Keywords
- Assessment (1)
- Bias (1)
- Dental practice (1)
- Evaluation (1)
- Evidence-based dentistry (1)
- Evidence-based medicine (1)
- Medical student (1)
- OSCE (1)
- Practical skills (1)
- Questionnaire (1)
Institute
- Medizin (3)
Background: The Objective Structured Clinical Examination (OSCE) is increasingly used at medical schools to assess practical competencies. To compare the outcomes of students at different medical schools, we introduced standardized OSCE stations with identical checklists.
Methods: We investigated examiner bias at standardized OSCE stations for knee- and shoulder-joint examinations, which were implemented into the surgical OSCE at five different medical schools. The checklists for the assessment consisted of part A for knowledge and performance of the skill and part B for communication and interaction with the patient. At each medical faculty, one reference examiner also scored independently to the local examiner. The scores from both examiners were compared and analysed for inter-rater reliability and correlation with the level of clinical experience. Possible gender bias was also evaluated.
Results: In part A of the checklist, local examiners graded students higher compared to the reference examiner; in part B of the checklist, there was no trend to the findings. The inter-rater reliability was weak, and the scoring correlated only weakly with the examiner’s level of experience. Female examiners rated generally higher, but male examiners scored significantly higher if the examinee was female.
Conclusions: These findings of examiner effects, even in standardized situations, may influence outcome even when students perform equally well. Examiners need to be made aware of these biases prior to examining.
Background: The purpose of this pilot study was to create a valid and reliable set of assessment questions for examining Evidence-based Dentistry (EbD) knowledge. For this reason, we adapted and validated for dental students the Berlin Questionnaire (BQ), which assesses Evidence-based Medicine (EbM) abilities.
Methods: The Berlin Questionnaire was validated with medical residents. We adapted it for use in a dentistry setting. An expert panel reviewed the adapted BQ for content validity. A cross-sectional cohort representing four training levels (EbD-novice dental students, EbD-trained dental students, dentists, and EbM−/EbD-expert faculty) completed the questionnaire. A total of 140 participants comprised the validation set. Internal reliability, item difficulty and item discrimination were assessed. Construct validity was assessed by comparing the mean total scores of students to faculty and comparing proportions of students and faculty who passed each item.
Results: Among the 133 participants (52 EbD-novice dental students, 53 EbD-trained dental students, 12 dentists, and 16 EbM-/ EbD-expert faculty), a statistically significant (p < 0.001) difference was evident in the total score corresponding to the training level. The total score reliability and psychometric properties of items modified for discipline-specific content were acceptable. Cronbach’s alpha was 0.648.
Conclusion: The adapted Berlin Questionnaire is a reliable and valid instrument to assess competence in Evidence-based Dentistry in dental students. Future research will focus on refining the instrument further.
Influence of structured reporting of tooth-colored indirect restorations on clinical decision-making
(2019)
The aim of the present study was to discover what influence structured reporting (study group = A) of toothcoloured lab-fabricated restorations has on clinical decision-making following international guidelines. By way of comparison, the conventional approach in the form of short reporting with 5 items (control group = B) was used as gold standard. The study was carried out in the first clinical semester of dentistry (n = 68) at the Goethe University in Frankfurt am Main. In the study group, indirect ceramic restorations were assessed on a scale of 1 (very good) to 5 (insufficient) using structured reporting (7 items, each with 5 subgroups) in accordance to World Dental Federation (FDI) - standards. Following this, the clinical decision on the insertion of the restoration was made. To evaluate the quality of the structured reporting, sensitivity, specificity, confidence intervals (Cl) and the respective predictive values (positive = PPV, negative= NPV) were determined. Based on FDI reporting, a ceramic inlay is also favored with a great degree of certainty in clinical decisions: this was the true in 34 procedures out of a total of 38 clinically incorporated ceramic inlays [sensitivity 67% (95% CI: 46%83%); specificity 89% (95% Cl: 75%-97%); PPV 82%, NPV 79%]. In the control group, sensitivity was 56% (95% CI: 35%-75%); specificity 92% (95% CI: 79%-98%); PPV 83%, NPV 74%. No significant differences could be determined between A and B (p = 0.813).
Due to the higher sensitivity and efficiency given comparable specificity, structured reporting of tooth-coloured lab-fabricated restorations based on FDI criteria, appears more recommendable than short reporting. It is also suitable for promoting decision-making in quality assessment, thus improving the durability of dental restorations.