Refine
Year of publication
Document Type
- Article (11)
- Working Paper (4)
- Conference Proceeding (2)
- Doctoral Thesis (1)
- Master's Thesis (1)
- Report (1)
Has Fulltext
- yes (20)
Is part of the Bibliography
- no (20) (remove)
Keywords
- evaluation (20) (remove)
Institute
Der vorliegende Artikel beschäftigt sich mit der Frage, welche Methoden genutzt werden können, um eine Evaluierung von Services und Angeboten von Fachinformationsdiensten nutzer*innenzentriert und interaktiv umzusetzen. Als Beispiel dient der Fachinformationsdienst Darstellende Kunst, bereitgestellt von der Universitätsbibliothek Johann Christian Senckenberg in Frankfurt am Main. Drei unterschiedliche Methoden werden in diesem Zusammenhang näher vorgestellt und ihre Anwendbarkeit für die Evaluierung von FID-Portalen oder vergleichbaren Rechercheportalen reflektiert: Leitfaden-Interviews mit Think-Aloud-Elementen, virtuelle Fokusgruppen sowie ein digitaler Card-Sorting-Ansatz.
School psychologists are asked to systematically evaluate the effects of their work to ensure quality standards. Given the different types of methods applied to different users of school psychology measuring the effects of school psychological services is a complex task. Thus, the focus of our scoping review was to systematically investigate the state of past research on the measurement of the effects of school psychological services published between 1998 and 2018 in eight major school psychological journals. Of the 5,048 peer-reviewed articles published within this period, 623 were coded by two independent raters as explicitly refering to school psychology or counseling in the school context in their titles or abstracts. However, only 22 included definitions of effects of school psychological services or described outcomes used to evaluate school psychological services based on full text screening. These findings revealed that measurement of the effects of school psychological services has not been a focus of research despite its' relevance in guidelines of school psychological practice.
WaterGAP (Water - Global Assessment and Prognosis) is a tool for modeling global water use and water availability. It participates among other models in the ISIMIP initiative (The Inter-Sectoral Impact Model Intercomparison Project). As part of this initiative, the water temperature should be calculated by participating hydrological models because it plays a vital role in many chemical, physical and biological processes. Therefore, the subject of this master thesis is to implement the physically based surface water temperature computation after VAN BEEK ET AL. (2012) and WANDERS ET AL. (2019) into WaterGAP and compare the results to the statistical regression approach by PUNZET ET AL. (2012). The computation is validated with observed water temperature data obtained from the GEMStat water quality database. The results are good for arctic and temperate latitudes. Surface water temperatures for tropical rivers are overestimated, most likely due to the overestimation of precipitation temperatures, incoming radiation and groundwater temperatures. The comparison with the regression model by PUNZET ET AL. (2012) shows matching results. The regression model even matches with WaterGAP results for most of the simulations of the future under climate change conditions, where the regression model should stop working due to changing environmental parameters. Several assumptions had to be made in order to implement the water temperature calculation in Water-GAP. These include, e.g., discharge temperatures for power plant cooling water, precipitation and surface runoff temperatures. For model improvements, perhaps three different values for the different regions of the world should be used to cool down the precipitation and surface runoff. The model could also be improved by refining the ice formation calculation, especially for the conditions when the ice melts, breaks up and is transported downstream. Furthermore, the feedback to the river channel roughness could be implemented if ice has formed. The WaterGAP model upgraded with the water temperature calculation will help the ISIMIP initiative in the future.
In der vorliegenden Evaluationsstudie wurde die Wirkung der Lehre des universitären Lehrprojektes ‚Expertise und Kooperation für eine Basisqualifikation Inklusion‘ (EKBI) auf inklusionsbezogene Einstellungen, Haltungen und Selbstwirksamkeitserwartungen untersucht. Diese Lehre schloss jeweils Lehrtandems aus mindestens zwei Dozierenden sowie interdisziplinäre Kooperationen ein. Die Teilnehmenden der Kurse (Experimentalgruppe, n = 101) sowie Studierende, die nicht daran teilgenommen hatten (Kontrollgruppe, n = 54), wurden vor und nach dem Semester, in dem die Lehre stattfand, mittels Fragebogen untersucht. Bei der Entwicklung allgemeinerer Einstellungen, Haltungen und Bedenken konnte kein signifikanter Effekt der Zeit in Abhängigkeit von der Gruppe verzeichnet werden. Es zeigte sich aber, dass sowohl die spezifischen unterrichtsbezogenen Einstellungen als auch die subjektiv eingeschätzte Lehrer*innenwirksamkeit in Bezug auf Inklusion in der Experimentalgruppe stärker anstiegen als in der Kontrollgruppe. Es ist zu schlussfolgern, dass die Tandemlehre mindestens kurzfristig wirksam in Bezug auf eine proinklusive Entwicklung ist. Zukünftige Studien könnten die Nachhaltigkeit der Effekte sowie ihren Praxistransfer untersuchen.
Background: Little is known about evaluation practices as well as performance-oriented allocation of resources according to teaching quality at German medical schools. For this reason, the Association of the Scientific Medical Societies in Germany and the German Association of Medical Faculties aimed to analyse current practices at German medical schools.
Methods: Data were collected by a questionnaire which was sent to all medical schools in Germany.
Results: 30 medical schools with 33 undergraduate medical programs participated in the survey (response rate: 83%). The evaluation tools used at these schools mainly assessed structural and procedural aspects of teaching and were designed to obtain overall student ratings of teaching quality. Evaluation tools were quite heterogeneous across the sample, and some uncertainty remained with regard to the psychometric properties of these tools and whether they meet international quality standards. Various algorithms underlying resource allocation for teaching are being used, but most focus on quantity rather than quality of teaching.
Conclusion: A nationwide agreement on a generalizable definition of high-quality teaching is desirable. At the same time, reliable and valid tools measuring teaching quality need to be identified and/or created. This could be accomplished through a wider collaboration of medical schools and could represent an advancement for the allocation of resources for high-quality teaching.
Reintroductions of plant species are increasingly popular in conservation practice. Steppe grasslands contain many rare and endangered plant species that are potential objects for such reintroductions. Most reintroduction projects, however, can only target a restricted number of species, which raises the question of how species should be prioritised. Here, we present a method to select priority species for reintroduction based on species' characteristics that are widely used in conservation practice. We first determined the local species pool containing those vascular plant species that occurred both in our target region (Thuringia, Germany) and target habitat (steppe grasslands), yielding 369 species. With the help of an a priori filter that selected currently endangered species with limited distribution, 136 potential target species were determined. These potential target species had experienced stronger decline, had a narrower phytosociological amplitude and were more likely to be species of the Festuco-Brometea class and the Festucetalia valesiacae order than non-target species. Potential target species were then ranked by a points system based on ten conservation-relevant characteristics of the species from the categories "threat and protection status", "distribution and decline", and "habitat affiliation". In the ranking, six steppe grassland plant species (Astragalus exscapus, Bothriochloa ischaemum, Prunella laciniata, Pulsatilla pratensis subsp. nigricans, Scorzonera purpurea, and Seseli hippomarathrum) achieved the highest scores. An additional seven species not specifically characteristic for steppe grasslands also scored highly. A post hoc evaluation of these 13 highest scoring species based on additional conservation criteria left five species (Astragalus exscapus, Linum leonii, Orchis morio, Pulsatilla pratensis subsp. nigricans and Scorzonera purpurea) as species with highest priority for reintroductions and another five species as highly suitable for reintroductions. Associations between the ranking order and different ranking criteria revealed that a species’ threat and rarity in Thuringia and its protection status had the highest representation in the ranking, followed by threat in Germany, regional decline and habitat affiliation. In contrast, international threat and responsibility of Thuringia for its conservation had only low representation in the ranking, probably because these characteristics applied to only a few species. The ranking list gives a selection of species for reintroductions, which combined with additional information based on comprehensive local and floristic knowledge, allows the identification of the species with the highest priority. Our method can be transferred to other regions or habitat types.
In this study, two different methods were applied to derive daily and monthly sunshine duration based on high-resolution satellite products provided by the European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT) Satellite Application Facility on Climate Monitoring using data from Meteosat Second Generation (MSG) SEVIRI (Spinning Enhanced Visible and Infrared Imager). The satellite products were either hourly cloud type or hourly surface incoming direct radiation. The satellite sunshine duration estimates were not found to be significantly different using the native 15-minute temporal resolution of SEVIRI. The satellite-based sunshine duration products give additional spatial information over the European continent compared with equivalent in situ-based products. An evaluation of the satellite sunshine duration by product intercomparison and against station measurements was carried out to determine their accuracy. The satellite data were found to be within ±1 h/day compared to high-quality Baseline Surface Radiation Network or surface synoptic observations (SYNOP) station measurements. The satellite-based products differ more over the oceans than over land, mainly because of the treatment of fractional clouds in the cloud type-based sunshine duration product. This paper presents the methods used to derive the satellite sunshine duration products and the performance of the different retrievals. The main benefits and disadvantages compared to station-based products are also discussed.
Communicating research with the public : evaluation of an invasive earthworm education program
(2013)
Ecologists are increasingly encouraged by funding agencies and professional societies to communicate their research with the public. However, most receive relatively little training in how to do this effectively. Furthermore, evaluation of whether such an investment by ecologists actually achieves conservation objectives is rare. We created an education program, involving print, television, radio, and internet media, to increase awareness about earthworm invasions and to discourage anglers from dumping earthworm bait. Using pre- and post-surveys, we evaluated our program’s success in reaching its target audience and in changing knowledge and behavior. Few participants (4.1%) recalled seeing the program material and knowledge of the fact that earthworms are non-native in Alberta remained low (15.8% before, 15.1% after). Further, after being told about the negative effects of earthworms in forests, 46.7% of the anglers surveyed stated they would not change their bait disposal behavior in the future, with many commenting that they did not believe earthworms could be harmful. These results highlight the importance of evaluating education programs, rather than assuming they are successful. Given many participants' doubts that earthworms have negative effects, both regulations and education may be needed to reduce earthworm introductions.
New technologies generate risks, for the evaluation of which various mechanisms have been developed; the most frequent of these mechanisms consists of advice from committees of experts to the bodies whose role is to decide whether a new technology should be implemented or not. Such committees try to measure the magnitude of the threats that accompany the introduction of a new technology in order that the policy-makers may take their decisions in the light of the reports of the experts. The legitimacy of such reports is not only found in the technical capacity of its authors, but also in the impartiality of their recommendations. On numerous occasions, nevertheless, the effective presence of this evaluation finds itself today under suspicion. There are various methods that can be employed to try to resolve this problem. Firstly by reinforcing the mechanisms on which the technocratic evaluation of the risk are based; for example, through transparency in the selection of the experts. Secondly, by means of the incorporation of democratic mechanisms in the scientific-technological policy. The exposure of the internal conditions to the dynamics of the technological change that make possible the institutionalised involvement of society in the control of risk, as well as of the mechanisms to realise it are the principal subjects of this work.
Welche gesellschaftlichen Zwänge wirken auf die Medizin und ihre Anwender ein? Wie ist das Verhältnis von Ökonomie und medizinisch Gebotenem? Wie steht es mit der Finanzierung der nicht evidenzbasierten Behandlung? Stellen Rationierung und Rationalisierung die möglichen Prinzipien der Priorisierung dar? Führt die Priorisierung zur Qualitätsminderung oder gar Sorgfaltsverletzung? Diese Fragen behandelte der 4. Ärztetag am Dom in Frankfurt am Main. ...
Introduction: This study presents our online-teaching material within the k-MED project (Knowledge in Medical Education) at the university of Marburg. It is currently organized in five e-learning modules: cytogenetics, chromosomal aberrations, formal genetics, fundamentals of molecular diagnostics, and congenital abnormalities and syndromes. These are basic courses intended to do the educational groundwork, which will enable academic teachers to concentrate on more sophisticated topics during their lectures. Methods: The e-learning modules have been offered to a large group of about 3300 students during four years at the Faculty of Medicine in Marburg. The group consists of science students (human biology) and medical students in the preclinical or the clinical period, respectively. Participants were surveyed on acceptance by evaluating user-tracking data and questionnaires. Results and Conclusion: Analysis of the evaluation data proofs the broad acceptance of the e-learning modules during eight semesters. The courses are in stable or even increasing use from winter term 2005/06 until spring term 2009. Conclusion: Our e-learning-model is broadly accepted among students with different levels of knowledge at the Faculty of Medicine in Marburg. If the e-learning courses are maintained thoroughly, minor adaptations can increase acceptance and usage even furthermore. Their use should be extended to the medical education of technical assistances and nurses, who work in the field of human genetics. Keywords: Human genetics, e-Learning, evaluation, multimedia
The aim of this study is a better understanding of radiation processes in regional climate models (RCMs) in order to quantify their impact and to reduce possible errors. A first important task in finding an answer to this question was to examine the accuracy of the components of the radiation budget in regional climate simulations. To this end, the simulated radiation budgets of two regional climate simulations for Europe were compared with a satellite-based reference. In the simulations with the RCM COSMO-CLM there were some serious under- and overestimations of short- and long-wave net radiation in Europe. However, taking into account the differences in the reference datasets, the results of the COSMO-CLM were quite satisfactory.
Using statistical methods, the influence of potential sources of uncertainties was estimated. Uncertainties in the cloud cover and surface albedo had a significant impact on uncertainties in short-wave net radiation, the explained variance of uncertainties in cloud cover was two to three times higher than that of uncertainties in surface albedo. Uncertainties in the cloud cover resulted in significant errors in the net long-wave radiation. However, the influence of uncertainties in soil temperature on errors in the long-wave radiation budget was low or even negligible. These results were confirmed in a comparison with simulations of the REMO and ALADIN regional climate models. It is reasonable to expect that a better parameterization of relatively simple parameters such as cloud cover and surface albedo is a means of significantly improving the simulation of radiation budget components in the COSMO-CLM.
An important question for the application of RCMs is to examine whether the results of radiation uncertainties and their impact factors are comparable if the model is applied in a region that is not the one for which it was originally created. Comparisons of the simulated radiation budgets of different RCMs for West Africa showed that problems in the simulation of short- and long-wave radiation fluxes were a widespread problem. Most of the tested models showed some considerable under- or overestimation of the short- and long-wave radiation fluxes.
Similar to Europe uncertainties in cloud cover were also in the simulations for Africa a significant factor affecting uncertainties in the simulated radiation fluxes. However, for the African simulations uncertainties in the parameterization of surface albedo were much more important than in Europe. On average, overland uncertainties in the cloud cover and surface albedo were of similar importance. Uncertainties in soil temperature simulations were of higher importance in Africa, and reached overland similar values of the mean explained variance (R2 ≈ 0.2) such as uncertainties in the cloud cover. This indicates a geographical dependence of the model error. This study confirmed the assumption that an improved parameterization of relatively simple parameters such as the surface albedo in RCMs leads to a significant improvement in the modeled radiation budget, particularly in Africa.
The influence of errors in the simulated radiation budget components on the simulation of climate processes, such as the West-African monsoon (WAM), was investigated in a next step. The evaluation of ERA-Interim and ECHAM5 driven COSMO-CLM simulations for Africa showed that the main features of the WAM were well reproduced by the model, but there were only slight improvements compared to the driving data. The index of convective activity in the model simulations was much too high and precipitation was underestimated in large parts of tropical Africa. The partly considerable differences between the ERA-Interim and ECHAM5 driven simulations demonstrated the sensitivity of the RCM to the boundary conditions and in particular to the sea surface temperature. An excessive northwards shift of the monsoon in the model was influenced by the land-sea temperature gradient and the strength of the Saharan heat low. Consequently, a part of the error was due to the driving data and the model itself produced another part.
By modifying the parameterization of the bare soil albedo the errors in the radiation budget and 2 m temperature in the Sahara region were significantly reduced. Similarly, the overesti-mation of precipitation and convection has been reduced in the Sahel. The effect of this modifi-cation on the examined WAM area was low. This confirmed that especially in desert regions, errors in the surface albedo were a driving factor for errors in the radiation budget. However, there are other important factors not yet sufficiently understood that have a strong influence on the quality of the simulation of the WAM.
The analysis of the actual state, the quantification of error sources and the highlighting of connections made it possible to find means to reduce uncertainties in the simulated radiation in RCMs and to have a better understanding of radiation processes. However, the magnitude of the errors found, the number of possible influencing factors, and the complexity of interactions, indicate that there is still a need for further research in this area.
Die Vermittlung der Zusammenhänge zwischen psychologischen Funktionen und körperlichen Veränderungen sowie deren Relevanz für die Entstehung und Aufrechterhaltung von Krankheiten stellt ein zentrales Ziel der Ausbildung in Medizinischer Psychologie dar. Zur Veranschaulichung dieser Zusammenhänge führten wir ein Psychophysiologie-Praktikum im ersten vorklinischen Semester ein. Die Studierenden führten in Vierergruppen mit Hilfe ausführlicher schriftlicher Instruktionen jeweils ca. 30 Minuten andauernde praktische Übungen durch, die die folgenden Themen behandelten: (1) Stress (abhängige Variable: Herzrate), (2) "Lügendetektor" (abhängige Variable: Hautleitwertsreaktionen), (3) Biofeedback (abhängige Variable: Hauttemperatur) und (4) Elektroenzephalogramm (abhängige Variable: Amplituden der vier klassischen Frequenzbänder). Die praktischen Übungen wurden durch theoretische Gruppenarbeiten und einen Termin zur Zusammenfassung der Ergebnisse der Übungen ergänzt. Die studentische Evaluation des Praktikums war durchweg positiv. So wurde das Praktikum als Bereicherung des Kurses angesehen, und der selbstbeurteilte Kenntnisstand auf dem Gebiet der Psychophysiologie zeigte eine signifikante Verbesserung. Diese Ergebnisse sowie unsere Eindrücke während des Praktikums bekräftigten unseren Entschluss, ein Psychophysiologie-Praktikum als Teil des Kurses der Medizinischen Psychologie und Medizinischen Soziologie fest zu etablieren.
E-Learning soll im Rahmen der allgemeinmedizinischen Ausbildung von Medizinstudierenden erprobt werden. Ein zielgruppenspezifisches, multimodulares Online-Angebot begleitet Medizinstudenten des 10. Semesters während ihres dezentralen Praktikums in hausärztlichen Praxen. Folgende Lehrziele werden angestrebt: (1) Einführung in das E-Learning, (2) Klinische Allgemeinmedizin - Online-Modul, (3) Chronic Care Online-Modul, (4) Online-Bewerbung. Die systematische Evaluation zeigt, dass E-Learning die Kommunikation der Studierenden untereinander und mit der universitären Lehreinheit während des Praktikum fördert. Auf der Grundlage der in diesem Pilotversuch gewonnenen Erfahrungen erscheint die Kombination mit Präsenzunterricht (Blended Learning) eine vielversprechende Option für die allgemeinmedizinische Ausbildung zu sein.
Vocational training programmes have been the most important active labour market policy instrument in Germany in the last years. However, the still unsatisfying situation of the labour market has raised doubt on the efficiency of these programmes. In this paper, we analyse the effects of the participation in vocational training programmes on the duration of unemployment in Eastern Germany. Based on administrative data for the time between the October 1999 and December 2002 of the Federal Employment Administration, we apply a bivariate mixed proportional hazards model. By doing so, we are able to use the information of the timing of treatment as well as observable and unobservable influences to identify the treatment effects. The results show that a participation in vocational training prolongates the unemployment duration in Eastern Germany. Furthermore, the results suggest that locking-in effects are a serious problem of vocational training programmes. JEL Classification: J64, J24, I28, J68
In this paper we evaluate the employment effects of job creation schemes on the participating individuals in Germany. Job creation schemes are a major element of active labour market policy in Germany and are targeted at long-term unemployed and other hard-to-place individuals. Access to very informative administrative data of the Federal Employment Agency justifies the application of a matching estimator and allows to account for individual (group-specific) and regional effect heterogeneity. We extend previous studies in four directions. First, we are able to evaluate the effects on regular (unsubsidised) employment. Second, we observe the outcome of participants and non-participants for nearly three years after programme start and can therefore analyse mid- and long-term effects. Third, we test the sensitivity of the results with respect to various decisions which have to be made during implementation of the matching estimator, e.g. choosing the matching algorithm or estimating the propensity score. Finally, we check if a possible occurrence of 'unobserved heterogeneity' distorts our interpretation. The overall results are rather discouraging, since the employment effects are negative or insignificant for most of the analysed groups. One notable exception are long-term unemployed individuals who benefit from participation. Hence, one policy implication is to address programmes to this problem group more tightly. JEL Classification: J68, H43, C13
Im Jahr 1993 wurde auf ehemaligen Ackerflächen in der Umgebung des Naturschutzgebiets „Garchinger Heide“ mit der Neuanlage von Kalkmagerrasen begonnen. In den Jahren 2001 bis 2004 wurde der Einfluss verschiedener Renaturierungsmaßnahmen (Bodenabtrag, Mähgutübertragung) auf die Vegetation untersucht und ein Vergleich mit Referenzflächen im Naturschutzgebiet durchgeführt. Trotz hoher P- und K-Gehalte der Böden ist der Phytomasseertrag auf Renaturierungsflächen ohne Bodenabtrag so niedrig, dass die Flächen als Magerrasen bezeichnet werden können. Sowohl die Gesamtartenzahl der Phanerogamen als auch die Anzahl der Magerrasenarten (überwiegend Festuco-Brometea-Arten) als Zielarten der Renaturierung sind auf Flächen mit Mähgut noch deutlich höher als auf Flächen ohne Mähgut, auf denen Molinio-Arrhenatheretea-Arten und Ruderalarten dominieren. Die γ-Diversität der Phanerogamen ist in den nie umgebrochenen Magerrasen der Garchinger Heide zwar niedriger, die Anzahl der Magerrasenarten aber höher als auf den Renaturierungsflächen ohne Bodenabtrag. Hinsichtlich der α-Diversität der Phanerogamen, die auf 0,01 m2 bis 100 m2 großen Aufnahmeflächen untersucht wurde, zeigen sich kaum signifikante Unterschiede zwischen ursprünglichen und neu angelegten Magerrasen. Die Anzahl der Magerrasenarten ist jedoch auf den meisten der untersuchten Maßstabsebenen auf den Renaturierungsflächen niedriger als im Naturschutzgebiet. Bei den Kryptogamen ist bei gleicher γ-Diversität sowohl die α-Diversität als auch die Anzahl der Magerrasenarten in den ursprünglichen Magerrasen höher als in den neu angelegten.
Die Ergebnisse zeigen, dass die Ermittlung von Artenzahlen ohne Angaben zur Artenzusammensetzung oder zur Anwesenheit von Zielarten nicht ausreicht, um den Erfolg von Naturschutz- und Renaturierungsmaßnahmen zu beurteilen. Die Magerrasenarten als Zielarten der Renaturierung sind dagegen gut als Indikatorartengruppe im Rahmen von Erfolgskontrollen geeignet.
Persistently high unemployment, tight government budgets and the growing scepticism regarding the effects of active labour market policies (ALMP) are the basis for a growing interest in evaluating these measures. This paper intends to explain the need for evaluation on the micro- and macroeconomic level, introduce the fundamental evaluation problem and solutions to it, give an overview of the newer developments in evaluation literature and finally take a look on empirical estimations of ALMP effects. JEL Classification: C14, C33, H43, J64, J68