| Name |
|---|
| Krampen, Günter |
| Mayer, Anne-Kathrin |
| Peter, Johannes |
| Leichner, Nikolas |
| Title | Research data of the evaluation of a blended-learning instruction program for information literacy |
|---|---|
| Original Title | Forschungsdaten der Evaluation eines Blended Learning-Trainings zur Förderung der Informationskompetenz |
| Citation | Krampen, G., Mayer, A.-K., Peter, J., & Leichner, N. (2015). Research data of the evaluation of a blended-learning instruction program for information literacy [Translated Title] (Version 1) [Data and Documentation]. Trier: Center for Research Data in Psychology: PsychData of the Leibniz Institute for Psychology Information ZPID. https://doi.org/10.5160/psychdata.kngr14pr10 |
| Language of variable documentation | German |
| Responsible for Data Collection | Leichner, Nikolas; Peter, Johannes |
| Data Collection Completion Date | 2013 |
| Dataset Publication | 2015 |
| Dataset ID | kngr14pr10 |
| Study Description | The aim of this study was to examine the effectiveness of a blended-learning instruction program for information literacy developed by the Leibniz Institute for Psychology Information (ZPID) and tailored to the needs of psychology students. The instruction program included three online modules conveying knowledge and skills related to finding scholarly information and two classroom seminars (90 minutes each) that were designed to reflect the content of the online modules and to practice the relevant skills. For the evaluation of the instruction program, an experimental pre/post design with three measurement waves over two weeks was implemented to evaluate the program’s effectiveness. The participants (N = 67) were randomly allocated to one of two groups. Group 1 (n = 37) completed the instruction program between waves 1 and 2. Group 2 (n = 30) was a waiting control group and completed the program between waves 2 and 3. Results indicate that the instruction program improved knowledge about information literacy topics, professionalism of literature searches, effectiveness of literature searches, as well as self-assessed competence in finding information, which is in line with the hypotheses. Additionally, it was examined whether epistemological beliefs and basic knowledge in psychology are associated with a knowledge increase achieved through the training. Results indicate that epistemological beliefs lead to an increase in knowledge, while basic knowledge in psychology does not. |
| Hypotheses | Hypothesis 1: Dependant on training participation, an increase in information competence knowledge will be demonstrated.
Hypothesis 2: Dependant on training participation, an increase in the professionalism of literature search behaviour will be demonstrated. Hypothesis 3: Dependant on training participation, an increase in literature search success will be demonstrated. Hypothesis 4: Dependant on training participation, an increase in self-assessed competence in finding information will be demonstrated. Hypothesis 5: Epistemological beliefs influence learning gains during training. Hypothesis 6: Psychology knowledge influences learning gains during training. |
| Keyphrase | effectiveness of blended-learning training of information literacy for psychology students, pre-post test design, improvement of knowledge about information literacy topics & effectiveness of literature searches & self-assessed competence in finding information, 71 psychology students, research data
|
| Funding | Funding line (6) of Leibniz projects within the SAW-Competition (SAW 2012) |
| Rating | As a result of the computer-based presentation of standardized tests and questionnaires, objectivity of application may be assumed. Furthermore, most of the tests were analyzed automatically. Sufficient evidence for the reliability and validity of all the instruments is available and can be found in the corresponding publications. |
| Classification | Educational Measurement Academic Learning & Achievement |
|---|---|
| Controlled Terms | Information Literacy Competence Psychological Assessment Computer Searching Information Seeking Knowledge Level Achievement Measures College Students Data Collection |
| Research Method Description | Experiment Data |
|---|---|
| Classification of Data Collection | Experimental Design, Laboratory Experiment |
| Research Instrument | The data were collected during three measurement waves, each in two-week intervals. All data collection took place in controlled group surveys in the computer labs at the University of Trier using the online survey software Unipark. During each of the three measurement waves, the subjects performed standardized subject-specific, literature search tasks. Using a taxonomy of three types of search tasks, three tasks (one per type) were created for each of the measurement waves. After every search task, questions pertaining to the subject’s approach during the task were posed. These data were used to evaluate the professionalism of literature search behaviour (Leichner et al., 2014).
At every measurement wave, the subjects also completed an information competence knowledge test (adapted according to Leichner et al., 2013), a self-assessment scale of literature search competence, a questionnaire for the assessment of epistemological beliefs and the questionnaire “Connotative Aspects of Epistemological Beliefs” (Stahl & Bromme, 2007). At t1, demographic data were also collected. After training participation (t2 for experimental group 1, t3 for experimental group 2), the “Evaluation of Blended Learning Inventory” (Peter et al., 2014) was employed to assess subjective evaluation of the training. Immediately after the first measurement wave, the subjects also completed two further questionnaires in an online format under non-controlled conditions: a test for the assessment of basic knowledge of psychology and the short version of the “Need for Cognition“ scale (Bless et al., 1994). |
| Data Collection Method | Data collection in the presence of an experimenter
- Group Administration - Computer-Supported |
| Time Points | repeated measurements |
| Survey Time Period | The duration of the study was four weeks, whereas the instruction programs each took place over the course of two weeks. During this time span, data was collected at three measurement waves, each in two-week intervals. For this purpose, each of the four subgroups were assessed separately on two consecutive days.
t1 (pre-test): All participants completed the questionnaires on information competence, epistemological beliefs and socio-demographic traits during a controlled group survey on the computer and subsequently, under non-controlled conditions, in a further online data collection section. After t1: Two-week instruction program for the two subgroups in experimental group 1 (independent completion of online teaching modules and two 90-minute classroom seminars). t2 (three days after completion of the instruction program for experimental group 1): All participants complete the questionnaires on information competence and epistemological beliefs again. Experimental group 1 also completes the questionnaire on subjective training evaluation. After t2: Two-week instruction program for the two subgroups in experimental group 2. t3 (post-test for experimental group 2 three days after completion of the instruction program and follow-up for experimental group 1): All participants complete the questionnaires on information competence and epistemological beliefs, experimental group 2 also receives the questionnaire on subjective training evaluation. |
| Characteristics | - |
| Population | Psychology students at the univerity of Trier (n=34 first-year college students and n=33 advanced college students) |
| Experimental Pool | Individuals |
| Sample | Convenience sample.
|
| Subject Recruitment | Recruiting via e-mail distributor and flyers in the university buildings. Subjects received compensation for study participation. |
| Sample Size | 71 individuals |
| Return/Drop Out | 3 cases were excluded because of early discontinuation and 1 case because of an extreme age difference when compared to the rest of the cases. The final sample encompassed N = 67 subjects. |
| Gender Distribution | 78 % female subjects (n=52)
22 % male subjects (n=15) |
| Age Distribution | 18-31 years |
| Special Groups | - |
| Country | Germany |
| Region | Rhineland-Palatina |
| City | Trier |
| Variables | Subject number
Variables on the experimental conditions Demographic data (age, sex, number of semesters, average grade at secondary school graduation, etc.) Variables from the search tasks Items from the information competence knowledge test Items from the self-assessment scale Items from the test for the assessment of basic knowledge of psychology Items from the “Need for Cognition” scale Items from the epistemological questionnaire Items from the questionnaire “Connotative Aspects of Epistemological Beliefs” Items from the “Evaluation of Blended Learning Inventory” (IEBL) Variables from the evaluation of the Moodle online teaching program |
| Data Status | Complete Data Set |
|---|---|
| Original Records | Individual processed recordings via computerized surveying (person-related data files) |
| Transformation | Data from the subjects were assessed via the online survey software Unipark and transferred to a data matrix automatically. |
| Description | Research data file |
|---|---|
| File Name | kngr14pr10_fd.txt |
| Data Content | 71 subjects, 886 variables |
| Data Points | 71*886=62906 data points |
| Variables | Subject identification number (1), dropouts (1), experimental group membership (1), learning group membership (1), age (1), gender (1), number of semesters (1), participation or no participation in the seminar and online study (3), average grade at secondary school graduation (1), self-evaluation of study performance (1), search tasks at the measurement waves 1, 2 and 3 (168), items from the information competence knowledge test at the measurement waves 1, 2 and 3 (306), items from the self-assessment scale of literature search competence at the measurement waves 1, 2 and 3 (30), items from the test for the assessment of basic knowledge of psychology (62), items from the "Need for Cognition" scale (16), items from the questionnaire for the assessment of epistemological beliefs at the measurement waves 1, 2 and 3 (105), items from the questionnaire "Connotative Aspects of Epistemological Beliefs" at the measurement waves 1, 2 and 3 (72), items from the “Evaluation of Blended Learning Inventory” (IEBL) at the measurement waves 1, 2 and 3 (52), variables from the evaluation of the Moodle online teaching program (63) |
| MD5 Hash | 99781e94c22768214cac5ee420b2d4c3 |
| Description | File Name |
|---|---|
| German codebook for the research data file kngr14pr10_fd.txt | kngr14pr10_kb.txt |
| Publications Directly Related to the Dataset |
|---|
| Leichner, N. (2015). Multimethodale Erfassung von Informationskompetenz. In A.-K. Mayer (Hrsg.), Informationskompetenz im Hochschulkontext – Interdisziplinäre Forschungsperspektiven (S. 83–102). Lengerich: Pabst. Datensatz 0286011 |
| Leichner, N. (2015). Multimethodale Erfassung von Informationskompetenz bei Psychologiestudierenden (Unveröffentlichte Dissertation). Universität Trier, Trier, Germany.Datensatz 0286011 |
| Leichner, N., Peter, J., Mayer, A.-K., & Krampen, G. (2014). Assessing information literacy programmes using information search tasks. Journal of Information Literacy, 8 (1), 3-20. doi:10.11645/8.1.1870 Datensatz 0280998 |
| Leichner, N., Peter, J., Mayer, A.-K., & Krampen, G. (2014). Fostering information literacy in German Psychology students using a Blended Learning approach. Proceedings of the 6th International Conference on Computer Supported Education, 353–359. doi:10.5220/0004795103530359 |
| Peter, J. (2015). Lehre von Informationskompetenz im Fach Psychologie: Konzeptionelle und strategische Überlegungen sowie empirische Befunde. In A.-K. Mayer (Hrsg.), Informationskompetenz im Hochschulkontext – Interdisziplinäre Forschungsperspektiven (S. 79–194). Lengerich: Pabst.Datensatz 0286017 |
| Peter, J. (2015). Zum wechselseitigen Einfluss epistemologischer Überzeugungen und Förderung von Informationskompetenz (Unveröffentlichte Dissertation). Universität Trier, Trier, Germany. |
| Peter, J., Leichner, N., & Krampen, G. (2014). Das Inventar zur Evaluation von Blended Learning (IEBL): Konstruktion und Erprobung in einem Training professioneller Informationskompetenz. In M. Krämer, U. Weger, & M. Zupanic (Hrsg.), Psychologiedidaktik und Evaluation X (S. 275–282). Aachen: Shaker.Datensatz 9006865 |
| Utilized Test Methods |
|---|
| Bless, H., Wänke, M., Bohner, G., Fellhauer, R. F., & Schwarz, N. (1994). Need for cognition: Eine Skala zur Erfassung von Engagement und Freude bei Denkaufgaben. Zeitschrift für Sozialpsychologie, 25(2), 147–154. Datensatz 0084899 |
| Leichner, N., Peter, J., Mayer, A.-K., & Krampen, G. (2013). Assessing information literacy among German psychology students. Reference Services Review, 41(4), 660–674. doi:10.1108/RSR-11-2012-0076 Datensatz 0279940 |
| Leichner, N., Peter, J., Mayer, A.-K., & Krampen, G. (2014). Assessing information literacy programmes using information search tasks. Journal of Information Literacy, 8(1). doi:10.11645/8.1.1870 Datensatz 0280998 |
| Stahl, E., & Bromme, R. (2007). The CAEB: An instrument for measuring connotative aspects of epistemological beliefs. Learning and Instruction, 17(6), 773–785. doi:10.1016/j.learninstruc.2007.09.016Datensatz 0204849 |
| Further Reading |
|---|
| Mayer, A.-K. (2015). Informationskompetenz im Hochschulkontext – Interdisziplinäre Forschungsperspektiven. Lengerich: Pabst.Datensatz 0286004 |