The Impact of Mathematical Proficiency on the Number-Space AssociationHoffmann, Danielle ; ; Martin, Romain et alin PLoS ONE (2014) A specific instance of the association between numerical and spatial representations is the SNARC (Spatial Numerical Association of Response Codes) effect. The SNARC effect describes the finding that ... [more ▼] A specific instance of the association between numerical and spatial representations is the SNARC (Spatial Numerical Association of Response Codes) effect. The SNARC effect describes the finding that during binary classification of numbers participants are faster to respond to small/large numbers with the left/right hand respectively. Even though it has been frequently replicated, important inter-individual variability has also been reported. Mathematical proficiency is an obvious candidate source for inter-individual variability in numerical judgments, but studies investigating its influence on the SNARC effect remain scarce. The present experiment included a total of 95 University students, divided into three groups differing significantly in their mathematical proficiency levels. Using group analyses, it appeared that the three groups differed significantly in the strength of their number-space associations in a parity judgment task. This result was further confirmed on an individual level, with higher levels in arithmetic leading to relatively weaker SNARC effects. To explain this negative relationship we propose accounts based on differences in access to qualitatively different numerical representations and also consider more domain general factors, with a focus on inhibition capacities. [less ▲] Detailed reference viewed: 293 (17 UL) Istzustand und Ausbau der Épreuves Standardisées (ÉpStan)Fischbach, Antoine ; Ugen, Sonja ; Muller, Claire et alPresentation (2014, January) Detailed reference viewed: 212 (11 UL) Die Online-Testplattform OASYSKeller, Ulrich ; François, Eric ; Fischbach, Antoine et alPresentation (2014, January) Detailed reference viewed: 446 (78 UL) Befunde zu den Herausforderungen des luxemburgischen Schulsystems aus Sicht verschiedener large-scale StudienMartin, Romain ; Keller, Ulrich ; Reichert, Monique et alPresentation (2014, January) Detailed reference viewed: 212 (9 UL) Differential relations between facets of complex problem solving and students’ immigration backgroundSonnleitner, Philipp ; ; Keller, Ulrich et alin Journal of Educational Psychology (2014), Advance online publication Whereas the assessment of complex problem solving (CPS) has received increasing attention in the context of international large-scale assessments, its fairness in regard to students’ cultural background ... [more ▼] Whereas the assessment of complex problem solving (CPS) has received increasing attention in the context of international large-scale assessments, its fairness in regard to students’ cultural background has gone largely unexplored. On the basis of a student sample of ninth-graders (N = 299), including a representative number of immigrant students (N = 127), the present study evaluated (1) whether CPS can be assessed fairly among students with or without immigration background and (2) whether achievement differences between these groups exist. Results showed that fair assessment of CPS is possible using the Genetics Lab, a computer-based microworld that incorporates game-like characteristics and multilingual-friendly features. Immigrant students were generally outperformed by their non-immigrant peers, but performance differences can largely be explained by differential enrollment in lower academic tracks. Interestingly, CPS scales were less affected by students’ educational background than a traditional paper-pencil-based reasoning scale. Moreover, a fine-grained analysis of different facets of CPS showed that irrespective of the academic track, immigrant students demonstrated a more efficient task exploration behavior than their native peers (d = .26). In sum, this might point to the potential of computer-based assessment of CPS to identify otherwise hidden cognitive potential in immigrant students. [less ▲] Detailed reference viewed: 295 (35 UL)![]() Computer-assisted testingGreiff, Samuel ; Martin, Romain ![]() in Mayer, L. (Ed.) Oxford Bibliographies in Education (2014) Detailed reference viewed: 242 (16 UL) ÉpStan Technical ReportFischbach, Antoine ; Ugen, Sonja ; Martin, Romain ![]() Book published by University of Luxembourg (2014) Detailed reference viewed: 290 (50 UL) Concept maps: A useful and usable tool for computer-based knowledge assessment? A literature review with a focus on usabilityWeinerth, Katja ; Koenig, Vincent ; Brunner, Martin et alin Computers and Education (2014), 78 The concept map is now widely accepted as an instrument for the assessment of conceptual knowledge and is increasingly being embedded into technology-based environments. Usability addresses how ... [more ▼] The concept map is now widely accepted as an instrument for the assessment of conceptual knowledge and is increasingly being embedded into technology-based environments. Usability addresses how appropriate (for a particular use) or how user-friendly a computer-based assessment instrument is. As we know from human-computer interaction research, if the interface is not user-friendly, a computer-based assessment can result in decreased test performance and reduced validity. This means that the usability of the interface affects the assessment in such a way that if the test is not user-friendly, then the test taker will not be able to fully demonstrate his/her level of proficiency and will instead be scored according to his/her information and communication technology (ICT) literacy skills. The guidelines of the International Test Commission (2006) require usability testing for such instruments and suggest that design standards be implemented. However, we do not know whether computer-conducted concept map assessments fulfill these standards. The present paper addresses this aspect. We conducted a systematic research review to examine whether and how researchers have studied and considered usability when conducting computer-based concept map assessments. Only 24 out of 119 journal articles that assessed computer-based concept maps discussed the usability issue in some way. Nevertheless, our review brings to light the idea that the impact of usability on computer-based concept map assessments is an issue that has received insufficient attention. In addition, usability ensures a suitable interaction between test taker and test device; thus, the training effort required for test use can be reduced if a test's usability is straight forward. Our literature review, however, illustrates that the interplay between usability and test use training has mostly been neglected in current studies. [less ▲] Detailed reference viewed: 379 (32 UL) Forty years on: Childhood intelligence predicts health in middle adulthood.Wrulich, Marius ; ; et alin Health Psychology (2014), 33(3), 292-296 Detailed reference viewed: 360 (26 UL) Domain-general problem solving skills and education in the 21st centuryGreiff, Samuel ; Wüstenberg, Sascha ; et alin Educational Research Review (2014), 13 Detailed reference viewed: 668 (108 UL) Computer-based assessment of Complex Problem Solving in educational contexts and how it is influenced by students’ level of Information and Communication Technology literacyGreiff, Samuel ; Kretzschmar, André ; Müller, Jonas et alin Journal of Educational Psychology (2014) Detailed reference viewed: 595 (111 UL) Predictive validity of tracking decisions: Application of a new validation criterion.Klapproth, Florian ; Krolak-Schwerdt, Sabine ; Hörstermann, Thomas et alin Spiliopoulou, Myra; Schmidt-Thieme, Lars; Janning, Ruth (Eds.) Studies in classification, data analysis, and knowledge organisation: Data Analysis, Machine Learning and Knowledge Discovery. (2014) Detailed reference viewed: 243 (34 UL) Kompetenzmessung im BildungsbereichMartin, Romain ; Greiff, Samuel ; Fischbach, Antoine et alin Steffgen, Georges; Michaux, Gilles; Ferring, Dieter (Eds.) Psychologie in Luxemburg - Ein Handbuch (2014) Detailed reference viewed: 193 (6 UL) What You See Is What You (Don’t) Get: A Comment on Funke’s (2014) Opinion PaperGreiff, Samuel ; Martin, Romain ![]() in Frontiers in Psychology (2014), 5 Detailed reference viewed: 263 (9 UL) HCI Design Methods in CBA: Lessons Learned and Recommendations Based on a Concept Map Use CaseWeinerth, Katja ; Koenig, Vincent ; Rivas, Salvador et alin Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2014 (2014) This paper focuses on the user-centered design of a computer-based assessment (CBA) instrument for knowledge measurement. We describe relevant design steps in general and illustrate them via the design of ... [more ▼] This paper focuses on the user-centered design of a computer-based assessment (CBA) instrument for knowledge measurement. We describe relevant design steps in general and illustrate them via the design of our usability improved CBA concept map instrument (ISO 9241-11, 1998; ISO 9241-210, 2010). We discuss design versus evaluation methods from a human-computer interaction (HCI) perspective and emphasize important design steps relevant for constructing usability improved assessment instruments in educational assessment. As these HCI methods are still seldom applied to CBA, this paper helps alleviate the dearth of literature and guidelines in this domain. Our objective is thus to provide the reader with a series of design recommendations for CBA, as derived both from HCI research; and to summarize lessons learned from our specific CBA design use case. [less ▲] Detailed reference viewed: 243 (15 UL) "My questionnaire is too long!" The assessments of motivational-affective constructs with three-item and single-item measures; ; et al in Contemporary Educational Psychology (2014), 39(3), 188-205 Detailed reference viewed: 390 (44 UL) Do test takers with different language backgrounds take the same C-test? The effect of native language on the validity of C-tests.Reichert, Monique ; Brunner, Martin ; Martin, Romain ![]() in Grotjahn, Rüdiger (Ed.) Der C-Test: Aktuelle Tendenzen/The C-Test: current trends. (2014) Detailed reference viewed: 295 (12 UL) Editorial to the special section Computer-based assessment of cross-curricular skills and processes.Greiff, Samuel ; Martin, Romain ; in Journal of Educational Psychology (2014), 106 Detailed reference viewed: 303 (73 UL) Computer-based assessment of cross-curricular skills and processes. Special section.Greiff, Samuel ; Martin, Romain ; in Journal of Educational Psychology (2014) Detailed reference viewed: 297 (10 UL) Developing number–space associations: SNARC effects using a color discrimination task in 5-year-oldsHoffmann, Danielle ; Hornung, Caroline ; Martin, Romain et alin Journal of Experimental Child Psychology (2013), 116 Human adults’ numerical representation is spatially oriented; consequently, participants are faster to respond to small/large numerals with their left/right hand, respectively, when doing a binary ... [more ▼] Human adults’ numerical representation is spatially oriented; consequently, participants are faster to respond to small/large numerals with their left/right hand, respectively, when doing a binary classification judgment on numbers, known as the SNARC (spatial– numerical association of response codes) effect. Studies on the emergence and development of the SNARC effect remain scarce. The current study introduces an innovative new paradigm based on a simple color judgment of Arabic digits. Using this task, we found a SNARC effect in children as young as 5.5 years. In contrast, when preschool children needed to perform a magnitude judgment task necessitating exact number knowledge, the SNARC effect started to emerge only at 5.8 years. Moreover, the emergence of a magnitude SNARC but not a color SNARC was linked to proficiency with Arabic digits. Our results suggest that access to a spatially oriented approximate magnitude representation from symbolic digits emerges early in ontogenetic development. Exact magnitude judgments, on the other hand, rely on experience with Arabic digits and, thus, necessitate formal or informal schooling to give access to a spatially oriented numerical representation. [less ▲] Detailed reference viewed: 277 (17 UL) |
||