Validated Variational Inference via Practical Posterior Error Bounds

in Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics (AISTATS) (2020, June)

Validating Brouwer's Continuity Principle for Numbers Using Named Exceptions

in Mathematical Structures in Computer Science (2017)

Validating PISA 2015 collaborative problem solving by face-to-face, self-, and teacher report collaboration measures.

Scientific Conference (2018, April)

Validating the PISA 2015 collaborative problem solving approach

Poster (2015, September)

Validation and Psychometric Analysis of 32 cognitive item models spanning Grades 1 to 7 in the mathematical domain of numbers & operations

Scientific Conference (2022, November)

Today’s educational field has a tremendous hunger for valid and psychometrically sound items to reliably track and model students’ learning processes. Educational large-scale assessments, formative ... [more ▼]

Today’s educational field has a tremendous hunger for valid and psychometrically sound items to reliably track and model students’ learning processes. Educational large-scale assessments, formative classroom assessment, and lately, digital learning platforms require a constant stream of high-quality, and unbiased items. However, traditional development of test items ties up a significant amount of time from subject matter experts, pedagogues and psychometricians and might not be suited anymore to nowadays demands. Salvation is sought in automatic item generation (AIG) which provides the possibility of generating multiple items within a short period of time based on the development of cognitively sound item templates by using algorithms (Gierl & Haladyna, 2013; Gierl et al., 2015). The present study psychometrically analyses 35 cognitive item models that were developed by a team of national subject matter experts and psychometricians and then used for algorithmically producing items for the mathematical domain of numbers & shapes for Grades 1, 3, 5, and 7 of the Luxembourgish school system. Each item model was administered in 6 experimentally varied versions to investigate the impact of a) the context the mathematical problem was presented in, and b) problem characteristics which cognitive psychology identified to influence the problem solving process. Based on samples from Grade 1 (n = 5963), Grade 3 (n = 5527), Grade 5 (n = 5291), and Grade 7 (n = 3018) collected within the annual Épreuves standardisées, this design allows for evaluating whether psychometric characteristics of produced items per model are a) stable, b) can be predicted by problem characteristics, and c) are unbiased towards subgroups of students (known to be disadvantaged in the Luxembourgish school system). After item calibration using the 1-PL model, each cognitive model was analyzed in-depth by descriptive comparisons of resulting IRT parameters, and the estimation of manipulated problem characteristics’ impact on item difficulty by using the linear logistic test model (LLTM, Fischer, 1972). Results are truly promising and show negligible effects of different problem contexts on item difficulty and reasonably stable effects of altered problem characteristics. Thus, the majority of developed cognitive models could be used to generate a huge number of items (> 10.000.000) for the domain of numbers & operations with known psychometric properties without the need for expensive field-trials. We end with discussing lessons learned from item difficulty prediction per model and highlighting differences between the Grades. References: Fischer, G. H. (1973). The linear logistic test model as an instrument in educational research. Acta Psychologica, 36, 359-374. Gierl, M. J., & Haladyna, T. M. (Eds.). (2013). Automatic item generation: Theory and practice. New York, NY: Routledge. Gierl, M. J., Lai, H., Hogan, J., & Matovinovic, D. (2015). A Method for Generating Educational Test Items That Are Aligned to the Common Core State Standards. Journal of Applied Testing Technology, 16(1), 1–18. [less ▲]

Validation and verification in domain-specific modeling method engineering: an integrated life-cycle view

in Software and Systems Modeling (2022)

Validation d’une typologie pour l’étude des dispositifs hybrides

in Education et Formation (n.d.)

Validation française de l’échelle de réactions et de buts liés à la colère (RBC)

in Encéphale (L') (2010), 36(3), 202-211

L’étude présente la validation française d’une échelle allemande (AERZ) [Diagnostica 49 (2003) 97–109, révisée Eur J Pers (2009)], évaluant la régulation de la colère. Cet instrument mesure sept réactions ... [more ▼]

L’étude présente la validation française d’une échelle allemande (AERZ) [Diagnostica 49 (2003) 97–109, révisée Eur J Pers (2009)], évaluant la régulation de la colère. Cet instrument mesure sept réactions et sept buts liés à la colère (RBC). L’apport principal de cette échelle est la mise en évidence des dimensions réactionnelles et intentionnelles lors de la régulation de la colère. Au-delà d’un panel de réactions fonctionnelles, voire dysfonctionnelles, la RBC revient sur les buts offensifs et défensifs associés à l’émotion de la colère. La version française adaptée a été administrée à un échantillon d’étudiants (n = 184). La structure factorielle de la version originale a en grande partie pu être retrouvée avec des consistances internes satisfaisantes pour les différentes dimensions. Globalement, les résultats obtenus attestent la validité, la fidélité et la sensibilité des construits mesurés par la RBC. Cette validation offre, en particulier dans le contexte français, un inventaire multidimensionnel permettant d’étudier les réactions et les buts liés à la colère, par exemple en testant l’efficacité d’interventions de régulation de la colère ou en tant que diagnostic. [less ▲]

Validation of a Chinese version of the Geriatric Anxiety Scale among community-dwelling older adults in mainland China.

in Journal of Cross-Cultural Gerontology (2017), 32

Validation of a Parkinson's disease questionnaire-39-based functional mobility composite score (FMCS) in people with Parkinson's disease.

in Parkinsonism & related disorders (2023), 112

INTRODUCTION: Functional mobility is an important outcome for people with Parkinson's disease (PwP). Despite this, there is no established patient-reported outcome measure that serves as a gold standard ... [more ▼]

INTRODUCTION: Functional mobility is an important outcome for people with Parkinson's disease (PwP). Despite this, there is no established patient-reported outcome measure that serves as a gold standard for assessing patient-reported functional mobility in PwP. We aimed to validate the algorithm calculating the Parkinson's Disease Questionnaire-39 (PDQ-39) based Functional Mobility Composite Score (FMCS). METHODS: We designed a count-based algorithm to measure patient-reported functional mobility in PwP from items of the PDQ-39 subscales mobility and activities of daily living. Convergent validity of the algorithm calculating the PDQ-39-based FMCS was assessed using the objective Timed Up and Go (n = 253) and discriminative validity was assessed by comparing the FMCS with patient-reported (MDS-UPDRS II) and clinician-assessed (MDS-UPDRS III) motor symptoms as well as between disease stages (H&Y) and PIGD phenotypes (n = 736). Participants were between 22 and 92 years old, with a disease duration from 0 to 32 years and 64.9% in a H&Y 1-2 ranging from 1 to 5. RESULTS: Spearman correlation coefficients (r(s)) ranging from -0.45 to -0.77 (p < 0.001) indicated convergent validity. Hence, a t-test suggested sufficient ability of the FMCS to discriminate (p < 0.001) between patient-reported and clinician-assessed motor symptoms. More specifically, FMCS was more strongly associated with patient-reported MDS-UPDRS II (r(s) = -0.77) than clinician-reported MDS-UPDRS III (r(s) = -0.45) and can discriminate between disease stages as between PIGD phenotypes (p < 0.001). CONCLUSION: The FMCS is a valid composite score to assess functional mobility through patient reports in PwP for studying functional mobility in studies using the PDQ-39. [less ▲]