Validating process variables of sourcing in an assessment of multiple document comprehension
Dados Bibliográficos
BACKGROUND: With digital technologies, competence assessments can provide process data, such as mouse clicks with corresponding timestamps, as additional information about the skills and strategies of test takers. However, in order to use variables generated from process data sensibly for educational purposes, their interpretation needs to be validated with regard to their intended meaning. AIMS: This study seeks to demonstrate how process data from an assessment of multiple document comprehension can be used to represent sourcing, which summarizes activities for the consideration of the origin and intention of documents. The investigated process variables were created according to theoretical assumptions about sourcing, and systematically tested for differences between persons, units (i.e., documents and items), and properties of the test administration. SAMPLE: The sample included 310 German university students (79.4% female), enrolled in several bachelor's or master's programmes of the social sciences and humanities. METHODS: Regarding the hierarchical data structure, the hypotheses were analysed with generalized linear mixed models (GLMM). RESULTS: The results mostly revealed expected differences between individuals and units. However, unexpected effects of the administered order of units and documents were detected. CONCLUSIONS: The study demonstrates the theory-informed construction of process variables from log-files and an approach for empirical validation of their interpretation. The results suggest that students apply sourcing for different reasons, but also stress the need of further validation studies and refinements in the operationalization of the indicators investigated
Competence (human resources) · Comprehension · Operationalization · Process (computing) · Sample (material) · Test (biology) · Computer Science · Educational Strategies and Epistemologies · Psychology · Psychometric Methodologies and Testing · Social Psychology · Student Assessment and Feedback
Narratives and Their Impact on Students’ Information Seeking and Critical Online Reasoning in Higher Education Economics and Medicine
Assessing University Students' Critical Online Reasoning Ability
Einschätzungen von Textunterschieden durch Lehramtsstudent*innen
Fostering multiple document comprehension
The effects of reading prompts and of post-reading generative learning tasks on multiple document integration
First among equals
A systematic review of the use of log-based process data in computer-based assessments
Linking self-report and process data to performance as measured by different assessment types
Critical Handling of Online Information by Prospective Teachers
Who benefits motivationally? How the direction of performance feedback affects feedback perception and motivation to improve multiple document comprehension
Entry Assessment of Student Learning Preconditions in Higher Education
Automated and controlled processes in comprehending multiple documents
Weighted Likelihood Estimation of Ability in Item Response Theory
Validating the Interpretations and Uses of Test Scores
Improving Students' Ability to Identify and Use Source Information
Fitting Linear Mixed-Effects Models Using lme4
Thanks coefficient alpha, we’ll take it from here.
Historical problem solving
Source Evaluation, Comprehension, and Learning in Internet Science Inquiry Tasks
Heuristic Decision Making
| Obras citantes distintas | 12 |
|---|---|
| Citações por ano | 2 |
| Intervalo de citações | 2020 - 2026 (7) |
| Velocidade de citação | current |
| Altamente citado | Não |
| Tipos de citação | Neutras: 12 |