Okan Bulut
Biographic Data
| ID | 211316 |
|---|---|
| NAME | Okan Bulut |
| GIVEN NAMES | Okan |
| FAMILY NAME | Bulut |
| SIGNATURE | BULUT O |
| AFFILIATIONS | University of Alberta |
| ORCID | 0000-0001-5853-1267 |
| VERIFIED | Yes |
| TOTAL WORKS | 30 |
| TOTAL CITATIONS | 4 |
| AUTHOR COUNT | 30 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 2014 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 2 |
Preschoolers’ initial planning time on problem-solving performance across task difficulties: Insights from intelligent tutoring mobile application log data
Planning is a critical cognitive ability that emerges during the preschool years and plays a key role in problem-solving. This study investigated the impact of preschool children’s initial planning time on their problem-solving performance across tasks of varying difficulty, using mobile log data from 1,318 children aged 5–6. Three main findings emerged from analyses using linear mixed models (LMM), generalized linear mixed models (GLMM), moderat…
Advancing higher education students’ assessment experiences with conversational agents
Uncovering adults' problem‐solving patterns from process data with hidden Markov model and network analysis
The impact of frequency and stakes of formative assessment on student achievement in higher education: A learning analytics study
Shortening Psychological Scales: Semantic Similarity Matters
In this study, we proposed a novel scale abbreviation method based on sentence embeddings and compared it to two established automatic scale abbreviation techniques. Scale abbreviation methods typically rely on administering the full scale to a large representative sample, which is often impractical in certain settings. Our approach leverages the semantic similarity among the items to select abbreviated versions of scales without requiring respon…
Automated scoring in the era of artificial intelligence: An empirical study with Turkish essays
Automated scoring (AS) has gained significant attention as a tool to enhance the efficiency and reliability of assessment processes. Yet, its application in under-represented languages, such as Turkish, remains limited. This study addresses this gap by empirically evaluating AS for Turkish using a zero-shot approach with a rubric powered by OpenAI's GPT-4o. A dataset of 590 essays written by learners of Turkish as a second language was scored by …
A Psychometric Network Analysis Approach for Detecting Item Wording Effects in Self-report Measures across Subgroups
In this study, we explored psychometric network analysis (PNA) as an alternative method for identifying item wording effects in self-report instruments. We examined the functioning of negatively worded items in the network structures of two math-related scales from the 2019 Trends in International Mathematics and Science Study (TIMSS); Students Like Learning in Mathematics (SLLM); and Students Confident in Mathematics (SCM). We also explored how …
Adaptive Case Study-Mixed Methods Design Practices for Researchers Studying Complex Phenomena
The methodological purpose of this article is to generate practical guidance for researchers studying complex phenomena through an adaptive case study-mixed methods (CS-MM) design. We describe CS-MM design adjustments made in response to our rapidly changeable research conditions that make complex phenomena challenging to study. We leverage Guetterman & Fetters’ (2018) CS-MM design recommendations while discussing specific adaptive design practic…
Group differences in the emotion regulation during test-taking scale: An explanatory item response modeling approach
Standing on the shoulders of giants: Online formative assessments as the foundation for predictive learning analytics models
As universities around the world have begun to use learning management systems (LMSs), more learning data have become available to gain deeper insights into students' learning processes and make data‐driven decisions to improve student learning. With the availability of rich data extracted from the LMS, researchers have turned much of their attention to learning analytics (LA) applications using educational data mining techniques. Numerous LA mod…
Predicting reading comprehension performance based on student characteristics and item properties
Examining adults’ web navigation patterns in multi-layered hypertext environments
Item wording effects in self-report measures and reading achievement: Does removing careless respondents help
Exploring Factors That Affected Student Well-Being during the Covid-19 Pandemic: A Comparison of Data-Mining Approaches
COVID-19-related school closures caused unprecedented and prolonged disruption to daily life, education, and social and physical activities. This disruption in the life course affected the well-being of students from different age groups. This study proposed analyzing student well-being and determining the most influential factors that affected student well-being during the COVID-19 pandemic. With this aim, we adopted a cross-sectional study desi…
Examining the relation between Pass cognitive processes and superior reading and mathematics performance
Although several studies have shown that planning, attention, simultaneous, and successive (PASS) cognitive processes—operationalized with the cognitive assessment system (CAS; Naglieri & Das, 1997)—are significant predictors of academic performance in the general population, little is known about their role among children with superior academic skills. Thus, the purpose of this study was to examine whether PASS processes can predict superior per…
A Polytomous Scoring Approach to Handle Not-Reached Items in Low-Stakes Assessments
In low-stakes assessments, some students may not reach the end of the test and leave some items unanswered due to various reasons (e.g., lack of test-taking motivation, poor time management, and test speededness). Not-reached items are often treated as incorrect or not-administered in the scoring process. However, when the proportion of not-reached items is high, these traditional approaches may yield biased scores and thereby threatening the val…
Toward an Evidence-Based Approach to Building Evaluation Capacity
Organizations are required to evaluate their programs for both learning and accountability purposes, which has increased the need to build their internal evaluation capacity. A remaining challenge is access to tools that lead to valid evidence supporting internal capacity development. The authors share practical insights from the development and use of the Evaluation Capacity Needs Assessment tool and framework and implications for using its data…
Using Data Mining for Rapid Complex Case Study Descriptions: Example of Public Health Briefings During the Onset of the Covid-19 Pandemic
The methodological purpose of this article is to demonstrate how data mining contributes to rapid complex case study descriptions. Our complexity-informed design draws on freely accessible datasets reporting the public health response surrounding the onset of the COVID-19 pandemic in Alberta (Canada) and involves the cross analysis of integrated findings across six periods of fluctuation identified in the initial quantitative phase of a convergen…
An Intelligent Recommender System for Personalized Test Administration Scheduling With Computerized Formative Assessments
The introduction of computerized formative assessments in schools has enabled the monitoring of students’ progress with more flexible test schedules. Currently, the timing and frequency of computerized formative assessments are determined based on districts and school authorities’ agreements with testing organizations, the teachers’ judgment of students’ progress, and grade-level testing guidelines recommended by researchers. However, these pract…
Le sentiment d’appartenance à l’école: Validation d’un modèle théorique prédisant l’engagement et le rendement scolaire en mathématiques d’élèves du secondaire
Le sentiment d'appartenance l'cole : validation d'un modle thorique prdisant l'engagement et le rendement scolaire en mathmatiques d'lves du secondaire Formation et profession 28(2), 2020
Evaluating the Performances of Missing Data Handling Methods in Ability Estimation From Sparse Data
Large amounts of missing data could distort item parameter estimation and lead to biased ability estimates in educational assessments. Therefore, missing responses should be handled properly before estimating any parameters. In this study, two Monte Carlo simulation studies were conducted to compare the performance of four methods in handling missing data when estimating ability parameters. The methods were full-information maximum likelihood (FI…
Achievement may be rooted in teacher expectations: Examining the differential influences of ethnicity, years of teaching, and classroom behaviour
Examining Turkish Adults' Recalled Experiences of Their Father's Presence
The father plays an important role in child development, including during adolescence, in many cultures. To date, research on the impact of father presence (in a household/family) on father-child relationships has been limited, especially in Eastern cultures due to the overwhelming influence of traditional gender role attitudes. The purposes of this study are to record and compare descriptions (i.e., profiles) of the father's presence, and to inv…
Retrofitting Diagnostic Classification Models to Responses From IRT-Based Assessment Forms
Developing a diagnostic tool within the diagnostic measurement framework is the optimal approach to obtain multidimensional and classification-based feedback on examinees. However, end users may seek to obtain diagnostic feedback from existing item responses to assessments that have been designed under either the classical test theory or item response theory frameworks. Retrofitting diagnostic classification models to existing assessments designe…
Procedures to develop a computerized adaptive test to assess patient-reported physical functioning
Adaptive Case Study-Mixed Methods Design Practices for Researchers Studying Complex Phenomena
The methodological purpose of this article is to generate practical guidance for researchers studying complex phenomena through an adaptive case study-mixed methods (CS-MM) design. We describe CS-MM design adjustments made in response to our rapidly changeable research conditions that make complex phenomena challenging to study. We leverage Guetterman & Fetters’ (2018) CS-MM design recommendations while discussing specific adaptive design practic…
Using Data Mining for Rapid Complex Case Study Descriptions: Example of Public Health Briefings During the Onset of the Covid-19 Pandemic
The methodological purpose of this article is to demonstrate how data mining contributes to rapid complex case study descriptions. Our complexity-informed design draws on freely accessible datasets reporting the public health response surrounding the onset of the COVID-19 pandemic in Alberta (Canada) and involves the cross analysis of integrated findings across six periods of fluctuation identified in the initial quantitative phase of a convergen…
Psychometric Evaluation of the Wijma Delivery Expectancy/Experience Questionnaire Version B
Examining the fear of delivery after childbirth is important. The authors' aim is to examine the overall psychometric quality of the Wijma Delivery Expectancy/Experience Questionnaire version B. Reliability and validity of the instrument were evaluated via reliability analysis, exploratory and confirmatory factor analyses, and multidimensional subscore estimation. A six-factor model was proposed to explain instrument results. Factors included con…
Evaluating Measurement Invariance in the Measurement of Developmental Assets in Latino English Language Groups Across Developmental Stages
Noncognitive characteristics are gaining importance in addressing the persistent challenges facing youth in diverse settings. Measurement invariance of two youth developmental assets, Support and Positive Identity, is evaluated across grade levels and English language learner (ELL) subgroups of Latino students in 6th through 12th grade. Explanatory item response modeling is used to evaluate measurement invariance. The measurement of Latino studen…
Multidimensional Extension of Multiple Indicators Multiple Causes Models to Detect DIF
A number of studies have found multiple indicators multiple causes (MIMIC) models to be an effective tool in detecting uniform differential item functioning (DIF) for individual items and item bundles. A recently developed MIMIC-interaction model is capable of detecting both uniform and nonuniform DIF in the unidimensional item response theory (IRT) framework. The goal of the current study is to extend the MIMIC-interaction model for detecting DI…
Differential Performance on National Exams: Evaluating Item and Bundle Functioning Methods using English, Mathematics, and Science Assessments
The purpose of this study is to evaluate two methodological perspectives of test fairness using a national Secondary School Certificate (SSC) examinations. SSC is a suit of multi-subject national qualification tests at Grade 10 level in South Asian countries, such as Bangladesh, India, and Pakistan. Because it is a high-stakes test, the fairness of SSC tests is a major concern among public and educational policy planners. This study is a first at…
Estimating Between-Person and Within-Person Subscore Reliability with Profile Analysis
Subscores are of increasing interest in educational and psychological testing due to their diagnostic function for evaluating examinees' strengths and weaknesses within particular domains of knowledge. Previous studies about the utility of subscores have mostly focused on the overall reliability of individual subscores and ignored the fact that subscores should be distinct and have added value over the total score. This study introduces a profile…
Retrofitting Diagnostic Classification Models to Responses From IRT-Based Assessment Forms
Developing a diagnostic tool within the diagnostic measurement framework is the optimal approach to obtain multidimensional and classification-based feedback on examinees. However, end users may seek to obtain diagnostic feedback from existing item responses to assessments that have been designed under either the classical test theory or item response theory frameworks. Retrofitting diagnostic classification models to existing assessments designe…
Procedures to develop a computerized adaptive test to assess patient-reported physical functioning
Examining Turkish Adults' Recalled Experiences of Their Father's Presence
The father plays an important role in child development, including during adolescence, in many cultures. To date, research on the impact of father presence (in a household/family) on father-child relationships has been limited, especially in Eastern cultures due to the overwhelming influence of traditional gender role attitudes. The purposes of this study are to record and compare descriptions (i.e., profiles) of the father's presence, and to inv…
An Intelligent Recommender System for Personalized Test Administration Scheduling With Computerized Formative Assessments
The introduction of computerized formative assessments in schools has enabled the monitoring of students’ progress with more flexible test schedules. Currently, the timing and frequency of computerized formative assessments are determined based on districts and school authorities’ agreements with testing organizations, the teachers’ judgment of students’ progress, and grade-level testing guidelines recommended by researchers. However, these pract…
Le sentiment d’appartenance à l’école: Validation d’un modèle théorique prédisant l’engagement et le rendement scolaire en mathématiques d’élèves du secondaire
Le sentiment d'appartenance l'cole : validation d'un modle thorique prdisant l'engagement et le rendement scolaire en mathmatiques d'lves du secondaire Formation et profession 28(2), 2020
Evaluating the Performances of Missing Data Handling Methods in Ability Estimation From Sparse Data
Large amounts of missing data could distort item parameter estimation and lead to biased ability estimates in educational assessments. Therefore, missing responses should be handled properly before estimating any parameters. In this study, two Monte Carlo simulation studies were conducted to compare the performance of four methods in handling missing data when estimating ability parameters. The methods were full-information maximum likelihood (FI…
Achievement may be rooted in teacher expectations: Examining the differential influences of ethnicity, years of teaching, and classroom behaviour
Examining the relation between Pass cognitive processes and superior reading and mathematics performance
Although several studies have shown that planning, attention, simultaneous, and successive (PASS) cognitive processes—operationalized with the cognitive assessment system (CAS; Naglieri & Das, 1997)—are significant predictors of academic performance in the general population, little is known about their role among children with superior academic skills. Thus, the purpose of this study was to examine whether PASS processes can predict superior per…
A Polytomous Scoring Approach to Handle Not-Reached Items in Low-Stakes Assessments
In low-stakes assessments, some students may not reach the end of the test and leave some items unanswered due to various reasons (e.g., lack of test-taking motivation, poor time management, and test speededness). Not-reached items are often treated as incorrect or not-administered in the scoring process. However, when the proportion of not-reached items is high, these traditional approaches may yield biased scores and thereby threatening the val…
Toward an Evidence-Based Approach to Building Evaluation Capacity
Organizations are required to evaluate their programs for both learning and accountability purposes, which has increased the need to build their internal evaluation capacity. A remaining challenge is access to tools that lead to valid evidence supporting internal capacity development. The authors share practical insights from the development and use of the Evaluation Capacity Needs Assessment tool and framework and implications for using its data…
Using Data Mining for Rapid Complex Case Study Descriptions: Example of Public Health Briefings During the Onset of the Covid-19 Pandemic
The methodological purpose of this article is to demonstrate how data mining contributes to rapid complex case study descriptions. Our complexity-informed design draws on freely accessible datasets reporting the public health response surrounding the onset of the COVID-19 pandemic in Alberta (Canada) and involves the cross analysis of integrated findings across six periods of fluctuation identified in the initial quantitative phase of a convergen…
Examining adults’ web navigation patterns in multi-layered hypertext environments
Item wording effects in self-report measures and reading achievement: Does removing careless respondents help
Exploring Factors That Affected Student Well-Being during the Covid-19 Pandemic: A Comparison of Data-Mining Approaches
COVID-19-related school closures caused unprecedented and prolonged disruption to daily life, education, and social and physical activities. This disruption in the life course affected the well-being of students from different age groups. This study proposed analyzing student well-being and determining the most influential factors that affected student well-being during the COVID-19 pandemic. With this aim, we adopted a cross-sectional study desi…
Group differences in the emotion regulation during test-taking scale: An explanatory item response modeling approach
Standing on the shoulders of giants: Online formative assessments as the foundation for predictive learning analytics models
As universities around the world have begun to use learning management systems (LMSs), more learning data have become available to gain deeper insights into students' learning processes and make data‐driven decisions to improve student learning. With the availability of rich data extracted from the LMS, researchers have turned much of their attention to learning analytics (LA) applications using educational data mining techniques. Numerous LA mod…
Predicting reading comprehension performance based on student characteristics and item properties
Adaptive Case Study-Mixed Methods Design Practices for Researchers Studying Complex Phenomena
The methodological purpose of this article is to generate practical guidance for researchers studying complex phenomena through an adaptive case study-mixed methods (CS-MM) design. We describe CS-MM design adjustments made in response to our rapidly changeable research conditions that make complex phenomena challenging to study. We leverage Guetterman & Fetters’ (2018) CS-MM design recommendations while discussing specific adaptive design practic…
Advancing higher education students’ assessment experiences with conversational agents
Uncovering adults' problem‐solving patterns from process data with hidden Markov model and network analysis
Computer Science (22 works) · Psychology (21 works) · Mathematics (11 works) · Mathematics education (11 works) · Statistics (9 works) · Engineering (8 works) · Psychometric Methodologies and Testing (8 works) · Psychometrics (8 works) · Item response theory (7 works) · Online Learning and Analytics (7 works)