Hassan Shaibah
Biographic Data
| ID | 9676605 |
|---|---|
| NAME | Hassan Shaibah |
| GIVEN NAMES | Hassan |
| FAMILY NAME | Shaibah |
| SIGNATURE | SHAIBAH H |
| AFFILIATIONS | Alfaisal University |
| ORCID | 0000-0002-3575-6460 |
| VERIFIED | Yes |
| TOTAL WORKS | 1 |
| TOTAL CITATIONS | 0 |
| WORKS AS AUTHOR | 1 |
| WORKS AS EDITOR | 0 |
| FIRST PUBLICATION YEAR | 2026 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 0 |
Agreement, calibration, and failure of three large language models as high-stakes multimodal ospe graders
Background Medical education faces increasing demand for scalable grading solutions. Large language models have been proposed as automated graders for high-stakes assessments, but evidence for their reliability in multimodal practical examinations remains limited.Methods This retrospective inter-rater reliability study compared three LLMs: ChatGPT-4o, Gemini 2.5 Flash, and Claude 3.5 Haiku with original human reference scores on 19 integrated ana…
No prominent works on this page.
Agreement, calibration, and failure of three large language models as high-stakes multimodal ospe graders
Background Medical education faces increasing demand for scalable grading solutions. Large language models have been proposed as automated graders for high-stakes assessments, but evidence for their reliability in multimodal practical examinations remains limited.Methods This retrospective inter-rater reliability study compared three LLMs: ChatGPT-4o, Gemini 2.5 Flash, and Claude 3.5 Haiku with original human reference scores on 19 integrated ana…
Artificial Intelligence in Healthcare and Education (1 work) · Categorical variable (1 work) · Clinical Reasoning and Diagnostic Skills (1 work) · Correlation (1 work) · Human reliability (1 work) · Innovations in Medical Education (1 work) · Inter-rater reliability (1 work) · Intraclass correlation (1 work) · Summative assessment (1 work)