Comparative analysis of artificial intelligence-driven assistance in diverse educational queries
ChatGPT vs. Google Bard
Bibliographic Data
| ID | 22162178 |
|---|---|
| Authors | Mohammad Al Mashagbeh (0000-0002-0461-3299, University of Jordan, corresponding author), Latefa Ali Dardas (0000-0001-5437-4778, University of Jordan), Latefa Dardas, Heba Alzaben (0000-0001-6439-0384, King Hussein Cancer Center), Amjad Alkhayat (Al-Balqa Applied University) |
| Year | 2024 |
| Volume | 9 |
| Publication date | 2024-09-26 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Frontiers in Education (JOURNAL) |
| Journal identifiers | ISSN: 2504-284X • E-ISSN: 2504-284X |
| Publisher | Frontiers Media SA (PUBLISHER • CH) |
| DOI | 10.3389/feduc.2024.1429324 |
| OpenAlex | W4402870273 |
| Language | EN |
| Citations received | 1 |
| References cited | 30 |
Artificial intelligence tools are rapidly growing in education, highlighting the imperative need for a thorough and critical evaluation of their performance. To this aim, this study tests the effectiveness of ChatGPT and Google Bard in answering a range of questions within the engineering and health sectors. True/false, multiple choice questions (MCQs), matching, short answer, essay, and calculation questions are among the question types investigated. Findings showed that ChatGPT 4 surpasses both ChatGPT 3.5 and Google Bard in terms of creative problem-solving and accuracy across various question types. The highest accuracy achieved by ChatGPT 4 was in true/false questions, reaching 97.5%, while its least accurate performance was noted in calculation questions with an accuracy of 82.5%. Prompting both ChatGPT and Google Bard to provide short responses apparently prevented them from hallucinating with unrealistic or nonsensical responses. The majority of the problems for which ChatGPT and Google Bard provided incorrect answers demonstrated a correct problem-solving approach; however, both AI models struggled to accurately perform simple calculations. In MCQs related to health sciences, ChatGPT seemed to have a challenge in discerning the correct answer among several plausible options. While all three tools managed the essay questions competently, avoiding any blatantly incorrect responses (unlike with other question types), some nuanced differences were noticed. ChatGPT 3.5 consistently adhered more closely to the essay prompts, providing straightforward and essential responses, while ChatGPT 4 demonstrated superiority over both models in terms of adaptability. ChatGPT4 fabricated references, creating nonexistent authors and research titles in response to prompts for sources. While utilizing AI in education holds a promise, even the latest and most advanced versions of ChatGPT and Google Bard were not able to accurately answer all questions. There remains a significant need for human cognitive skills and further advancements in AI capabilities
Computer security · Data science · Information retrieval · Intelligence analysis · World Wide Web · Artificial Intelligence in Healthcare and Education · Computer Science · COVID-19 diagnosis using AI · Privacy-Preserving Technologies in Data · Artificial Intelligence
Transforming Education
Survey of Hallucination in Natural Language Generation
Engineering Education in the Era of ChatGPT
Artificial Intelligence in Education
Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education
ChatGPT
Performance of ChatGPT on USMLE
ChatGPT performance on multiple choice question examinations in higher education. A pragmatic scoping review
| Citations per year | 1 |
|---|---|
| Citation span | 2025 - 2025 (1) |
| Highly cited | No |