Development and validation of the prompt engineering competence scale (Pecs)
Bibliographic Data
| ID | 21500818 |
|---|---|
| Authors | Omer Gibreel (0000-0003-3280-8293, Gulf University for Science and Technology), İbrahim Arpacı (0000-0001-6513-4569, Gulf University for Science and Technology, corresponding author) |
| Year | 2025 |
| Publication date | 2025-04-24 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Information Development (JOURNAL) |
| Journal identifiers | ISSN: 0266-6669 • E-ISSN: 1741-6469 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/02666669251336455 |
| OpenAlex | W4409776565 |
| Language | EN |
| Citations received | 2 |
| References cited | 31 |
In a digitized world where artificial intelligence (AI) is rapidly infiltrating every aspect of our lives, it is crucial to utilize generative AI tools effectively. While the demand for AI technologies is increasing rapidly, challenges arise in their practical use. Accordingly, this study aims to develop a novel scale to measure users’ level of competence in prompt engineering. The psychometric properties of the Prompt Engineering Competence Scale (PECS) were evaluated using data obtained from 437 users. An exploratory factor analysis was performed to investigate the factor structure of the PECS. The results revealed a one-factor structure with a Cronbach's alpha value of 0.92. Confirmatory factor analysis results indicated that the one-factor model provided a good fit to the data. In the final stage, the item discrimination index was calculated to improve further the reliability and validity of the newly developed scale. The results suggest that the scale items were able to reliably discriminate users. These findings collectively indicate that the PECS is a valid and reliable instrument for measuring users’ level of competence in prompt engineering
Data science · Engineering ethics · Engineering management · Geography · Knowledge management · Process management · Systems engineering · Competency Development and Evaluation · Computer Science · Engineering · Engineering Education and Curriculum Development · Psychology · Social Psychology · Technology Assessment and Management
Scale Development
Embracing the future of Artificial Intelligence in the classroom
Artificial intelligence self-efficacy
AI literacy and its implications for prompt engineering strategies
Mails - Meta AI literacy scale
Pre-train, Prompt, and Predict
Digital Literacy
Impact of artificial intelligence-enabled job characteristics and perceived substitution crisis on innovative work behavior of employees from high-tech firms
Development of the cybersecurity scale (CS-S)
Supporting digitally enhanced learning through measurement in higher education
Measuring user competence in using artificial intelligence
The Essentials of Factor Analysis
Coefficient alpha and the internal structure of tests
Subjective measures of well-being
| Citations per year | 2 |
|---|---|
| Citation span | 2025 - 2026 (2) |
| Highly cited | No |