Navigating the fog: the effectiveness of personalised conversational GenAI models for supporting ancient language learning

[thumbnail of Open Access]
Preview
Text (Open Access)
- Published Version
· Available under License Creative Commons Attribution Non-commercial.

Please see our End User Agreement.

It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Ross, E. A. S. ORCID: https://orcid.org/0000-0003-4174-835X and Baines, J. (2025) Navigating the fog: the effectiveness of personalised conversational GenAI models for supporting ancient language learning. AI & Antiquity, 1 (1). pp. 35-52. ISSN 3081-4553 doi: 10.64946/aiantiquity.v1i1.002

Abstract/Summary

Hallucinations (misleading, inaccurate predicted text presented as fact) are a critical problem for using generative artificial intelligence (GenAI) tools to support ancient language teaching and learning. For a teacher, significant editing time is required to correct any inaccuracies or misrepresentations prior to making use of AI-generated content to support their teaching practice. For students, these convincing errors may not be recognised, and this may lead to misconceptions in their knowledge formation. OpenAI and Google released public-facing, customizable conversational AI models which allow users to upload their own datasets to create personalised AI chat agents, known as GPTs (2023) and Gems (2024) respectively. This presents an opportunity for teachers to personalize their own models to streamline their students’ experiences. However, can personalised conversational AI tools provide a fine-tuned experience that reduces the major, problematic ancient history and ancient language hallucinations that we see in standard ChatGPT and Gemini outputs? This paper discusses the creation of a personalised Latin Tutor GPT and Gem through the development of a series of exhaustive Latin vocabulary spreadsheets. We tested these personalised tools against their standard GenAI counterpart to determine if personalisation improved their efficacy and efficiency for supporting ancient language learning. The development of the spreadsheets and testing process both closely addressed current GenAI ethical issues, including copyright, environmental impact, and content restrictions. The results of these tests found that personalised GPTs and Gems made small efficacy and efficiency improvements, but the time and energy required greatly outweighed the results.

Altmetric Badge

Item Type Article
URI https://centaur.reading.ac.uk/id/eprint/124613
Identification Number/DOI 10.64946/aiantiquity.v1i1.002
Refereed Yes
Divisions Arts, Humanities and Social Science > School of Humanities > Classics
Uncontrolled Keywords Ancient Language Learning, Generative Artificial Intelligence, Latin, OpenAI, Gemini, AI Ethics
Publisher Center for Innovation in Ancient Worlds
Download/View statistics View download statistics for this item

Downloads

Downloads per month over past year

University Staff: Request a correction | Centaur Editors: Update this record