Please use this identifier to cite or link to this item: https://hdl.handle.net/10419/307995 
Year of Publication: 
2024
Citation: 
[Journal:] Journal of Documentation [ISSN:] 1758-7379 [Volume:] 81 [Issue:] 7 [Publisher:] Emerald [Place:] Bingley [Year:] 2024 [Pages:] 18-30
Publisher: 
Emerald, Bingley
Abstract: 
Purpose We compare human intelligence to artificial intelligence (AI) in the choice of appropriate Journal of Economic Literature (JEL) codes for research papers in economics. Design/methodology/approach We compare the JEL code choices related to articles published in the recent issues of the Journal of Economic Literature and the American Economic Review and compare these to the original JEL code choices of the authors in earlier working paper versions and JEL codes recommended by various generative AI systems (OpenAI’s ChatGPT, Microsoft’s Copilot, Google’s Gemini) based on the abstracts of the articles. Findings There are significant discrepancies and often limited overlap between authors’ choices of JEL codes, editors’ choices as well as the choices by contemporary widely used AI systems. However, the observations suggest that generative AI can augment human intelligence in the micro-task of choosing the JEL codes and, thus, save researchers time. Research limitations/implications Rapid development of AI systems makes the findings quickly obsolete. Practical implications AI systems may economize on classification costs and (semi-)automate the choice of JEL codes by recommending the most appropriate ones. Future studies may apply the presented approach to analyze whether the JEL code choices between authors, editors and AI systems converge and become more consistent as humans increasingly interact with AI systems. Originality/value We assume that the choice of JEL codes is a micro-task in which boundedly rational decision-makers rather satisfice than optimize. This exploratory experiment is among the first to compare human intelligence and generative AI in choosing and justifying the choice of optimal
Subjects: 
Artificial intelligence
Large language models
Search costs
Bounded rationality
JEL: 
D83
D81
C88
A14
A11
Persistent Identifier of the first edition: 
Creative Commons License: 
cc-by Logo
Document Type: 
Article
Document Version: 
Published Version
Appears in Collections:

Files in This Item:
File
Size





Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.