Bitte verwenden Sie diesen Link, um diese Publikation zu zitieren, oder auf sie als Internetquelle zu verweisen: https://hdl.handle.net/10419/308347 
Erscheinungsjahr: 
2024
Schriftenreihe/Nr.: 
IZA Discussion Papers No. 17488
Verlag: 
Institute of Labor Economics (IZA), Bonn
Zusammenfassung: 
Understanding individuals' beliefs, preferences, and motivations is essential in social sciences. Recent technological advancements—notably, large language models (LLMs) for analyzing open-ended responses and the diffusion of voice messaging— have the potential to significantly enhance our ability to elicit these dimensions. This study investigates the differences between oral and written responses to open-ended survey questions. Through a series of randomized controlled trials across three surveys (focused on AI, public policy, and international relations), we assigned respondents to answer either by audio or text. Respondents who provided audio answers gave longer, though lexically simpler, responses compared to those who typed. By leveraging LLMs, we evaluated answer informativeness and found that oral responses differ in both quantity and quality, offering more information and containing more personal experiences than written responses. These findings suggest that oral responses to open-ended questions can capture richer, more personal insights, presenting a valuable method for understanding individual reasoning.
Schlagwörter: 
survey design
open-ended questions
large language models
beliefs
JEL: 
C83
D83
Dokumentart: 
Working Paper

Datei(en):
Datei
Größe
621.95 kB





Publikationen in EconStor sind urheberrechtlich geschützt.