LLMs Predict Social Science Experiment Outcomes, Nature Study Shows
A new study published in Nature finds that large language models like GPT-4 can predict the results of social science experiments with surprising accuracy. Researchers fed the models descriptions of experiments from published papers and asked them to forecast outcomes, achieving performance comparable to human experts. The models excelled in domains like psychology and economics, though they struggled with complex real-world interventions. This suggests LLMs can serve as rapid, low-cost hypothesis generators, potentially accelerating the pace of social science research.