LLMs in qualitative psychology
Emerging applications of large language models in qualitative psychological research methodology as well as the critics.
Morgan, David L. (2023)
ChatGPT reproduces concrete qualitative themes well but misses subtler interpretive insights from manual analysis.
This study tests whether ChatGPT can reanalyze qualitative datasets without the labor-intensive process of manual coding. Across two previously analyzed datasets, it recreated concrete, descriptive themes reasonably well but was less able to identify subtle interpretive themes. The results suggest AI can reduce effort in parts of qualitative analysis, while reinforcing that human judgment remains essential within the broader analytic process.
Using ChatGPT to reanalyze two previously coded qualitative datasets and comparing its themes with the original analyses.
Basic familiarity with qualitative research and thematic analysis is helpful.
One of the first honest head-to-head tests of ChatGPT against human thematic analysis.
— ES