Exploring the validity of sentiment analysis in psychotherapy

What happens if you apply the Multilingual Language Model Toolkit for Sentiment Analysis (XLM-T), “a transformer-based NLP model derived from the Cross-lingual Language Model based on RoBERTa”, to psychotherapy transcripts? Eberhardt et al. (2024) investigate. Here’s a slightly simplified Table 1, showing correlations between positive and negative sentiment and a patient-reported emotions scale. Green gives between-patient correlations and pink within-patient across sessions. Note the wide confidence intervals.

Eberhardt, S. T., Schaffrath, J., Moggia, D., Schwartz, B., Jaehde, M., Rubel, J. A., Baur, T., AndrΓ©, E., & Lutz, W. (2024). Decoding emotions: Exploring the validity of sentiment analysis in psychotherapy. Psychotherapy Research.