lnu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
How to Model and Interpret Cross-Lagged Effects in Psychotherapy Mechanisms of Change Research: A Comparison of Multilevel and Structural Equation Models
Linnaeus University, Faculty of Health and Life Sciences, Department of Psychology. Linköping University, Sweden.ORCID iD: 0000-0002-2486-6859
Weill Med Coll, USA.ORCID iD: 0000-0003-1573-5715
Justus Liebig Univ Giessen, Germany.ORCID iD: 0000-0002-9625-6611
2022 (English)In: Journal of Consulting and Clinical Psychology, ISSN 0022-006X, E-ISSN 1939-2117, Vol. 90, no 5, p. 446-458Article in journal (Refereed) Published
Abstract [en]

Objective: Modeling cross-lagged effects in psychotherapy mechanisms of change studies is complex and requires careful attention to model selection and interpretation. However, there is a lack of field-specific guidelines. We aimed to (a) describe the estimation and interpretation of cross lagged effects using multilevel models (MLM) and random-intercept cross lagged panel model (RI-CLPM); (b) compare these models' performance and risk of bias using simulations and an applied research example to formulate recommendations for practice. Method: Part 1 is a tutorial focused on introducing/describing dynamic effects in the form of autoregression and bidirectionality. In Part 2, we compare the estimation of cross-lagged effects in RI-CLPM, which takes dynamic effects into account, with three commonly used MLMs that cannot accommodate dynamics. In Part 3, we describe a Monte Carlo simulation study testing model performance of RI-CLPM and MLM under realistic conditions for psychotherapy mechanisms of change studies. Results: Our findings suggested that all three MLMs resulted in severely biased estimates of cross-lagged effects when dynamic effects were present in the data, with some experimental conditions generating statistically significant estimates in the wrong direction. MLMs performed comparably well only in conditions which are conceptually unrealistic for psychotherapy mechanisms of change research (i.e., no inertia in variables and no bidirectional effects). Discussion: Based on conceptual fit and our simulation results, we strongly recommend using fully dynamic structural equation modeling models, such as the RI-CLPM, rather than static, unidirectional regression models (e.g., MLM) to study cross-lagged effects in mechanisms of change research. What is the public health significance of this article? We describe the differences between multilevel and structural equation modeling in the study of mechanisms of change in psychotherapy research. We argue that the common application of multilevel modeling assumes that there is no within-patient inertia in predictor or outcome variable, and the outcome variable does not impact the predictor, both of which seem highly unrealistic in psychotherapy research. Moreover, we demonstrate that violations of these assumptions may lead to severe bias in estimated coefficients, resulting in inaccurate recommendations for clinical practice. Thus, we recommend researchers to use structural equation modeling to estimate the effects of proposed change mechanisms over time.

Place, publisher, year, edition, pages
American Psychological Association (APA), 2022. Vol. 90, no 5, p. 446-458
Keywords [en]
process research, statistical methods, mechanisms of change, outcome research, prediction models
National Category
Psychology
Research subject
Social Sciences, Psychology
Identifiers
URN: urn:nbn:se:lnu:diva-114105DOI: 10.1037/ccp0000727ISI: 000798613900011PubMedID: 35604748Scopus ID: 2-s2.0-85130466663OAI: oai:DiVA.org:lnu-114105DiVA, id: diva2:1670543
Available from: 2022-06-16 Created: 2022-06-16 Last updated: 2022-10-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textPubMedScopus

Authority records

Falkenström, Fredrik

Search in DiVA

By author/editor
Falkenström, FredrikSolomonov, NiliRubel, Julian A.
By organisation
Department of Psychology
In the same journal
Journal of Consulting and Clinical Psychology
Psychology

Search outside of DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 265 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf