An experimental study of the influence of individual participant characteristics on formal consensus development.
Carpenter, James, Hutchings, Andrew, Raine, Rosalind et al. · International journal of technology assessment in health care · 2007 · DOI
Quick Summary
This study looked at how different types of doctors and healthcare workers rate whether psychological treatments are appropriate for ME/CFS and other chronic conditions. Researchers had 346 people in 20 groups review mental health treatments and rate how suitable they were, testing whether factors like the doctors' specialty, age, and sex changed their opinions.
Why It Matters
For ME/CFS patients, this study is important because it reveals that expert consensus on appropriate treatments depends heavily on who is making the recommendations—particularly whether a professional is trained in general practice versus mental health. Understanding these biases helps patients and advocates recognize why treatment recommendations may vary and why developing balanced expert panels matters for creating trustworthy clinical guidance.
Observed Findings
General practitioners and mental health professionals had the largest differences in their initial ratings and in how much they changed their ratings between discussion rounds.
Women increased their ratings of interventions more than men did between rounds.
Women rated interventions more favorably when assuming ideal resource levels rather than realistic levels; men showed no such difference.
There were statistically significant differences in initial ratings based on both specialty and age groups across different conditions.
Specialty remained the most influential factor even after accounting for other participant characteristics.
Inferred Conclusions
Professional specialty should be treated as a critical determinant when designing consensus panels and interpreting their recommendations.
The composition of expert panels (balanced vs. homogenous by profession) meaningfully influences the conclusions reached about treatment appropriateness.
Demographic factors like sex and age have measurable but smaller effects on clinical rating decisions.
Remaining Questions
Why do general practitioners and mental health professionals differ so substantially in their treatment recommendations for ME/CFS?
What This Study Does Not Prove
This study does not demonstrate whether psychological interventions are actually effective for ME/CFS, nor does it prove that any particular treatment recommendation was correct or incorrect. It only shows that different types of doctors rate interventions differently; it cannot establish whether those differences reflect true clinical differences or professional bias. The study also does not assess patients' experiences with these interventions.
About the PEM badge: “PEM required” means post-exertional malaise was an explicit required diagnostic criterion for participant inclusion in this study — not that PEM was studied, observed, or discussed. Studies using criteria that do not require PEM (e.g. Fukuda, Oxford) are tagged “PEM not required”. How the atlas works →
Contribute
Private, reviewed by a human. Not a public comment thread.