Why patients should not enroll in a clinical trial of video gaming treatment for chronic fatigue syndrome

xboxIf I were a patient with with chronic fatigue syndrome/myalgic Encephalomyelitis (CFS/ME), I would not consent to be in a clinical trial of active video gaming for adults. I would consider withdrawing my consent if I had already provided it.

Either decision would be within my rights. I would be acting for myself, but also out of concern for the patient community.

But then again, saying no would mean I would miss dancin’ up with storm with Kinect Dance Central or being all I can be in the endless competition of  Sports Rivals.

  • Enrollment has begun for a clinical trial evaluating a treatment for chronic fatigue syndrome, but important details that should have been set remained ill-defined.
  • The trial is scientifically unsound, likely to contribute misinformation to the existing scientific literature, and has unresolved safety concerns. Recruitment began without patients having had an adequate say.
  • Participation in a clinical trial is not a responsibility that patients must accept. It’s a choice, a gift from them. Consenting to being in a clinical trial often involves patients assuming considerable burden with the hope that their participation will benefit others. Under the Declaration of Helsinki, patients can only be enrolled in clinical trials with their fully informed consent based on full consideration of risks and benefits.
  • Patients need to understand their basic rights and insist on active participation in the planning and design of clinical trials, as well as the analysis, interpretation and dissemination of results. Patients need to be prepared to refuse to consent to a clinical trial or to leave one when these conditions are not met.

An interview with the trial’s principal investigator is here. It raised serious concerns.

Thanks to Sasha Nimmo [I recommend following@sashanimmo on Twitter] for blogging about the opening of enrollment for this trial, interviewing the principal investigator, and providing some invaluable links.

The trial as summarized in the published registration:

Chronic Fatigue Syndrome/ Myalgic Encephalomyelitis (CFS/ME) is characterised by profound and debilitating exhaustion, resulting in chronic physical inactivity. The detrimental effects of physical inactivity, potentially related to inflammatory pathways (allostatic load) and the body’s ability to cope with stress, further compound the health risk of the disease. The aetiology of CFS/ME is unclear, and recent research has focussed unsuccessfully on individual inflammatory and immune biomarkers. Cumulative biomarkers such as the allostatic load index have stronger predictive power; enhancing our understanding of factors related to CFS/ME. To improve the health of people with CFS/ME and fill these knowledge gaps, this project will conduct a novel intervention using active video gaming to explore the relationships between allostatic load and physical activity in people with CFS/ME.
1. To investigate if active video gaming is an effective management strategy to increase the physical activity levels of adults with CFS/ME
2. To investigate the relationship between allostatic load and physical activity in people with CFS/ME
3. To determine the feasibility and acceptability of active video gaming as a management strategy to increase physical activity levels in adults with CFS/ME

The registration does not specify the video game patients to which patients will be randomized. However, in the interview with Sasha Nimmo, the investigator described it as:

A dance-based game called Kinect Dance Central and a sports game called Sports Rivals. These were chosen for pragmatic reasons, they are off-the-shelf easily available games, and after informal consultation with some adults of varying ages and genders with CFS, a preference to sporting and dance-type games was indicated.

Kinect-Demokinect sports rivalsHmm, I would love to see a record of the deliberations out of which this choice of games emerged, how many patients were involved and with what say.

It boggles my mind to imagine patients who actually suffers from ME dancing up a storm with Kinect Direct Center or becoming the “champion they were meant to be in an ever-evolving sports competition”  of Sports Rivals.

Why trial registration is important.

 Trial registrations commits investigators in advance of recruiting for a trial to particular details of the trial, including entry and exclusion criteria, procedures, sample size, primary and secondary outcomes, and key data analyses.

An adequate registration requires all these elements to be clearly specified. When they are not, or when the investigators subsequently ignore the registration, there is heightened risk of selective reporting, bias, and the dumping of misleading information into the scientific literature. Poorly defined trial registrations or their simply ignored by investigators contribute to an untrustworthy literature that communicates an exaggerations of the effectiveness of interventions that would be obtained in clinical practice.

When investigators do not adhere to a well-defined trial registration, they put patients, providers, and policymakers at risk of bad decisions based on poor quality data. Patients may be harmed by what they thought had been established scientifically as a safe, effective treatment.

Scientific Concerns.

The investigators have an inadequate idea of who will participate and how they will be described for clinical and scientific purposes.

 The trial registration does not provide scientifically and clinically useful inclusion criteria. What the principal investigator said in an interview worried me:

 The inclusion criteria for the study stipulate participants will need to have been diagnosed with CFS by a medical specialist and they will be requested to report which criteria were used for their diagnosis. Diagnostic uncertainty is an issue that has surrounded CFS research for some time, and unfortunately there still does not seem to be any consensus agreement. The inclusion criteria were designed to take a pragmatic approach which would provide the opportunity for sub-group analyses at the end of the study to determine whether diagnostic criteria were related to intervention outcomes.

This leaves basic entry criteria undefined. This being left open gives investigators an opportunity to exaggerate the effectiveness of their intervention at the end by making decisions about lumping and splitting of patients after they have already seen their outcome data and picking what works best.

 This looseness in describing entry criteria occurs against the backdrop of considerable confusion in Australia and misdiagnosis of persons suspected of having chronic fatigue syndrome/ myalgic encephalomyelitis. As many as two in five patients who are diagnosed by clinicians do not actually meeting the Fukuda chronic fatigue syndrome definition (CFS) or the International Consensus Criteria for Myalgic Encephalomyelitis (ICC ME).

 A recent article in the journal Clinical Epidemiology  reported:

A total of 535 patients diagnosed with CFS/ME by a primary care physician were identified. Of these, 30.28% met Fukuda criteria. A further 31.96% met both Fukuda criteria and International Consensus Criteria. There were 14.58% reporting chronic fatigue but did not meet criteria for CFS/ME and 23.18% were considered noncases due to exclusionary conditions. Within those meeting CFS/ME criteria, the most common events prior to illness included cold or flu, gastrointestinal illness, and periods of undue stress. Of the 60 symptoms surveyed, fatigue, cognitive, and short-term memory symptoms, headaches, muscle and joint pain, unrefreshed sleep, sensory disturbances, muscle weakness, and intolerance to extremes of temperature were the most commonly occurring symptoms (reported by more than two-thirds of patients). Significant differences in symptom occurrence between Fukuda- and International Consensus Criteria-defined cases were also identified.

Such a mixed bag of patients with unvalidated diagnoses will pose serious problems for any generalizing beyond the immediate sample. A sample collected elsewhere would very likely have a different case mix. Conclusions from this study would not hold.

Any generalizations about the whole sample would represent inaccurate portrayals of the patients within particular subgroups that are defined by specific diagnostic criteria.

No power analysis  [What is that?] is given for the particular recruitment goal of 30 patients stated in the trial registration. A sample of 30 means that 15 patients would be randomized to immediate receipt of the intervention and 15 would be placed on a waiting list. This would be a grossly underpowered trial, which some would argue in itself poses serious scientific and ethical problems.

The investigators’ post-hoc sorting of patients into subgroups would mean much smaller groups than the already small total sample of 30 would be examined, producing statistically meaningless results.

This trial would be a waste of resources and the invalidity of the results would mean that the efforts of patients who had consented to participate were squandered.

Data will be analyzed for a 12 month follow-up, but the study is randomized only for six months.

The principal investigator said in the interview:

The pilot study is designed so that there is a 6 months comparison of the intervention to control and after that time the waitlisted control group will then participate in the intervention for the final six months.

The principal investigator described the clinical trial as only a pilot study, but it is not described that way in the trial registration. Instead, it is clearly aiming to introduce an estimate of the efficacy of the intervention into the literature.

The primary outcome will be assessed at 12 months. However, there is no control group at that point, and so interpretation will be made without the benefit of a comparison. The difficulty that this poses is that any change from 6 to 12 months will be attributed to the intervention, whereas some or all of it of it might be due to changes that would occur in the absence of intervention or by patients remaining in routine care.

Safety concerns.

 The principal investigator seems unaware of the dangers posed to patients by overexertion.

 The principal investigator stated:

 Unfortunately, the issues surrounding the PACE trial have clouded some people’s thoughts regarding the benefit of physical activity for people with chronic conditions such as people with CFS. This is potentially detrimental given the indisputable research surrounding the health benefits of physical activity.

“Indisputable?” I worry what the investigator means by issues surrounding the PACE trial being ‘clouding some people’s thoughts’. If the investigator rejects the serious criticisms that have been leveled against the PACE trial and its investigators, I don’t think they should expect much patient participation.

The investigator group does not grasp the understandable concerns that patients share with researchers like myself and many others about the results of the PACE trial being fatally flawed.

 Moreover, the statements concerning “indisputable research concerning the health benefits of physical activity” is a general statement that is misleading when applied to chronic fatigue syndrome/ myalgic Encephalomyelitis.

The investigator may not be sufficiently medically informed about the condition to anticipate and respond to likely serious adverse events.

The trial registration had conveyed a bias against construing CFS/ME as a physical health condition, rather than a mental health condition. Maybe that bias is now coming home to roost.

The aetiology of CFS/ME is unclear, and recent research has focussed unsuccessfully on individual inflammatory and immune biomarkers.

“Unsuccessfully?” How about the ineffectiveness and harm of treating CFS/ME as a mental disorder with cognitive behavioral therapy and graded exercise therapy?

If I were a patient with ME, I would worry about being harmed by the exercise required for participation in the trial and for the trial team being ill-prepared to respond appropriately. Given the statements that were made in the interview by the principal investigator, I’ve wonder if the consenting process for patients involves accurate portrayal of the potential risks of participating.

 Will the data be shared after the study is completed?

The principal investigator’s answer  evaded revealing whether the data would be shared, with whom, and under what conditions.

Patient should not consent to participation in a trial where data are not publicly shared. The data should be available for reanalysis, checks on the interpretations made by the investigators, and integration with other data in a transparent fashion.

Notoriously, investigators in the PACE trial of cognitive behavior therapy and graded exercise for chronic fatigue syndrome continue to refuse to share their data – even when they published in PLOS One, a journal where making the data available was required. They have attacked the character of anyone seeking access to the data, particularly patients. They have even barred a professional from obtaining access to the data on the grounds she has visited patient websites.

The PACE investigators even argue that the possibility of damage to their interpretations of the trial and their reputations is sufficient to require a noncritical attitude toward them as a condition for receipt of the data. But they readily share their data with colleagues who accept and promote their distorted interpretations.

 The failure to specify that data will be made publicly available without restrictions would alone be sufficient for me to refuse participation in the trial.

An already misleading literature concerning treatment of adults with ME/CFS.

 The scientific literature concerning treatment of chronic fatigue syndrome is dominated by investigators who consistently misrepresent their findings; refuse to share their data; and have financial conflicts of interests that are served by inflated estimates of the efficacy of psychological interventions for ME/CFS.

The financial interests of  investigators have also intruded upon a systematic summary of the effectiveness of intervention, providing misinformation in a recent Cochrane review, so that the review is neither objective nor trustworthy.

 Patient involvement should be from the start of the planning of a trial.

 The “stakeholder advisory group” for this trial has not even met yet, despite recruitment already having begun. The diverse advisory group seems heavy on researcher and professional involvement, and weak on patient representation. Only two patient representatives are indicated.

The principal investigator stated in the interview:

Part of the project involves forming a Stakeholder Advisory Group which will include rheumatologists, exercise physiologists and the research team, but more importantly several people from the general public who are managing CFS and at least two representatives from the SA ME/CFS Society and Bridges and Pathways; all of whom will help finalise the finer points of the intervention before it commences. The Stakeholder Advisory Group is soon to convene to finalise details. I acknowledge that perhaps some members of the ME and CFS community may not agree with all components of the study design, and I welcome any discussions with them in order to improve the proposed project.

Peter Mitchell, Secretary, responded on behalf of the Management Committee of ME/CFS Australia (SA) Inc:

We have no input into the design of the trial.

We are cognizant of the many faults in the PACE trial which claims, incorrectly, to demonstrate the value of GET [graded exercise therapy] for people with ME/CFS.  We are also aware of the survey indicating the harm experienced by patients who have attempted GET.

Our organisation is therefore unequivocally opposed to the practice of GET for patients with ME/CFS, and we would not lend our support to any study that had that intention.

The Bridges and Pathways ME/CFS Multidisciplinary Clinical and Research Centre responded to the question Did you raise any objections about this study?”:

We did not know about it until it was on the [South Australian] ME/CFS Society’s website.

To the question: “What is Bridges and Pathways position on graded exercise therapy?”:

B&P uses a biomedical model of ME/CFS and have a recognition that many people have mitochondrial (energy making) faults or immune system faults that can be increased with physical exercise and stress. These pathways can now be measured and identified using laboratory tests. We do not include graded exercise therapy as one of our recommended treatments.

What patients should require before consenting to participate in research…

An editorial in The BMJ has taken a bold stand about greater patient involvement in all phases of research:

Working with other journals, research funders, and ethics committees, we hope that at some time in the future only research in which patients have been fully involved will be considered acceptable.

In their instructions to authors, The BMJ now includes a section Reporting patients’ involvement in research which states:

As part of its patient partnership strategy, The BMJ is encouraging active patient involvement in setting the research agenda.

We appreciate that not all authors of research papers will have done this, and we will still consider your paper if you did not involve patients at an early stage. We do, however, request that all authors provide a statement in the methods section under the subheading Patient involvement.

This should provide a brief response to the following questions:

How was the development of the research question and outcome measures informed by patients’ priorities, experience, and preferences?

How did you involve patients in the design of this study?

Were patients involved in the recruitment to and conduct of the study?

How will the results be disseminated to study participants?

For randomised controlled trials, was the burden of the intervention assessed by patients themselves?

Patient advisers should also be thanked in the contributorship statement/acknowledgements.

If patients were not involved please state this.

If this information is not in the submitted manuscript we will ask you to provide it during the peer review process.

Please also note also note that The BMJ now sends randomised controlled trials and other relevant studies for peer review by patients.

Will the Chronic Fatigue Syndrome/ Myalgic Encephalomyelitis patients of Australia rise up and inspire the parents of child and teen CFS/ME patients of the UK?

Australian patients face a clear challenge and a clear choice whether to participate in this clinical trial. Maybe they can act in a way that inspires the parents of CFS/ME children in the UK to similarly demand involvement before consenting to their children to participate in a clinical trial. Principal Investigator Esther Crawley has given no indication that she will share her data from a new trial of an Internet-based CBT program for adolescents with CFS.

Esther Crawley has a bad history with the patient community. Through the NHS, she inflicted a quack Lightning Process treatment on children and adolescents with CFS/ME in the SMILE trial. Yet, three years after completing the trial, she still has not published the results. But her friend Phil Parker has profited handsomely. Although the UK’s Advertising Standards Authority (ASA) has forbidden him from advertising the Lightning Process as a medical treatment, Parker has received payment for training and providing treatment in a clinical trial. Parker even implied on his promotional website that his treatment was being used in the Northern Ireland NHS – that is, until I alerted a member of the Northern Irish National Assembly Health Committee and the NHS insignia was removed.

If Esther Crawley won’t commit to publishing the data from her new trial and sharing it in a timely matter, why should parents consent for their children to enroll? Parents should demand greater say in all phases of the trial as a condition for consenting for their children or for keeping their children in the trial. Taking their children out of the trial is their right.


15 thoughts on “Why patients should not enroll in a clinical trial of video gaming treatment for chronic fatigue syndrome

  1. Good job. There’s not much to add.

    In the end this is still based on the flawed idea that the problem is behavioural.

    As part of my medical investigation I was subjected to cardiopulmonary exercise testing. My VO2max was 1.2 liters per minute, which 42% of the expected value of a person of my age and gender. There is no identifiable heart or lung problem and this is too low to be explainable by a sedentary lifestyle, and the respiratory quotient of 1.38 is consistent with good effort.

    Many patients have results that are substantially worse than this. I consider myself mildly to moderate affected and care for myself, with difficulties at times.

    I think it’s time for these exercise therapy theorists to acknowledge the biological dimension of the problem. If they think that there is a subgroup of patients where behaviour and motivation is actually the problem then they should make an effort to distinguish this subgroup from the others, rather than using vague criteria that create confusion and can lead to sick people being abused for “not trying hard enough”. But I doubt that such a subgroup is more than than a diagnostic error, if it exists at all. PACE showed no improvement in fitness for any group (the step test used is an approximation of VO2max). On a side note: individual step test data that could clarify whether any individuals in any groups actually improved is being withheld by the authors.

    Liked by 2 people

  2. This criticism is based on flawed, incomplete and incorrect information about this trial. I suggest that you wait until full details are published and recruitment begun before you make misleading claims about it. Your entire article is based on someone else’s reporting and basic registration details of the study. Enrolment has not begun.


    • Please tell me how what I directly quoted from the trial registration and an interview with the study principal investigator is incorrect. I’m listening.

      I don’t think waiting is advisable when these statements have been made without evidence of sufficient patient involvement, awareness of safety issues, or observance of standards of basic clinical trial design.

      Liked by 1 person

    • Great idea. Don’t critique design elements that have been provided by the investigators themselves until AFTER patients are being enrolled onto the study! Brilliant!


  3. Well, we had playing pretend sports, dancing at pretend parties and now a pretend study of a pretend therapy. I liked the comment about peoples expectation of it being of benefit to others, well I suppose Kinect might benefit. This isn’t research its an attempt to generate something that can be used in an advert.

    Liked by 1 person

  4. It’s 2016. Time for some real medicine for a real disease. Also time for transparency regarding the pseudoscience research that has kept ME/CFS in the dark ages for way too long. Thanks for another great article.

    Liked by 1 person

  5. This study is flawed and indicates a lack of understanding about ME/CFS, at the South Australian University. Another survey based study, with unclear entry criteria, lack of OBJECTIVE monitoring… The active video games- is at odds with the initial claims that people could lie down to do this exercise. The dangers of aerobic exercise are well documented by Mark Van Ness of the Workweek Foundation. Not having a clear diagnostic criteria is a hallmark of poor, studies whose underlying assumption is that people with ME/CFS aren’t really ill, and so we can bundle anyone with fatigue into the mix. No mention of steps taken to determine that a person is able to increase their activity- why aren’t the participants screened pre trial for being physiologically well enough to participate? Why aren’t they wearing heart rate monitors, actigraphs, pedometers – continuously to monitor health and well being and outcomes.

    Liked by 1 person

  6. “The aetiology of CFS/ME is unclear, and recent research has focussed unsuccessfully on individual inflammatory and immune biomarkers. Cumulative biomarkers such as the allostatic load index have stronger predictive power; enhancing our understanding of factors related to CFS/ME.”
    This sounds very Lloyd speak,- claiming that recent biomedical, research has been unsuccessful.
    Is Katia really measuring allostatic load, as stated the beginning? If so how? .

    A google search:
    3. Measures of allostatic load
    The usual approach to measuring allostatic load is through composite measures of a range of biomarkers, various measures that are sensitive to subtle changes in the biological state resulting from environmental exposure (see Figure 1).
    Which biomarkers should be used to measure allostatic load?
    In one of the first attempts to operationalise the definition of allostatic load, 10 biomarkers were used (Seeman, Singer, Rowe, Horwitz, & McEwen, 1997). Four of them were primary mediators: cortisol, epinephrine, norepinephrine and dehydroepiandrosterone sulphate (DHEAS). Six of them represented secondary outcomes: systolic and diastolic blood pressure, waist-hip ratio, high-density lipoprotein (HDL) and total cholesterol ratio and glycosylated haemoglobin. The measures were chosen so that they would cover both primary mediators and secondary outcomes of allostatic load and represent the function of neuroendocrine, cardiovascular, metabolic and fat deposition systems. The allostatic load score was the number of biomarkers where the individual was located in the highest risk quartile.


  7. This statement “The aetiology of CFS/ME is unclear, and recent research has focussed unsuccessfully on individual inflammatory and immune biomarkers. Cumulative biomarkers such as the allostatic load index have stronger predictive power; enhancing our understanding of factors related to CFS/ME.” sounds like wanting to suggest that biomarker research should not be funded.

    Griffit University, also located in Australia, does research into biomarkers for ME/CFS and might be a competitor for funding.

    I find the biomarker research difficult to interpret as layman but labelling it as “unsuccessful” seems completely dishonest. It would be more correct to say that their work needs to be confirmed.

    Lipkin and Hornig’s plasma cytokine signature published last year also wasn’t “unsuccesfull”, on the contrary.

    Perhaps this statement is just the obligatory attempt to make-believe that there’s nothing really wrong with patients. Something that psychosomatic explanations require to avoid looking like invoking magic.

    Liked by 1 person

  8. “Professor Ron Davis presented new findings from his Big Data study at Friday’s Invest in ME 2016 conference. Davis’s preliminary data show serious problems with the biochemical processes needed to convert sugars and fats from food into energy the body can use. If these findings are replicated, this could prove a major step forward in understanding ME/CFS………
    ……..The metabolomic data in the three patients who were examined highlighted that the main metabolic engine of energy molecule generation – the citric acid cycle in mitochondria – isn’t working properly. Glycolysis also does not look like it’s working very well in patients.

    Researchers were able to determine these errors by looking at the molecular byproducts of the cell and noting abnormalities in the compounds usually consumed and generated by these reactions. The basic biochemical process to turn sugars from food into energy molecules just wasn’t delivering for patients.”



  9. I myself tried to increase activity using a Wii fit (belonging to a family member) and just like every other attempt to increase my activity, however gradually, it failed–I ended up worse than before. But by all means, study authors, ignore all the patients (who have similar stories to mine) and do your own thing. That should keep this disease in status quo for a few more decades.


  10. I have ME, I have tried these games & dance, as part of my own pace at home trial, gET. I would not recommend these games to anyone with ME ! or cfs,😷😤😡😱😰😥😎😴😵so so much worsening debilitating issues,with no sleep & nothing to take the excruciating pains!! away, even do gentle yoga movement,s have bad affect, the temperature control is hard to deal with, the Motion sensor in my brain was off balance for days later, can’t eat for days on end you feel so poorly. This is not a good idea at all for the people who you have in mind. “DANGER” if say a person only as mild cfs? You are pushing them in to debilitating painful exhaustion ,with much more add on to there already weak body ,MCS is much more increase & it just doesn’t go away! Your flu like issues just get so much worse. And the paralyse feelings. This can last for days & much longer. This was on a Wii consoles, my body is badly damaged from this exercise. Not by Deconditioned, because I did what I was told !would help ME , GET , CBT, so take this as a warning! Do no harm! Kind regards from a ME suffer 💞


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s