Following on from their original email and Professor Holgate’s response, Leeds ME Network have sent a further email to Prof Holgate of CMRC about concerns regarding the proposed MEGA project:
Many thanks for your swift response to my previous email regarding the MEGA study and for passing our concerns on to those who are preparing the bid for funding…
It is heartening to hear from your email that the inclusion of very severe patients is under discussion by the MEGA team. I notice, however, that you mention ‘financial limitations’ in this context. The reaction of other patients with whom I have shared this issue echoes my own: that severely affected patients should be the priority. People with ME/CFS in general are offered little in the way of treatment but most of the severely affected are abandoned entirely by doctors. They are left to lie in darkened rooms, often unable even to sit up in bed or converse with their loved ones, and without any prospect of medical intervention. I’m sure you know all this. Though I cannot claim to have taken a scientific sample of opinion, the overwhelming impression I get from patients is that if there are financial constraints regarding MEGA then these should apply to the overall number of samples taken rather than be focussed on the severely affected, who are the ones most in need of help. I am reminded of Prof Ron Davis’ observation that data from severely affected patients is the most important ‘because their biology would show the greatest differences compared with healthy controls’. It seems incongruous to be envisaging such an enormous study yet even at this stage, while the grant submission is still being prepared, to be talking about insufficient money for full inclusion in the study of those most in need of help.
A further issue regarding patient selection occurred to me while reading through the ‘questions and answers’ update on the MEGA petition website:
The update says: “The only way to do this is to recruit patients through NHS clinics throughout England.”
As I described in my previous email, taking patients from the clinics alone would produce a sample of patients biased towards the less severely affected. Since that earlier email, I have had chance to listen to Prof Davey Smith’s talk at the CMRC conference and it seems evident that using only the clinics to recruit patients would result in precisely the kind of selection bias he warns against. I’m pleased that plans are now being made to also include the severely affected. However, patients on social media are concerned that we might end up with a sample consisting mainly of mildly affected patients from the clinics along with a small token sample of the severely affected to keep the patient community happy. This will not win patient support. What we need is a fully representative spectrum of patients from mild to severe through moderate. This will require the inclusion of patients from outside the clinics not only to ensure the representation of severe patients but also of those moderately affected, for these would also be underrepresented in a sample which came entirely from the clinics (as I argued in my previous email).
The Q&A update also says with regards to patients from the clinics: “The clinicians will be asked to identify patients they judge from NICE criteria to have CFS/ME” and “Patients will have been examined and a full history taken.”
Speaking to a senior clinician from one of the clinics has confirmed my impression (mentioned in my previous email) that most of the clinics actually consider the NICE criteria to be too broad for use and rely instead on Fukuda and/or their own clinical experience. So a cohort from the clinics will not be a homogenous sample but will have been diagnosed according to the individual expertise of the clinicians involved. As for patients being examined and a full history taken, this seems unlikely to be the norm. Clinicians at triage will usually be nurses or OTs rather than doctors so there is unlikely to have been a full medical examination or a full medical history taken. The emphasis will have been on the symptoms the clinician considers to be typical of ME/CFS. As in some cases these clinicians have little previous experience of the condition and come from a mental health background, this may not necessarily coincide with what experienced doctors – or indeed patients – consider to be ME.
I think the point I am trying to make here is this: The impression is given that one of the main motivations for using the clinics is the belief that a lot of the work of data collection with regard to these patients has already been done. In actual fact, this is unlikely – and certainly not to the uniform standard that reliable research would require. In contrast, the approx. 500 samples in the National Biobank have been rigorously catalogued. Hopefully they will be used as part of the study.
I cannot speak for the whole patient community, of course, but I like to think that the majority of patients would very much support the study if the various issues I’ve described in my two emails (and possibly one two more which may not have occurred to me!) are addressed. If we can reach that stage, I think people with ME would be happy to do whatever they can to help, especially if we can be persuaded there is a genuine desire for a truly representative sample of patients. I mentioned previously that Prof Newton and (especially perhaps) Victoria Strassheim who assisted her in her severely affected project, would be ideal people to ask about reaching patients through social media and the national support groups. Further to which, I feel that local groups like ours could be a source of additional patients – perhaps we could even organise local ‘clinics’ in hired rooms or homes etc to take samples if this would be appropriate. If we can establish trust and work together, we can really make this project into the success we all want to see…
But one last thing… I have tried to stick to issues rather than personalities yet I feel I have to make a final point which unavoidably involves both.
As you well know, precision is vital for any study. But there are one or two people in the MEGA team, and you can probably guess who I mean, who seem to have some very strange ideas about acceptable science. I understand you know all about the damaging misinformation which has been produced by the now largely discredited PACE trial but I should also like to draw your attention to a study on ‘Chronic Fatigue Syndrome at Age 16 Years’.
As the name implies, this study was designed to assess the prevalence of the condition in children at age 16. The authors declared: ‘it is important that the uncertainties regarding the population prevalence of pediatric CFS are resolved.’
However, the children in this study were selected on the basis of no established criteria, but rather:
- a parental questionnaire asking if the child had been “feeling tired or felt she/he had no energy” and whether this had affected their education and activities, and
- the child’s score of 19 or over on the Chalder Fatigue Questionnaire.
It is worth contrasting this makeshift means of ‘diagnosis’ with Fukuda, which requires four out of eight additional named symptoms in addition to fatigue, and even the NICE criteria (which, as mentioned previously, most clinicians seem to discard as being too broad to actually use) which requires one additional named symptom in addition to post-exertional malaise.
Furthermore, there was no attempt in the ‘age 16’ study to exclude other conditions which might have produced fatigue in these children (with the exception of depression which was again assessed on the strength of only a simple questionnaire enquiry about the children’s feelings). There was no doctor or medical testing involved and no attempt to assess the nature of the fatigue. All that appears to have been identified, therefore, though by no means precisely, were the number of children with ‘generic fatigue’.
In spite of this, Prof Crawley (who was lead author of the study) described these children in the media as having ‘CFS also known as ME’, effectively equating ME with generic fatigue. Yet these are two very different things.
And this was billed as a study helping to ‘resolve uncertainties about prevalence’!
I mention this to help you understand at least some of the reason why patients are so unhappy about Prof Crawley’s involvement with patient selection for MEGA. She has received millions in research funding in recent years yet she produces research like ‘age 16’ which, far from ‘resolving uncertainties’, is so imprecise that it only leads to further misinformation. Patients want quality biomedical research (yes please!) but we do not want another study as poor as PACE which might take us another five years to expose and would soak up all available funding for years to come.
I do not want to make this about personalities but I am anxious for you and your colleagues to be aware of the rational basis of patient concerns, especially with regard to patient selection, for the idea of simply taking all the patients from the clinics seems to us to be little more accurate in terms of patient sample than the makeshift criteria used for ‘age 16’ – and it is hard to avoid the suspicion that both ideas have come from the same source.
I personally am not asking for any personnel to be removed from the MEGA team (as long as there is adequate oversight from patients) but I can fully understand why other patients may be doing so.
P.S. You can read more about the ‘Age 16’ study in this previous post.
7 thoughts on “More on MEGA”
Thank you. Well said!
LikeLiked by 1 person
Agree with Sue! Very well said. What patients need most of all is a collection of samples that is as useful as possible to future biomedical researchers. This requires a reasonable degree of scientific rigour from the outset (and we’ve got good reason to be anxious about that). Thank you for keeping us updated. Samantha
Thanks, Samantha. Yes, I think you focus on the heart of the matter. The establishment of the biobank is all important. It needs to be a representative sample of patients and the ‘paperwork’ needs to be accurate. If it’s allowed to go ahead as it is then, as you say, we have good reason to be anxious. We know that the person who is apparently the impetus behind this project doesn’t really care – she has a history of sloppy research and is probably only interested in obtaining a plentiful supply of fatigue and mental health questionnaires to keep her in research funding for the forseeable future.
The question has been asked: why can’t we just use the existing British biobank instead of starting a new one. See discussion in the comments on the latest MEGA update blog: https://www.change.org/p/support-this-huge-biomedical-m-e-cfs-study-and-its-application-to-major-uk-research-funders/u/18203963?recruiter=false&utm_source=share_update&utm_medium=twitter&utm_campaign=share_twitter_responsive
Prof Chris Ponting says the 300 patients plus 200 controls in the existing bank is not enough. The question has been asked: how many *is* enough? Do we really need 12000?
LikeLiked by 2 people
Yes, I’m no scientist, but I’d imagine a large collection of samples from ‘fatigue’ patients without the necessary info to differentiate between them, could make this resource almost useless to serious researchers (and help ‘less serious researchers’ further muddy the waters). Time, effort and care was put into building up the existing biobank. Thank you for the link – off to read it now!
LikeLiked by 2 people
Another excellent piece, and responses. I think we are lucky that you are able to keep up with the breadth of the debate across a number of the fora!
I have been much of the same opinion, though not so widely read, so it is good to see these points being so ably put to Prof. Holdgate, who doesn’t yet seem to grasp the extent of the fog of misinformation that passes for ‘scientific’ evidence, through only being derived on a ‘garbage in: garbage out’ basis, but, nevertheless, being successfully spun by the, proprietorial, biopsychosocial lobby, in pursuit of their own aggrandisement.
It is hard to put such basic concerns across to those newly in a position to positively affect the course of future research, without seeming to be almost hysterical one’s self, but I find that my impression does rather chime with yours, when you say that a dominant ‘research’ lobbyist is: “probably only interested in obtaining a plentiful supply of fatigue and mental health questionnaires to keep her in research funding for the foreseeable future.”. I do, reluctantly, suspect that this may not be very far from the truth, for the whole psychological ‘research’ sector, who’s modus operandi does seem to consist in, fallacious, pseudoscientific, statistical p-mining of spurious data constructed with vague questionnaires conducted on ill-defined subject groups. It sounds preposterous, but the more of it one reads, the more the impression deepens.
I do hope that your efforts succeed in conveying this woeful state of affairs to the wider research and medical communities.
LikeLiked by 1 person
On seeing the new OMEGA counterpetition:
It seems unfortunate that there has to be a petition of this kind against what, in the right hands, and with careful preparation of protocols in advance, would undoubtedly be a gathering of very useful data; and I feel uncomfortable that this will discourage some of the very able researchers and research teams who have been brought into the MEGA group but had no part in earlier ill advised research proposals; but it seems that something of this sort will have to be done, to ensure a complete new start, and clean break with the discredited ‘science’ of biopsychosocial egotists.
I apologise to the, well-meaning, I’m sure, Prof. Holdgate, and those others who I fear have had to be reticent in criticising poor research, because of the binding conditions that were attached to membership of the Research Collaborative, under the direction of the partisan ‘Science Media Centre’, but the time really has come to return to both freedom of speech and information in this research field, after the gambit of crying ‘harassment’ after any honest questioning, has been so clearly shown up for what it was, in the courts.
I would advise that a new steering group be set up for a large and inclusive, data gathering and biomic sequencing and typing study with the major emphasis on the severely affected, who are the most likely to yield clear differences worthy of more intensive study. By all means collect data from a quota of less severely disabled/sick patients as well, but only to the number necessary to provide a control match for each of the seriously ill study subjects. A similar number of healthy controls will also be needed.
Thus the size and expense of the study should stem from the maximum number of seriously ill participants for statistical certainty, times three. If that turns out to be a very big cost: then let all patient organisations and researchers get together and lobby for those necessarily big funds to be made available. With the skyrocketing costs of indefinite medical care, I would say that, no matter what the cost of such a project, it will be tiny compared with the costs of the failure to treat, into infinity.
[I have just been presented with a Change.org offer to pay for promoting this petition to other users of the site. I don’t think this is a good idea, because we want to encourage principled and knowledgeable support and comment, rather than ‘nagging ticks’. I had not realised that I was being pestered to support petitions about which I know nothing, because Change. org was allowing privileged access to its clickosphere. ]
LikeLiked by 1 person
A brilliant comment, Steve, and a very sensible proposal. I’d like to publicise this more widely. I’ll send you an email.