Halloween Science

Abstract

APPROACH: Trick or Treatment? by Simon Singh and Edzard Ernst claims to “examine the various alternative therapies in a scrupulous manner” (p.3). This critique assesses the validity of this claim, both in general and specifically in respect of homeopathy, by analysing the authors’ own arguments and evidence for accuracy, consistency and reliability. Where information is lacking in Trick or Treatment?, the critique incorporates evidence from other primary sources (where possible) or reputable secondary sources. Some conclusions reached on the basis of Ernst and Singh’s own statements are also supported by reference to other sources. All sources are referenced.

RESULTS: We have identified nineteen major faults in the case presented by this book:

Evidence: (1) The authors frequently rely on figures, trials, events, quotations, statements, opinions and explanations which are unsupported by reference to sources. (2) This evidence is frequently misleading as a result of being presented out of context. (3) The authors use different criteria when assessing the validity of evidence, depending on whether the evidence supports their views or not.

Science: (4) The authors commit the common fallacy of confusing absence of proof with proof of absence. (5) The importance of theory is minimized or even ignored, when discussing both science in general and individual alternative therapies. (6) The authors assume that orthodox medicine is scientific, but offer no justification for this position. (7) There is evidence that the authors do not understand the principles and practice of orthodox medicine.

Definitions: (8) Alternative medicine is defined in four different ways in the course of the book. (9) Other significant terms, such as ‘science’, ‘disease’, ‘cure’, ‘effectiveness’ and ‘orthodox medicine’ are undefined. (10) This allows arguments to be built on vague preconceptions rather than on clearly defined principles. (11) The differences between orthodox medical and alternative medical definitions is not taken into account, despite their impact on the design of trials. (12) The authors fail to present the ideas of evidence-based medicine accurately. (13) The authors fail to present the nature and development of homeopathy accurately, raising doubts about their presentation of the other therapies. (14) They also call into question the principles of orthodox drug therapy, despite the fact that the tests used by this therapy underpin much of their argument.

Analytical tools: (15) The authors fail to prove that their main tool, the randomised controlled trial (RCT), is valid for testing curative interventions, while presenting evidence that there are serious problems with using it for this purpose. (16) They show that a tool derived from these trials, the meta-analysis, is prone to lack of objectivity, yet they rely on this for some of their conclusions. (17) Their conclusions are also dependent on the concept of the placebo effect, but they make it clear that this effect has no scientific basis and is so unpredictable as to have questionable scientific validity in this context. (18) They acknowledge the importance of individuality in the curative process, but deny its significance for the design of analytical tools. (19) They fail to take into account the need for analysis of evidence from clinical practice.

CONCLUSIONS: Ernst and Singh have failed to provide a secure theoretical or evidential base for their argument, and have used analytical tools inadequate (in this context) for achieving objective and reliable conclusions. The result of these weaknesses is that their argument relies heavily on preconceptions, variable definitions and opinion, a problem exacerbated by a tendency to confirmation bias on the authors’ part. As a result, Trick or Treatment? has no validity as a scientific examination of alternative medicine.

Downloads

In addition to the Abstract above, there is a summary version and the full version of this publication.

For the Halloween Science Abstract (one page) click here.
For the Halloween Science Summary (12 pages) click here.
For Halloween Science in full (142 pages) click here.

Halloween Science is free. However, if you would like to make a donation to H:MC21 in recognition of the time which has gone into making this work available, please

either donate here through Paypal,

or click here to go to information about donating in other ways.

If you are a UK tax-payer, H:MC21 can also claim an extra 28% of your donation from the government if you send us a completed Gift Aid Form.

For praise of Halloween Science click here.

Video: The Plural of Denial is Not Science

Carol Boyce has made a video along the lines of Halloween Science, and this is available on YouTube. Watch and laugh at : http://www.youtube.com/watch?v=cHi1UjPvhXQ&feature=player_embedded

Return to Publications