Course outline
Module 1
Module 1: Introduction to Evidence-Based Assessment
Introduction to Evidence-Based Assessment
Knowledge check
Q1. What is the highest level of evidence in the traditional evidence hierarchy used to assess medical interventions?
- A. Expert opinion
- B. Case reports
- C. Systematic reviews and meta-analyses of randomized controlled trials ✓
- D. Animal studies
Why: Systematic reviews and meta-analyses that pool results from multiple well-designed randomized controlled trials sit at the top of the evidence hierarchy because they minimize bias and combine data across studies to give the most reliable estimate of an intervention's effect.
Q2. Why is a randomized controlled trial (RCT) generally considered stronger evidence than an observational cohort study for judging whether a treatment works?
- A. RCTs are always larger than cohort studies
- B. RCTs are cheaper and faster to conduct
- C. Randomization helps balance known and unknown confounding factors between treatment and control groups ✓
- D. RCTs do not require a control group
Why: Random assignment distributes both measured and unmeasured confounders roughly evenly across groups, so differences in outcomes are more plausibly attributable to the intervention rather than to pre-existing differences between participants.
Q3. A herbal supplement is praised in a testimonial video by a satisfied user who felt better after taking it. What is the main limitation of this as evidence of effectiveness?
- A. Testimonials are always deliberately fabricated
- B. Improvement may result from placebo effects, natural recovery, regression to the mean, or other factors without a comparison group ✓
- C. Testimonials cannot describe any health outcome
- D. Only physicians are permitted to report symptom changes
Why: Individual anecdotes lack a control group and cannot separate the effect of the product from the many other reasons a person's symptoms might improve, such as the natural course of illness or regression to the mean after a symptom flare-up.
Q4. What does it mean when a study reports a statistically significant result with a p-value of less than 0.05?
- A. There is a 95% chance the treatment works
- B. If there were truly no effect, results at least this extreme would occur less than 5% of the time by chance ✓
- C. The treatment is clinically important and should be adopted
- D. The study was free of bias
Why: A p-value describes the probability of observing data at least as extreme as those obtained, assuming the null hypothesis of no effect is true. It does not indicate the probability that the treatment works or whether the effect is large enough to matter in practice.
Q5. Why is publication bias a concern when reviewing the evidence for an alternative therapy?
- A. Journals only publish studies that are written in English
- B. Studies with positive results are more likely to be published than those with null or negative results, which can make an intervention appear more effective than it is ✓
- C. Negative studies are always more rigorous than positive ones
- D. Publication bias only affects drug trials and not complementary therapies
Why: When null or negative findings go unpublished, the published literature overrepresents favorable results. Systematic reviews attempt to counter this by searching registries and grey literature, and funnel plots can help detect asymmetry suggesting missing studies.
Module 2
Module 2: Acupuncture: What the Trials Show
Acupuncture: What the Trials Show
Knowledge check
Q1. According to large systematic reviews of acupuncture trials, what is the most consistent finding for chronic pain conditions such as back pain and osteoarthritis?
- A. Acupuncture produces no effect beyond placebo under any circumstances
- B. Acupuncture produces small benefits over sham or no treatment, but these effects are generally modest and often shrink when compared with rigorous sham controls ✓
- C. Acupuncture cures chronic pain permanently after a single session
- D. Acupuncture is more effective than all standard pharmaceutical painkillers
Why: Meta-analyses such as those pooling individual patient data (e.g., Vickers et al., 2012) find statistically significant but small differences versus sham or no treatment for chronic pain. When sham acupuncture is used, the gap between real and sham acupuncture is much smaller, suggesting that a substantial part of the effect may relate to non-specific factors such as expectation and the ritual of treatment.
Q2. Why are sham acupuncture controls important in acupuncture trials?
- A. They make the trial cheaper to run without any other benefit
- B. They allow researchers to separate the specific effects of needling at acupuncture points from non-specific effects such as expectation, attention, and the clinical setting ✓
- C. They prove that acupuncture works whenever sham results are similar to real acupuncture
- D. They are only needed when patients refuse real treatment
Why: Because acupuncture cannot be blinded to the patient in the usual way, a credible sham (such as non-penetrating or non-acupoint needling) lets researchers estimate how much of the observed benefit is due to the specific intervention versus placebo-like or contextual factors.
Q3. A trial reports that real acupuncture reduces pain more than a sham procedure, but the difference is smaller than the minimum clinically important difference. What is the most appropriate interpretation?
- A. Acupuncture is clinically important and should be recommended to all patients
- B. The result is statistically significant but may not be clinically meaningful for patients ✓
- C. The trial proves acupuncture is a placebo with no effect at all
- D. The trial is invalid because sham controls cannot be used in acupuncture research
Why: Statistical significance does not guarantee clinical importance. A difference that is real but smaller than what patients would notice or value as meaningful should be interpreted cautiously, especially when weighing costs and risks of treatment.
Q4. Which factor is a common methodological problem that can inflate apparent benefits in acupuncture trials?
- A. Using too many sham controls
- B. Lack of blinding of outcome assessors and reliance on subjective self-reported outcomes such as pain scores ✓
- C. Recruiting participants of different ages
- D. Measuring outcomes at more than one time point
Why: Subjective outcomes like pain are sensitive to expectation, and when participants or assessors know who received acupuncture, bias can inflate results. Trials with adequate blinding of assessors and objective or well-validated outcomes provide more reliable evidence.
Q5. Based on the current evidence, which statement best summarizes the role of acupuncture in clinical practice?
- A. It has been definitively proven to treat all diseases, including cancer
- B. It may offer modest symptomatic benefit for some chronic pain conditions, but evidence for many other conditions is weak or inconsistent, and it should be considered alongside conventional care ✓
- C. It has no evidence supporting any use whatsoever
- D. It is only effective when performed by traditional practitioners in China
Why: The evidence is strongest for certain chronic pain conditions, with modest effects that are partly attributable to non-specific factors. For many other claimed uses the evidence is limited or mixed, so acupuncture is best viewed as a possible adjunct rather than a replacement for proven treatments.
Module 3
Module 3: Herbal Medicine and Drug Interactions
Herbal Medicine and Drug Interactions
Knowledge check
Q1. Which herbal supplement is most well known for reducing the effectiveness of certain antiretroviral drugs and oral contraceptives by inducing liver enzymes?
- A. Ginger
- B. St. John's Wort ✓
- C. Peppermint
- D. Chamomile
Why: St. John's Wort induces cytochrome P450 enzymes (notably CYP3A4) and P-glycoprotein, which speeds the breakdown of many drugs, including some antiretrovirals and oral contraceptives, potentially reducing their effectiveness.
Q2. Ginkgo biloba is often taken for memory, but it has antiplatelet effects. Which medication combination poses the greatest concern when taken with ginkgo?
- A. Acetaminophen and vitamin C
- B. Warfarin and aspirin ✓
- C. Metformin and levothyroxine
- D. Amoxicillin and omeprazole
Why: Ginkgo inhibits platelet-activating factor and can increase bleeding risk. Combining it with anticoagulants like warfarin or antiplatelet drugs like aspirin raises the risk of hemorrhage.
Q3. Why is grapefruit juice mentioned alongside herbal medicine when discussing drug interactions?
- A. It contains high levels of vitamin K that cancel drug effects
- B. It inhibits intestinal CYP3A4 enzymes, increasing levels of many drugs ✓
- C. It neutralizes stomach acid needed for drug absorption
- D. It binds to drugs and prevents their absorption entirely
Why: Grapefruit compounds such as furanocoumarins inhibit intestinal CYP3A4, which can raise blood levels of many medications, sometimes to toxic levels. Its effect is similar to certain herbal interactions involving drug-metabolizing enzymes.
Q4. Garlic supplements are commonly used for cardiovascular health. What is a primary interaction concern for someone taking garlic supplements?
- A. Increased risk of bleeding when combined with anticoagulant or antiplatelet drugs ✓
- B. Reduced blood pressure leading to fainting with no other effects
- C. Elevated potassium levels causing heart rhythm problems
- D. Complete inactivation of all antibiotics
Why: Garlic has antiplatelet properties, so combining it with warfarin, aspirin, or other blood thinners can increase bleeding risk. It is also advisable to stop garlic supplements before surgery.
Q5. Which statement best describes the evidence base for herbal-drug interactions?
- A. All herbal products are regulated identically to prescription drugs, so interactions are well documented
- B. Many interactions are reported from case reports and laboratory studies, while formal clinical data are often limited ✓
- C. Herbal products never interact with pharmaceutical drugs because they are natural
- D. Interactions have been ruled out for every commonly used herb
Why: Much herbal-drug interaction evidence comes from case reports, in vitro studies, and pharmacokinetic research, with fewer large clinical trials. Supplements are also not held to the same pre-market approval standards as drugs in many countries, so product quality and dosing vary.
Module 4
Module 4: Homeopathy: Claims Versus Clinical Data
Homeopathy: Claims Versus Clinical Data
Knowledge check
Q1. What is the central principle of homeopathy known as 'like cures like'?
- A. Substances that cause symptoms in healthy people can cure similar symptoms in sick people ✓
- B. Diseases are caused by imbalances in the body's four humors
- C. Illness is always the result of an invading pathogen
- D. Treatments work best when they are administered in large physical doses
Why: Homeopathy is based on the principle of similia similibus curentur, which holds that a substance producing symptoms in a healthy person can treat similar symptoms in someone who is ill. This principle originated with Samuel Hahnemann in the late 1700s and is not supported by modern pharmacology or biology.
Q2. What does the term 'potentization' refer to in homeopathic preparation?
- A. Increasing the concentration of the active ingredient with each preparation
- B. The repeated dilution and vigorous shaking of a substance, which proponents claim increases its potency ✓
- C. Heating a remedy to extract its most powerful compounds
- D. Combining two remedies to produce a stronger effect
Why: Potentization involves serial dilution followed by succussion (vigorous shaking). As dilution increases, homeopathic remedies typically contain no detectable molecules of the original substance, yet proponents claim potency increases. This contradicts basic chemistry, since the more a remedy is diluted, the less of the original substance remains.
Q3. Which of the following best describes the findings of major systematic reviews of homeopathy versus placebo?
- A. Homeopathy consistently outperforms placebo for chronic conditions
- B. Homeopathy shows effects only for surgical recovery
- C. Reviews find no reliable evidence that homeopathic remedies work better than placebo for any specific condition ✓
- D. Homeopathy is proven effective for all infectious diseases
Why: Large systematic reviews, including a 2015 assessment by Australia's National Health and Medical Research Council, concluded there is no reliable evidence that homeopathy is effective for any health condition beyond placebo. Apparent positive effects in individual trials are generally attributed to placebo response, regression to the mean, and methodological weaknesses.
Q4. Why might a person report feeling better after taking a homeopathic remedy even if the remedy contains no active ingredient?
- A. Homeopathic remedies contain hidden pharmaceutical drugs
- B. The remedy directly alters cellular DNA to promote healing
- C. Placebo effects, natural recovery over time, and regression to the mean can all produce apparent improvement ✓
- D. Water memory transfers healing information to the patient
Why: Many conditions improve naturally over time, and people tend to seek treatment when symptoms are at their worst, so subsequent improvement is likely regardless of treatment (regression to the mean). Additionally, the ritual of consultation and treatment can produce genuine placebo responses. Controlled trials are necessary to separate these effects from any true pharmacological action.
Q5. What is the 'water memory' hypothesis, and why is it rejected by scientists?
- A. The idea that water stores information about dissolved substances, which has been confirmed by spectroscopy
- B. The claim that water can remember the shape of containers it was stored in, which is widely accepted
- C. The proposal that water molecules retain imprints of past solutes, which is unsupported by evidence and conflicts with known chemistry ✓
- D. A theory that water converts into energy during dilution
Why: Water memory is the proposed mechanism homeopaths use to explain how diluted remedies could retain therapeutic properties. Hydrogen bonds in liquid water form and break within picoseconds, so no stable structure could preserve a memory of dissolved substances. Attempts to replicate water memory claims under controlled, blinded conditions have failed.
Module 5
Module 5: Chiropractic and Spinal Manipulation Evidence
Chiropractic and Spinal Manipulation Evidence
Knowledge check
Q1. According to systematic reviews, which condition has the strongest evidence supporting spinal manipulation for short-term relief?
- A. Acute low back pain ✓
- B. Asthma in children
- C. Ear infections
- D. Type 2 diabetes
Why: Multiple systematic reviews and clinical guidelines find spinal manipulation can provide short-term pain relief for acute low back pain, comparable to some standard treatments, though the effect size is modest and often short-lived. Evidence for asthma, ear infections, and diabetes is lacking.
Q2. What is the term for the adverse event most commonly cited as a serious risk of cervical spinal manipulation?
- A. Vertebral artery dissection leading to stroke ✓
- B. Hair loss
- C. Chronic fatigue
- D. Skin rash
Why: Cervical manipulation has been associated with rare but serious vertebral artery dissection, which can cause stroke. The absolute risk is very low and causality is debated, but it is the most cited serious adverse event, which is why it features prominently in risk discussions.
Q3. What does the term 'subluxation,' central to traditional chiropractic theory, refer to?
- A. A partial dislocation of a vertebra that impairs nerve function, a concept without solid scientific support ✓
- B. A broken bone in the spine confirmed by X-ray
- C. A type of muscle strain common in athletes
- D. An inflammatory disease of the joints
Why: The chiropractic 'vertebral subluxation' concept claims misaligned vertebrae interfere with nerve function and health broadly. Imaging and research have not validated this as a distinct, diagnosable entity, and it is a major point of scientific criticism.
Q4. Which statement best reflects the evidence on spinal manipulation for conditions outside the musculoskeletal system, such as asthma or infections?
- A. There is little or no reliable evidence that it treats these conditions ✓
- B. It has been proven to cure them in randomized trials
- C. It is recommended as first-line treatment by major medical bodies
- D. It reliably boosts immunity measured in controlled studies
Why: Claims that spinal manipulation treats non-musculoskeletal conditions are not supported by high-quality evidence. Such claims are a key reason critics question broader chiropractic practice, while manipulation's role for back and neck pain is the best-supported use.
Q5. Why is a 'sham' or placebo manipulation important in trials of spinal manipulation?
- A. It helps separate the specific effects of manipulation from expectation, attention, and the therapeutic relationship ✓
- B. It makes patients feel more comfortable during treatment
- C. It is required to measure the patient's blood pressure
- D. It replaces the need for a control group in every study
Why: Hands-on treatments carry strong nonspecific effects such as expectation and attention. Sham manipulation allows researchers to determine whether the specific technique adds benefit beyond these factors, which is central to evaluating the evidence.
Module 6
Module 6: Mind-Body Practices: Meditation, Yoga and Tai Chi
Mind-Body Practices: Meditation, Yoga and Tai Chi
Knowledge check
Q1. Which of the following best describes mindfulness meditation as studied in clinical research?
- A. Attempting to empty the mind of all thoughts for extended periods
- B. Deliberately paying attention to the present moment with an open, non-judgmental attitude
- C. Entering a trance state in which the body is controlled by external energy
- D. Repeating a sacred word to achieve communication with a higher power
Why: In research settings, mindfulness is defined as intentionally attending to present-moment experience, including thoughts and sensations, without judging them. It is not about emptying the mind, entering trance, or spiritual communication.
Q2. What is a common finding in systematic reviews of yoga for chronic low back pain?
- A. Yoga consistently cures disc herniation
- B. Yoga shows small to moderate benefits for pain and function compared with usual care
- C. Yoga has no measurable effect on any musculoskeletal condition
- D. Yoga worsens pain in the majority of participants
Why: Multiple systematic reviews and trials suggest yoga can provide modest improvements in pain and function for chronic low back pain, though it does not cure underlying structural problems and effects are generally small to moderate.
Q3. Tai chi is often described as which type of exercise?
- A. High-intensity interval training
- B. Heavy resistance weight training
- C. Low-impact, slow, flowing movement combined with breathing and attention
- D. Competitive contact sport
Why: Tai chi involves slow, controlled, flowing movements coordinated with breathing and mental focus. It is low impact and widely studied for balance, fall prevention, and gentle physical activity in older adults.
Q4. Why is a placebo or active control group important when evaluating meditation or yoga studies?
- A. It makes the study cheaper to conduct
- B. It helps separate specific effects of the practice from expectation, attention, and social contact effects
- C. It is required only for drug trials, not behavioral interventions
- D. It ensures participants will report higher satisfaction
Why: Mind-body interventions can produce benefits through expectancy, group support, and time spent attending to health. Appropriate control conditions help researchers determine whether the specific practice adds benefit beyond these nonspecific factors.
Q5. Which statement best reflects the current state of evidence for meditation and yoga in alternative medicine?
- A. They are proven to cure cancer and heart disease
- B. They have no scientific support whatsoever
- C. Some outcomes, such as stress and anxiety symptoms, show promising evidence, though many studies have methodological limitations
- D. They work only when combined with specific herbal supplements
Why: Research shows promising results for stress reduction, anxiety, and some pain conditions, but many trials are small or have weak controls, and claims of curing serious diseases are not supported by the evidence.
Module 7
Module 7: Regulation, Misinformation and Critical Appraisal
Regulation, Misinformation and Critical Appraisal
Knowledge check
Q1. Which of the following is the most important feature of a well-designed randomised controlled trial when evaluating an alternative therapy?
- A. A large number of testimonials from satisfied patients
- B. Random allocation of participants to intervention and control groups ✓
- C. Publication in a journal that specialises in complementary medicine
- D. A sponsor who has a financial interest in the therapy's success
Why: Random allocation helps ensure that known and unknown confounding factors are distributed evenly between groups, so any difference in outcome is more likely to be due to the intervention. Testimonials are anecdotal and cannot separate treatment effects from natural recovery, placebo, or regression to the mean.
Q2. What does the term 'placebo effect' refer to?
- A. A deliberate attempt by a practitioner to deceive a patient
- B. Improvement in symptoms that results from a patient's expectations or the ritual of treatment rather than the active ingredient ✓
- C. The toxic side effects caused by an inactive substance
- D. The permanent cure of a disease without any medical intervention
Why: The placebo effect describes real symptomatic improvement arising from psychological and contextual factors such as expectation, attention, and the therapeutic relationship. It is why controlled trials must compare treatments against placebo or sham controls.
Q3. A website claims that a herbal supplement 'cures cancer' and cites a single laboratory study on cultured cells. Which critical appraisal question is most relevant here?
- A. Is the website professionally designed and attractive to read?
- B. Has the supplement been used for a long time in traditional cultures?
- C. Do the results from cell culture experiments reliably translate to effects in living human patients? ✓
- D. Is the supplement sold at a low price compared with pharmaceuticals?
Why: Many substances that kill or inhibit cancer cells in a laboratory dish fail to have the same effect in humans, because of factors like metabolism, dosage, and bioavailability. Extrapolating from in vitro results to clinical cure is a common misinformation pattern.
Q4. Which body is primarily responsible for regulating the marketing claims of dietary supplements in the United States?
- A. The World Health Organization
- B. The Food and Drug Administration (FDA) ✓
- C. The National Institute for Health and Care Excellence (NICE)
- D. The Cochrane Collaboration
Why: In the United States the FDA oversees dietary supplements, though under the DSHEA framework it does not require proof of efficacy before marketing, and it generally acts only after problems emerge. NICE is a UK body that evaluates clinical interventions, the WHO sets global health guidance, and Cochrane produces systematic reviews rather than regulating products.
Q5. A study reports that a remedy improved symptoms in 40 patients with no control group. What is the main limitation of this design?
- A. It is too expensive to conduct at scale
- B. It cannot distinguish the remedy's effect from natural recovery, placebo, or regression to the mean ✓
- C. It must always produce false positive results
- D. It is illegal to publish uncontrolled studies
Why: Without a control group, improvements could result from the natural course of the illness, the placebo response, or regression to the mean (patients often enrol when symptoms are at their worst). Uncontrolled case series are useful for generating hypotheses but cannot establish that a treatment caused the improvement.