Home Conditions Guides Vaccines Recipes Symptoms Tools 💊 Rx Savings About Compare Prices
🔬 Study Scorecard

🦠 COVID-19 Vaccines

4 major studies graded on 9 RCT methodology criteria.

"We don't tell you what to think. We show you the data."
About These Trials

COVID-19 vaccines received Emergency Use Authorization in late 2020, followed by full FDA approval starting in 2021. The trials were among the largest and fastest vaccine trials ever conducted — enrolling tens of thousands in months. This speed, combined with manufacturer funding and short follow-up windows, raised legitimate methodological questions. Below is how each major trial actually stacks up.

🧪 What do these 9 criteria mean? click to expand
Control Group

A comparison group received a different treatment (or no treatment) under identical conditions.

Without a control group, you cannot determine whether changes in outcomes were caused by the vaccine or other factors.

Randomized

Participants were randomly assigned to vaccine or control — not by age, risk, or researcher choice.

Randomization prevents selection bias, ensuring the vaccinated and unvaccinated groups are comparable at baseline.

Double-Blind

Neither participants nor researchers measuring outcomes knew who received the vaccine.

Blinding prevents both reporting bias (participants feeling better just from getting a shot) and measurement bias.

Placebo-Controlled

The control group received an inert substance (saline) — not another active vaccine.

Active comparators can mask safety signals. If the control group also experiences side effects, adverse events in the test group may appear deceptively normal.

Large Sample (1,000+)

At least 1,000 participants were enrolled.

Larger samples detect modest effects and rare adverse events. A 200-person study might miss a side effect affecting 1 in 500.

Long Follow-up (1yr+)

Participants were tracked for at least one year after vaccination.

Short follow-up windows miss delayed adverse events, waning immunity, and long-term effectiveness.

Independent Funding

Funded primarily by government, universities, or non-profits — not the manufacturer.

Industry-funded trials are statistically more likely to show positive results for the funder's product. This is a documented pattern, not an accusation.

Peer-Reviewed

Published in a peer-reviewed journal after independent scientific review.

Peer review catches methodological errors, though it is not a guarantee of correctness.

Results Reproduced

Independent researchers or real-world surveillance data confirmed the core findings.

Single trials can contain errors. When multiple independent studies find similar results, confidence increases substantially.

⭐ Gold Standard — all criteria met
Control
Random
Blind
Placebo
N≥1K
1yr+
Indep $
Peer
Repro
43,548
Participants
2 mo
Follow-up
2020
Published
BioNTech and Pfizer
Funded by
Control Group
Randomized
Double-Blind
Placebo-Controlled
Large Sample (1,000+)
Long Follow-up (1yr+)
Independent Funding
Peer-Reviewed
Results Reproduced

Study Summary

The pivotal Phase 3 trial supporting Emergency Use Authorization for the Pfizer COVID-19 vaccine. Enrolled 43,548 adults across 6 countries. Reported 95% efficacy against symptomatic COVID-19 at a median 2-month follow-up. Saline placebo used.

Strengths

Exceptionally large, multinational, rigorous randomization and blinding. Results rapidly confirmed by real-world data in multiple countries and later variants.

Limitations

2-month median follow-up — insufficient to assess waning immunity, long-term safety, or duration of protection. Entirely manufacturer-funded. Excluded immunocompromised individuals and most adults over 75.

📄 Read the published study →
30,420
Participants
2 mo
Follow-up
2021
Published
Moderna and NIAID (co-funded)
Funded by
Control Group
Randomized
Double-Blind
Placebo-Controlled
Large Sample (1,000+)
Long Follow-up (1yr+)
Independent Funding
Peer-Reviewed
Results Reproduced

Study Summary

Phase 3 trial of the Moderna vaccine enrolling 30,420 adults 18+. Reported 94.1% efficacy. Notably co-funded by NIAID (a federal agency) — making it the most independently funded of the major COVID-19 vaccine trials.

Strengths

Large, co-funded by a federal agency (NIAID), strong methodology. Included participants 65+. Results confirmed across multiple country surveillance datasets.

Limitations

2-month median follow-up. Despite NIAID involvement, Moderna held primary financial interest. Did not assess long-term immunity or rare adverse events at low frequency.

📄 Read the published study →
43,783
Participants
1 mo
Follow-up
2021
Published
Janssen Vaccines & Prevention (J&J)
Funded by
Control Group
Randomized
Double-Blind
Placebo-Controlled
Large Sample (1,000+)
Long Follow-up (1yr+)
Independent Funding
Peer-Reviewed
Results Reproduced

Study Summary

Phase 3 trial of the single-dose J&J vaccine across 8 countries. Reported 66.9% efficacy against moderate-to-severe COVID-19 at 28 days. Primary endpoint measured at 28 days post-vaccination — a much shorter window than Pfizer/Moderna's 7-day endpoint, making cross-trial comparisons unreliable.

Strengths

Very large, diverse global population. Single-dose design studied for access advantages. Saline placebo.

Limitations

28-day primary endpoint is very short. Results varied considerably by region and circulating variant. Entirely manufacturer-funded. Associated with rare thrombosis with thrombocytopenia syndrome (TTS) detected post-authorization.

📄 Read the published study →
11,636
Participants
3 mo
Follow-up
2021
Published
AstraZeneca and UK Government
Funded by
Control Group
Randomized
Double-Blind
Placebo-Controlled
Large Sample (1,000+)
Long Follow-up (1yr+)
Independent Funding
Peer-Reviewed
Results Reproduced

Study Summary

Phase 2/3 trial across UK, Brazil, and South Africa. Reported 70.4% pooled efficacy. The control group received a meningococcal vaccine (not saline) — meaning this was not truly placebo-controlled, and adverse event comparisons were not straightforward.

Strengths

Multinational design. Published in Lancet. Results confirmed by UK real-world data. Cold-chain stable design addressed global access needs.

Limitations

Control was an active vaccine, not saline. Blinding was imperfect. Combined four sub-trials with different dosing intervals. An accidental half-dose in some participants added confounding. Smallest sample of the major COVID-19 trials.

📄 Read the published study →

📋 What This Means

The major COVID-19 trials met the most critical RCT benchmarks: large, randomized, double-blind, placebo-controlled. The consistent gap was short follow-up (weeks to months, not years), preventing assessment of long-term immunity duration or delayed adverse events. All trials were manufacturer-funded. Real-world surveillance from multiple countries has confirmed core efficacy findings, particularly against severe disease.

Methodology note: This scorecard evaluates study design quality — not vaccine safety or efficacy conclusions. A study meeting fewer criteria doesn't mean the vaccine doesn't work; it means the evidence has methodological limitations. Always discuss vaccination decisions with your healthcare provider.

View Other Vaccine Scorecards

🤧 Flu⚡ Shingles🫁 Pneumonia🫀 RSV