Introduction
WHO coronavirus disease (COVID-19) dashboard.
The authorisation of several vaccines has followed multiple international randomised controlled trials. As of April 1, 2021, two vaccinations against SARS-CoV-2 are in use in the UK: an mRNA-based vaccine (BNT162b2; tozinameran) produced by Pfizer Inc and BioNTech SE and a replication-deficient simian adenovirus vector ChAdOx1 nCoV-19 (Vaxzevria) from Oxford University and AstraZeneca. Both contain nucleic acid coding for the full-length structural surface glycoprotein (spike protein) of SARS-CoV-2. Two doses of BNT162b2 have 95% (95% CI 90–98) efficacy at least 7 days after the second dose against symptomatic SARS-CoV-2 infection in participants without evidence of previous COVID-19 infection.
- Polack FP
- Thomas SJ
- Kitchin N
- et al.
Early in 2021, researchers reported that BNT162b2 has an effectiveness of 73% (95% CI 62–82) at 21–27 days after the first dose against symptomatic disease in people older than 70 years in Israel.
- Dagan N
- Barda N
- Kepten E
- et al.
After two doses, ChAdOx1 nCoV-19 has 70% efficacy at least 14 days after the second dose against symptomatic SARS-CoV-2 infection in seronegative participants,
- Voysey M
- Clemens SAC
- Madhi SA
- et al.
with some evidence of increasing protection as dose interval increases.
- Voysey M
- Costa Clemens SA
- Madhi SA
- et al.
Evidence shows that neutralising antibodies are detectable 28 days after a single ChAdOx1 nCoV-19 dose in adults aged at least 70 years.
- Ramasamy MN
- Minassian AM
- Ewer KJ
- et al.
Data from Public Health England (PHE) show a relative risk of hospitalisation, more than 14 days after first dose, of 0·57 (95% CI 0·48–0·67) for BNT162b2 and 0·63 (0·41–0·97) for ChAdOx1 nCoV-19 in people aged at least 80 years, when using date of first positive test and of admission to hospital.
- Lopez Bernal J
- Andrews N
- Gower C
- et al.
UK medicines regulator gives approval for first UK COVID-19 vaccine.
The UK national BNT162b2 vaccination programme started on Dec 8, 2020. Authorisation for ChAdOx1 nCoV-19 followed on Dec 30, 2020, with first administration of ChAdOx1 nCoV-19 on Jan 4, 2021. The Joint Committee on Vaccination and Immunisation (JCVI) advised targeting vaccines towards those at highest risk of severe disease: residents in long-term care facilities (LTCFs) and their carers, patients aged at least 80 years, and frontline health and social care workers.
Advice on priority groups for COVID-19 vaccination.
However, several other European countries have deferred ChAdOx1 nCoV-19 vaccination in adults older than either 55 or 65 years owing to the absence of efficacy or effectiveness evidence in those age groups, despite high infection and hospitalisation incidences.
Evidence before this study
We searched PubMed and medRxiv for observational studies published between Dec 1, 2020, and Feb 10, 2021, using the terms “COVID19 vaccine effect”, “SARS-CoV-2” or “COVID-19”, “vaccine”, and “effectiveness”. We selected articles with no language restrictions. Our search returned five studies, all of which were relevant to this topic. A case-control study found one dose of BNT162b2 has an estimated effectiveness against symptomatic disease in people aged 70 years and older of 62% (95% CI 43–77) at 14–21 days after first dose and 73% (95% CI 62-82) at 21–27 days after first dose. A paper authored by Public Health England employees using positive testing reported a relative risk of hospitalisation of 0·57 (0·48–0·67) and 0·63 (0·41–0·97) more than 14 days after first dose in adults aged at least 80 years with BNT162b2 or ChAdOx1 nCoV-19 respectively. A preprint reported one dose vaccine effectiveness against hospitalisation of 85% (95% CI 76–91) and 94% (73–99) 28–34 days after first dose BNT162b2 and ChAdOx1 nCoV-19 respectively, and in adults aged at least 80 years 81% (65-90) for the two vaccines analysed together. One preprint reported a 51% relative risk reduction against SARS-CoV-2 symptomatic infection 13–24 days after the first BNT162b2 vaccine dose, in a cohort of 503 875 individuals. The SIREN study in health-care workers with a median age of 46·1 years reported vaccine effectiveness of 70% (95% CI 55–85) 21 days after first dose of BNT162b2 against SARS-CoV-2 infection (symptomatic and asymptomatic).
Added value of this study
To date, few real-world data exist on the effectiveness of one dose of the BNT162b2 or ChAdOx1 nCoV-19 vaccines, and data for the effectiveness of ChAdOx1 nCoV-19 against COVID-19 disease are scarce in people aged at least 70 years. This test-negative, case-control study reports the effect of one dose of BNT162b2 or ChAdOx1 nCoV-19 vaccine against admission to hospital in people aged at least 80 years, who were often frail and had comorbidities, using symptom onset to determine vaccine effect, which increases accuracy when determining one-dose vaccine effectiveness, addressing an urgent public health question. We excluded patients with symptoms starting more than 10 days before admission, to reduce bias from false-negative SARS-CoV-2 tests.
Implications of all the available evidence
Our findings provide evidence that one dose of either the BNT162b2 or ChAdOx1 nCoV-19 vaccine, currently used in the UK vaccination programme, substantially reduces the risk of COVID-19-related hospital admissions, in individuals aged at least 80 years old on March 31, 2021.
Optimising the COVID-19 vaccination programme for maximum short-term impact.
In the context of these policies, this test-negative case-control study aimed to assess the effectiveness of a single BNT162b2 or ChAdOx1 nCoV-19 vaccine dose against COVID-19-related admissions to hospital for people aged at least 80 years in Bristol, UK.
Methods
Study design and participants
- Verani JR
- Baqui AH
- Broome CV
- et al.
,
- Lipsitch M
- Tchetgen Tchetgen E
- Cohen T
of consecutive adults admitted to one hospital (Southmead Hospital) in North Bristol NHS Trust or one hospital (Bristol Royal Infirmary) in University Hospitals Bristol and Weston NHS Foundation Trust with signs and symptoms of respiratory disease between Dec 18, 2020 (ie, 10 days after administration of BNT162b2 started), and Feb 26, 2021, inclusive. Enrolment started at this time point because the Kaplan-Meier graph in the phase 3 BNT162b2 study showed divergence between controls and vaccinees from 10 days post-vaccination.
- Polack FP
- Thomas SJ
- Kitchin N
- et al.
Patients with signs and symptoms of respiratory infection and who would be aged at least 80 years on March 31, 2021 (ie, the age group initially targeted for vaccination) were included in this analysis. A clinician identified eligible test-positive and test-negative individuals from the medical admission list. Clinical data were collected from electronic and paper patient records and recorded on an electronic clinical record form using REDCap.
- Harris PA
- Taylor R
- Thielke R
- Payne J
- Gonzalez N
- Conde JG
Data collection methods were identical for the test-positive and test-negative groups. To avoid observer bias, all data were collected by individuals who were not involved in data analysis and blinded to the results.
Vaccination records (ie, vaccination brand and date of administration) for each study patient were obtained from linked hospital and GP records, including vaccinations delivered at vaccination hubs. Vaccination data were collected by individuals blinded to participants’ SARS-CoV-2 test results.
This study was approved by the Health Research Authority Research Ethics Committee (East of England, Essex, UK), including data collection under Section 251 of the 2006 NHS Act authorised by the Confidentiality Advisory Group.
All adults admitted to the two participating hospitals—which encompass all the acute adult secondary care facilities in Bristol—were screened for signs and symptoms of respiratory disease, including: documented fever (≥38°C) or hypothermia (<35·5°C); cough; increased sputum volume or sputum discolouration; pleurisy; dyspnoea; tachypnoea; examination findings compatible with acute lower respiratory tract disease (eg, crepitations); or radiological changes suggestive of acute respiratory tract disease. Patients with at least two of these signs, or a confirmed clinical or radiological diagnosis of acute lower respiratory tract disease, were included.
Patients who developed symptoms before receiving their vaccine or those who received their vaccine after admission were excluded, as were those with symptoms that started more than 10 days before admission to avoid including patients with potentially false negative admission SARS-CoV-2 tests. To avoid bias due to nosocomial infection, readmissions data were excluded (ie, only the first admission of each patient was counted).
Guidance and standard operating procedure COVID-19 virus testing in NHS laboratories.
Test-negative individuals (controls) had to have respiratory disease and a negative SARS-CoV-2 result.
Procedures
We studied the effectiveness of the first dose of BNT162b2 (Pfizer) vaccine and ChAdOx1 nCoV-19 (Oxford–AstraZeneca) vaccine. Individuals were defined as exposed if they had received a single dose of either vaccine between Dec 8, 2020 (Pfizer) or Jan 4, 2021 (Oxford–AstraZeneca), and Feb 12, 2021, with recruitment censored between Feb 26, 2021, and the latest event date. Unvaccinated or unexposed individuals in the analyses had received neither vaccine.
- Charlson ME
- Pompei P
- Ales KL
- MacKenzie CR
and Rockwood clinical frailty score (with a score of 5–9 indicating frailty).
- Rockwood K
- Song X
- MacKnight C
- Bergman H
- Hogan DB
- McDowell I
- Mitnitski A
Outcomes
Our primary outcome was the vaccine effectiveness of first doses against hospital admissions with respiratory infection. Vaccine effectiveness of first dose was assessed at least 14 days after receipt of first dose. Those developing symptoms within 14 days of receipt of first vaccine dose were excluded from the primary analysis but were assessed in a separate bias detection analysis (negative control).
Statistical analysis
,
Although this calculation was sensitive to vaccine uptake in controls, we predicted that, with 80% power and a two-sided α of 0·05, at 80% receipt of first dose in controls an odds ratio (OR) of vaccination of 0·3 could be detected from at least 53 test-positive individuals.
Finally, to explore the possible effect of instabilities during the first weeks of the vaccine programme, we analysed the apparent effectiveness of BNT162b2 during the period in early 2021 when ChAdOx1 nCoV-19 was also used (between Jan 4, and Feb 26, 2021). To assess likely levels of residual bias, we did a negative control analysis in which we calculated the apparent effectiveness of one dose of vaccine during the period up to 14 days after administration, when no protection was expected. Analyses for each vaccine were done separately.
We compared proportions using Fisher exact tests and compared parametric data using Student’s t-tests. We used R (version 4.0.2) for all statistical analyses. Regarding missing data, we planned to exclude participants for whom vaccine status could not be determined. Statistical significance was defined using two-sided significance level of α=0·05.
This study is registered with ISRCTN, number 39557.
Role of the funding source
The study sponsor collaborated in the design of the study and commented on the drafted manuscript. The sponsor had no role in data collection, data analysis, data interpretation, or writing of the report.
Results
Weekly publication of COVID-19 vaccinations.
Between Dec 18, 2020, and Feb 26, 2021, 6673 adults (aged ≥18 years) were admitted to participating hospitals in Bristol (figure 1). 2741 had signs or symptoms of respiratory disease; of whom 803 (29%) were aged at least 80 years and 466 were enrolled. Missing data were minimal; vaccine status could not be determined for 26 patients (figure 1). No imputation was done. 144 (31%) of 466 enrolled patients tested positive for SARS-CoV-2. The designation of test-positive and test-negative groups is shown in figure 2. The period of observation from vaccination to data cutoff (Feb 26, 2021) for this analysis was 34–80 days for BNT162b2 and 19–64 days for ChAdOx1 nCoV-19.

Figure 1Study profile
Total study cohort of 144 SARS-CoV-2-positive individuals divides into 135 BNT1626b vaccinated and unvaccinated cases and nine ChAdOx1 nCoV-19 vaccinated cases, with the 27 unvaccinated cases in the ChAdOx1 nCoV-19 group shared from the unvaccinated cases in the BNT1626b group. *Aged at least 80 years by March 31, 2021.

Figure 2Euler diagram of study cohorts
Total study cohort of 144 SARS-CoV-2-positive cases and 322 SARS-CoV-2-negative controls, separated into the BNT1626b group (135 test-positive and 269 test-negative) and ChAdOx1 nCoV-19 group (36 test-positive and 90 test-negative). The ChAdOx1 nCoV-19 group is smaller due to the later introduction of this vaccine (on Jan 4, 2021), thus only the subset of controls identified after this date were eligible for this analysis.
- Charlson ME
- Pompei P
- Ales KL
- MacKenzie CR
Table 1Baseline characteristics of study cohort
Data are n (%) unless otherwise stated. To maintain patient confidentiality, data with fewer than five patients have been amended to <5.
Table 2Vaccine effectiveness for one dose of BNT162b2 or ChAdOx1 nCoV-19
IMD=index of multiple deprivation.
- Charlson ME
- Pompei P
- Ales KL
- MacKenzie CR
Table 3Characteristics of individuals who received one dose of either BNT162b2 or ChAdOx1 nCoV-19
Data are n (%) unless otherwise stated. To maintain patient confidentiality, data with fewer than five patients have been amended to <5.
Discussion
As the rollout of available COVID-19 vaccines continues globally, there is an urgent need for real-world effectiveness data, particularly relating to severe disease in people aged at least 80 years—a high-risk group and a primary target for the UK vaccination programme. Furthermore, few people aged at least 80 years have been enrolled in randomised control trials of COVID-19 vaccines to date. All observational studies are subject to bias and more so in the context of current rapid changes in disease epidemiology and vaccine deployment strategy and operationalisation. By undertaking a comprehensive prospective systematic surveillance study in two large hospitals in one city, we were able to collect a much more detailed and accurate dataset than can be obtained from routine coding and admission databases. Although our work on this topic is ongoing and will deliver more granularity and precision over time, initial results are of immediate relevance to the formulation of and adjustments to current vaccination strategies in different countries using these vaccines.
- Polack FP
- Thomas SJ
- Kitchin N
- et al.
of BNT162b2 enrolled few adults aged at least 80 years and evaluated the efficacy of two doses of BNT162b2 against symptomatic COVID-19; although the trial gave an indication of efficacy against admissions to hospital, the estimate was imprecise due to the scarcity of hospitalised participants. Thus, our findings of the vaccine effectiveness of a single dose of BNT162b2 in preventing hospital admission from COVID-19 infection in people aged at least 80 years, who were often frail and had many comorbidities, was encouragingly high.
- Vasileiou E
- Simpson CR
- Shi T
- et al.
our study was restricted to the people aged at least 80 years and we adjusted for changes in exposure risk and groups targeted for vaccination over time. Our findings are consistent with a preprint by PHE, which reported a hazard ratio of 0·57 (0·58–0·67) for admissions to hospital (excluding accident and emergency) when undergoing COVID-19 testing more than 14 days after the first dose of BNT162b2.
- Lopez Bernal J
- Andrews N
- Gower C
- et al.
Similarly, the SIREN study reported a one-dose BNT162b2 vaccine effectiveness of 70% (95% CI 55–85) at 21 days in health-care workers.
- Hall VJ
- Foulkes S
- Saei A
- et al.
SARI-Watch reported the effectiveness of BNT162b2 to be 57% (95% CI 48–63) after first dose in participants aged at least 80 years.
PHE monitoring of the early impact and effectiveness of COVID-19 vaccination in England.
A case-control study from Israel found the estimated effectiveness of BNT162b2 against symptomatic disease in adults aged at least 70 years was 44% (95% CI 49–64) at 14–24 days after one dose and 64% (37–83) at 21–27 days after one dose.
- Dagan N
- Barda N
- Kepten E
- et al.
In the same cohort, one dose of BNT162b2 had an estimated effectiveness against hospitalisation of 74% (95% CI 56–86) at 14–24 days after first dose and 78% (61–91%) at 21–27 days after first dose.
- Dagan N
- Barda N
- Kepten E
- et al.
Other studies from Israel have reported that one dose of BNT162b2 has an effectiveness against COVID-19 laboratory-confirmed infection of 51% at 13–24 days after first dose,
- Chodick G
- Tene L
- Patalon T
- et al.
or 75% at 15–28 days after first dose.
- Amit S
- Regev-Yochay G
- Afek A
- Kreiss Y
- Leshem E
Taken together, our results and those of other studies suggest that, although substantial effectiveness can be expected after only one dose of BNT162b2, even in high-risk individuals, a second dose provides valuable additional protection.
- Lopez Bernal J
- Andrews N
- Gower C
- et al.
The results from this test-negative, case-control study show that a single dose of ChAdOx1 nCoV-19 induces a high level of protection against severe COVID-19 disease in a real-world patient group aged at least 80 years.
- Voysey M
- Costa Clemens SA
- Madhi SA
- et al.
Neutralising anti-spike IgG antibody levels after a single vaccine dose peaked at day 28 post-vaccination. However, participants who received only a single dose of ChAdOx1 nCoV-19 had a median age of 36·3 years (IQR 28·0–48·0), and were therefore much younger than our cohort.
- Voysey M
- Clemens SAC
- Madhi SA
- et al.
Data released from Scotland in April, 2021, reported 74–94% effectiveness of one dose of ChAdOx1 nCoV-19 against admission to hospital in the entire population between January and mid-February, 2021.
- Vasileiou E
- Simpson CR
- Shi T
- et al.
The point estimates for the one-dose effectiveness of each of the two vaccines in this study should not be compared with the other for several reasons. The 95% CIs overlap widely. Contrasting the cases in the two distinct vaccine analyses show several differences. The Pfizer BNT162b2 vaccine was introduced in the UK when numbers of cases were rising, but were considerably lower than case numbers were in early January, when ChAdOx1 nCoV-19 vaccination started. Perhaps more importantly, a sensitivity analysis restricting the observation period for BNT162b2 to the same period over which ChAdOx1 nCoV-19 was studied, resulted in point estimates for the two vaccines that were almost identical (79·3% for BNT162b2 and 80·4% for ChAdOx1 nCoV-19). This finding suggests that people aged at least 80 years who received one dose of BNT162b2 in December, 2020, might have been at greater COVID-19 risk than individuals who received either vaccine in January, 2021. Thus, changes in vaccine deployment and hospital care during the study period might have biased results to some degree in the earliest weeks of the programme. Such changes could have included, but are not been limited to, improvements in the avoidance of vaccinating people already infected and, in some cases, symptomatic with COVID-19; infection control improvements in vaccination clinics; and, reduced exposure of individuals who had been successfully shielding themselves up to the time of immunisation.
- Wheelock A
- Miraldo M
- Thomson A
- Vincent C
- Sevdalis N
meaning that our study is not subject to the biases associated with fee-based or insurance-based health care. Second, by using a regression analysis that adjusted for week of symptom onset, we reduced the risk of bias attributable to any prioritisation that might have occurred in vaccination strategy or changes in background COVID-19 rates and, therefore, exposure to infection. Third, we also adjusted for socioeconomic status using index of multiple deprivations because this might affect an individual’s likelihood of vaccine uptake, infection, and severe disease rates.
- MacKenna B
- Curtis HJ
- Morton CE
- et al.
Fourth, we used the date of symptom onset to define the start of illness and provide a time estimate for infection after vaccination. We were, therefore, able to define the start of illness relative to both vaccine administration and hospitalisation accurately, without relying on the date of first positive COVID-19 test, eliminating bias or misclassification that could occur via the use of test date alone (which can vary widely). Finally, the observed ORs for both vaccines over the first 14 days after administration—when no protection was to be expected—were both close to 1 (although the confidence intervals were wide) suggesting that there was, at worst, only limited bias in these cohorts over the periods studied.
- Harper H
- Burridge A
- Winfield M
- et al.
Second, we did not measure the effect of one dose in individuals who were not admitted to hospital with COVID-19, and there might be treatment bias where people of advanced age are not referred to hospital. This study provides vaccine effectiveness estimates in secondary care settings only, not including general practice or accident and emergency consultations which did not result in hospitalisation. Individuals who died before admission to hospital or who were otherwise not referred to hospital were not included in this study. Patients with severe disease seen in general practice or accident and emergency might have been included in this analysis (via referral), and biased results towards lower vaccine effectiveness. It is also possible that weak or moderate protection induced by vaccination could result in slower disease progression and longer intervals from symptom onset to hospitalisation for vaccinated individuals.
Third, sampling and processing might have resulted both in false positive and negative PCR results, which could have rendered the effectiveness estimates imprecise to some degree with uncertain direction and size of any such biases.
Fourth, the study cohort was predominantly White and the effectiveness of these vaccines might differ in individuals from other ethnic backgrounds. This study specifically excluded individuals with asymptomatic disease and cannot determine the effectiveness of one vaccine dose against asymptomatic disease or transmission.
Fifth, this analysis was done in one location on a small number of participants and, by necessity, over a short time period, which restricts the generalisability of the findings.
Sixth, we did not assess vaccine effectiveness against individual variants of SARS-CoV-2, and this was not being comprehensively tested on standard-of-care specimens during the study period. However, selective sequencing data indicate that almost all cases during the study period were B.1.1.7, with a small number of wild-type variants. Finally, although we controlled for time in our analysis, we cannot fully account for temporal changes due to background exposure to infection, prevalence of variants of concern, or rising rates of vaccine receipt with emerging differences in characteristics between vaccine recipients and non-recipients in the study age range. A larger, individually matched cohort study is required to control for these potential confounders better.
In summary, the findings of our case-control analysis will help to guide strategy development for the use of BNT162b2 and ChAdOx1 nCOV-19 vaccines in clinical practice and should reassure policy makers of the high value of deploying these vaccines, and the importance of administering two doses, in high-risk populations in whom incidence of severe disease and death from SARS-CoV-2 infection remains high.
CH, RM, LD, JO, and AF generated the research questions and analysis plan. CH, ZM, JK, LW, KF, RH, AT, ZF, LM, GR, RA, DA, MG, and ZSB were involved in data collection. CH and AF verified the data. CH, RM, LD, and AF undertook data analysis. AF provided oversight of the research. All authors had full access to all data in the study, had final responsibility for the decision to submit for publication, and were involved in the final manuscript preparation and its revisions before publication.
More Stories
What will it look like when we arrive? – George Couros
Measuring Student Engagement with Digital Tools
Reimagining Waste Tracking and Reduction: An Interview with Jamie DelliSanti