This article looks at how the proportion “ever testing” positive for SARS-CoV-2 antibodies can be calculated using the data available from the Schools Infection Survey (SIS) and seeks feedback on whether this is a useful measure; the methodology can be refined when more data is collected over the course of the coronavirus (COVID-19) pandemic.
Calculating the proportion of pupils that “ever tested” positive for antibodies results in higher estimates of the proportion previously infected with coronavirus (COVID-19) in the local authorities sampled, compared with using just the results from the final Round 6 tests carried out in SIS.
Over the full duration of SIS, an estimated 15.30% (95% confidence intervals: 13.50% to 17.24%) of primary pupils and 17.29% (95% confidence intervals: 16.28% to 18.33%) of secondary pupils in the local authorities sampled had at least one test that recorded antibody levels above the limit of detection.
For local authority estimates, confidence intervals are wide so should be interpreted with caution, but indicate a range in antibody levels around the country; in areas where community infection rates have been relatively low throughout the pandemic the percentage of pupils with antibody levels above the limit of detection is lower than areas that have had higher rates of infection.
Have you been asked to take part in the study?
For more information, please visit the SIS participant guidance page.
If you have any further questions, please email the SIS operations team: Schools.Studies.Mailbox@ons.gov.uk.
Pupil antibody tests were collected periodically over the course of the 2020 to 2021 academic year in a sample of schools from 15 local authorities in England as part of the COVID-19 Schools Infection Survey (SIS). The pupil antibody test used in SIS was based on oral fluid collection - a non-invasive alternative to collecting blood and more suitable for self-administered use by children.
However, this test is less sensitive (estimated at 80%). Antibody levels are less concentrated in oral fluid samples compared to blood and may fall below the limit of detection for the oral fluid test more quickly, whereas they remain present in blood for longer. Therefore, some pupils who previously tested positive for SARS-CoV-2 antibodies will test negative in later rounds.
When new infections are low the net effect can lead to an apparent fall in antibody levels in the population. In the case of SIS the percent testing positive in Round 6 was lower than in Round 4. Therefore, the results cannot be used as a measure of prior COVID-19 infection over a long time period and, as the immune response does not rely on antibodies alone, these figures cannot be used as an indication of current immunity.
To try to provide a more comprehensive estimate of prior infection with COVID-19, the proportion “ever testing” positive for SARS-CoV-2 antibodies was calculated. This article looks at how the proportion “ever testing” positive can be calculated using the data available and seeks feedback on whether this is a useful measure.Nôl i'r tabl cynnwys
As part of this analysis, we also considered two alternative methods for calculating those “ever testing” positive.
The first alternative method (Method 2) selected just those tested as part of Round 6 and counted previous positive tests if available for the participant. This method also has similar limitations to the preferred method (Method 1) (not all Round 6 participants have data from a previous round). Additionally, those who were not available or chose not to participate in Round 6 would also be excluded, despite having valid data from previous rounds.
Another alternative (Method 3) would be to only analyse those that had test results from each of the four main testing rounds to see what proportion had tested positive at least once. However, this method would result in a very small number of participants available for analysis (2,780), which means the data could not be weighted separately for primary and secondary pupils, and local authority estimates would also not be possible. Consequently, this method has been discounted. Table 2 shows the comparison between the adjusted estimate for Round 6 positivity (used in our Round 6 bulletin), the preferred method for “ever positive” (Method 1) and the first alternative method (Method 2).
Both methods of “ever tested” positive result in a significantly higher estimate of the proportion of secondary pupils infected with COVID-19. For primary pupils both methods are also higher, but the difference is not significant, partly because of the smaller number of primary pupils sampled, which results in wider confidence intervals.
In the future, by incorporating NHS Test and Trace data, it would also be possible to look at previous positive PCR test results, which would help fill in data gaps where a participant does not have a full years’ worth of antibody test results.
|Method 1||Method 2|
Download this table Table 2: Comparison of other “ever positive” methods.xls .csv
More about coronavirus
COVID-19 Schools Infection Survey estimate of pupils ever testing positive for antibodies
Dataset | Released 27 October 20
Experimental statistics providing estimates of pupils ever testing positive for SARS-CoV-2 antibodies from the COVID-19 Schools Infection Survey across a sample of schools, within selected local authority areas in England.
The Coronavirus (COVID-19) Schools Infection Survey analysis was produced by the Office for National Statistics (ONS) in collaboration with our research partners at the London School of Hygiene and Tropical Medicine and UK Health Security Agency.Nôl i'r tabl cynnwys
A confidence interval gives an indication of the degree of uncertainty of an estimate, showing the precision of a sample estimate. The 95% confidence intervals are calculated so that if we repeated the study many times, 95% of the time the true unknown value would lie between the lower and upper confidence limits. A wider interval indicates more uncertainty in the estimate. Overlapping confidence intervals indicate that there may not be a true difference between two estimates. For more information, see our methodology page on statistical uncertainty.
A result is said to be statistically significant if it is likely not caused by chance or the variable nature of the samples. For more information, see our methodology page on statistical uncertainty.
Data presented in this bulletin are from the COVID-19 Schools Infection Survey (SIS). These findings are for SARS-CoV-2 antibodies for pupils only.
Estimates have been weighted and are representative of the ethnicity, gender, and age for all pupils in the sampled local authorities.
Our methodology article provides further information about response rates, survey design, how we process data and how data are analysed.
Antibody testing was carried out in schools on the following dates:
between 3 and 20 November 2020 (referred to as Round 1)
between 30 November and 11 December 2020 (referred to as Round 2)
between 15 and 31 March 2021 (referred to as Round 4)
between 14 June and 6 July 2021 (referred to as Round 6)
Round 3 was due to take place in late January 2021. Testing within schools for this round was cancelled because of restricted attendance in schools during the national lockdown; however, home antibody tests were carried out for new participants who joined the study after Round 2 and for those who did not receive a valid test result from Rounds 1 or 2.
More quality and methodology information on strengths, limitations, appropriate uses, and how the data were created is available in our methodology article.
Data cleaning and quality assurance is being carried out on data collected as part of the study on an ongoing basis. All estimates presented in this bulletin are provisional results and presented as experimental statistics while we seek feedback on the methods used. Estimates may therefore be revised in future publications.
Strengths and limitations
Please refer to the strengths and limitations section of the COVID-19 Schools Infection Survey, Round 2 bulletin.Nôl i'r tabl cynnwys
Manylion cyswllt ar gyfer y Erthygl
Ffôn: +44 208 039 0326