1. Executive summary April to June 2017

Summary of achieved sample size

The achieved sample size for the UK Labour Force Survey (LFS) during April to June 2017 (AJ17) was 88,801 individuals in 37,287 households. Please note that there were no NHS households in this period. Compared with the previous quarter January to March 2017 (JM17) this represents a decrease of 0.2% in household interviews and an increase of 0.3% in achieved person interviews.

Summary of response rates

Please note that historical reports can also be accessed.

In AJ17 main response rates were as follows:

  • the total response rate for Great Britain excluding imputed cases (Table 2) was 42.0%; this is down 1.2 percentage points on the previous quarter

  • the response rate excluding imputed cases (Figure 3) was 53.6% in wave 1 and 36.4% in wave 5; this compares with 54.0% and 37.2% respectively in the previous quarter

  • the total response rate for Great Britain including imputed cases (Table 3) was 48.8%, down 0.2 percentage points on the previous quarter

  • of non-response in AJ17 (Figure 4), non-contacts comprised 17.1% (down 0.1 percentage points on the previous quarter), circumstantial refusals were 10.4% (up 0.3 percentage points), outright refusals comprised 54.3% (up 0.1 percentage points on the previous quarter) and other refusals comprised the remainder

  • the regions with the highest accumulated response rate across the 5 waves (Table 6) were “West Yorkshire” and “Rest of Yorkshire and Humberside” (56.2%); the lowest were “Merseyside” and “Inner London” (45.1%)

  • the overall proxy response rate (Table 7) was 34.1%; the highest proxy response rates occur in the 16 to 17 age group (88.4%), in males (38.7%) and in the non-white ethnicity group (42.9%)

  • the average income response rate (Table 8) was 85.9%

  • the data on attrition rates are shown in Table 9; these data reveal in percentage change terms that those who drop out of the survey between waves 1 and 5 are over-represented in the 20 to 29 age bands, employees, in households with five people, and amongst those living in Outer London

Notes:

  1. Methodological changes in January to March 2011 (JM11) and July to September 2010 (JS10) have impacted response rates. From JM11 a proportion of initial interviews have been conducted by the telephone unit rather than face-to-face as an efficiency measure. Telephone interviews generally have higher levels of non-response. The removal of households with residents aged 75 and older after their initial interview from JS10 also impacts response as these households generally have high response rates. See the 'Questionnaire changes' section for more detail.

Questionnaire changes

Changes to State Pension age were introduced in 2010, which affected labour market and LFS publications, as well as other social surveys. Under the Pensions Act 2011, women's State Pension age will increase more quickly (than originally planned) to 65 between April 2016 and November 2018. From December 2018, the State Pension age for both men and women will start to increase to reach 66 by October 2020.

From JS10, households that only contain respondents aged 75 and older are removed from the sample after their wave 1 interview. This change was introduced to reduce the cost of the survey and reduce the burden on respondents. Households only containing individuals aged 75 or older are largely economically inactive and therefore the value of interviewing these households is greatly reduced when considering the main aims of the LFS. The wave 1 interviews from 75 and older households will receive a larger weight to make them representative of the UK population. This change results in around a 10% reduction in the household sample size and a 7% reduction in the individual sample size.

From JS10, the treatment of “concealed multi-households” on the LFS has also changed. Previously if one sampled address turned out on inspection to be, for example, not one house but six flats, all six flats would be recorded as households and interviews would be attempted with each household. The number of households encountered could be in the hundreds. This was not a practical approach. We decided to harmonise the approach to multi-households across all our social surveys. From JS10, if a concealed multi-household is recorded only one household will be randomly selected to be interviewed.

Following a pilot run in JS10, from JM11 onwards a proportion of wave 1 cases (around 15 to 20%) have been interviewed by the Telephone Unit (TU) as opposed to the traditional face-to-face method (FtF). Sampled addresses are matched to telephone numbers in order to do this. Potential concerns associated with this approach are twofold; that response rates will fall as sampled respondents may be more likely to refuse a telephone survey and that mode effects may be observed in the data collected. This situation will be monitored.

Details of fieldwork issues and new, amended and deleted questions can be found in Section 7.

Nôl i'r tabl cynnwys

2. Summary of quality

2.1 Relevance

The degree to which the statistical product meets user needs for both coverage and content.

Primary purpose

The primary purpose of the Labour Force Survey (LFS) is "the prompt publication of key aggregate, whole economy, indicators, for the integrated assessment of labour market conditions" (Review of the Labour Force Survey, ONS, 2002). The “labour market” covers all aspects of people's work, including the education and training needed to equip them for work, the jobs themselves, job-search for those out of work and income from work and benefits.

Users and uses

Users of LFS data often combine it with related data from other sources to provide an overall view of the state of the labour market. One of the most important users of this sort of assessment is the Bank of England's Monetary Policy Committee, which sets interest rates in order to meet the government's inflation target.

Other important users of LFS data are HM Treasury and the Department for Work and Pensions, because they are responsible for UK economic and labour market policy. They are interested in a variety of indicators of the state of the labour market, including the number of people in employment, the number of hours worked and the number of unemployed people (defined according to the International Labour Organisation - ILO). They often analyse these series by age groups, by regions and by sex. Other government users include the Department for Business, Energy and Industrial Strategy (BEIS), the Home Office, the Health and Safety Executive, the Scottish Government, and the Welsh Government.

At the international level, LFS data are used by the European Parliament, Council and Commission, the European Central Bank and DG Employment (Directorate-General for Employment, Social Affairs and Equal Opportunities). It is also used by the Organisation for Economic Co-operation and Development (OECD) and the International Labour Organisation.

Other users include local authorities, the Trades Union Congress (TUC), the Employer's Association, the Confederation of British Industry, the Institute of Employment Studies, the Institute for Public Policy Research, the National Institute of Economic and Social Research, the Policy Studies Institute, the Institute for Fiscal Studies, academic researchers, the media and the general public.

Strengths and limitations

The strengths of the LFS are that it has the largest coverage of any household survey in the UK and can thus generate statistics for small geographical areas. In addition, the sampling errors are relatively small, as a result of the wave structure and the size of the survey. The survey covers a large range of employment-related variables and non-employment-related variables, allowing cross-linking analyses to be undertaken (for example, earnings against educational attainment).

One of the limitations of the LFS is that the sample design provides no guarantee of adequate coverage of any industry, as the survey is not industrially stratified. The LFS coverage also omits communal establishments, except NHS housing, students in halls of residence and at boarding schools. Members of the armed forces are only included if they live in private accommodation. Also, workers under 16 are not covered.

Main definitions

The definitions of the three economic activity groups – employed, unemployed and economically inactive – that are used in the LFS are the standard International Labour Organisation (ILO) definitions. It should be noted that although the LFS uses ILO definitions, these definitions are not interpreted and applied in exactly the same way in different countries. For example, although “working age” is a common term, different countries have different statutory school leaving and retirement ages. However, Eurostat collects data from member states and adjusts them to produce comparable estimates.

2.2 Accuracy

The closeness between an estimated result and the (unknown) true value.

The main threats to accuracy are sources of error, namely sampling error and non-sampling error, where non- sampling error includes: coverage error, non-response error, measurement error, processing error and model assumption error.

Many of the sources of non-sampling error are difficult to measure. However, the LFS publishes detailed response rates for all waves of the survey and an overall response rate, including time series (Tables 2 to 5 and Figures 3 and 4). Response rates are also published by government region for each wave during the particular quarter (Table 6). The LFS also publishes proxy response rates (Table 7), response rates for income questions by National Statistics (NS) Socio-Economic Classification (Table 8) and attrition rates (Table 9).

Surveys, such as the LFS, provide estimates of population characteristics rather than exact measures. In principle, many random samples could be drawn and each would give different results, due to the fact that each sample would be made up of different people, who would give different answers to the questions asked. The spread of these results is the sampling variability, which generally reduces with increasing sample size. A confidence interval is a range of values, defined by a lower and upper bound, which indicates the variability of an estimate. Statistical methods are used to calculate the sampling variability from which the confidence interval can be determined. For example, with a 95% confidence interval, it is expected that in 95% of the survey samples, the resulting confidence interval will contain the true value that would be obtained by surveying the whole population.

The LFS routinely publishes details of achieved sample sizes in terms of achieved number of household and person interviews (Table 1 and Figures 1 and 2) and sampling variability for estimates of main variables. Sampling variability (95% confidence intervals) can be found in the ‘Sampling variability' section (Table A11) of the Labour market statistical bulletin.

Nôl i'r tabl cynnwys

3. Achieved sample

Nôl i'r tabl cynnwys

4. Response rates

Nôl i'r tabl cynnwys

5. Timeliness and punctuality

Timeliness refers to the lapse of time between publication and the period to which the data refer. Punctuality refers to the time lag between the actual and planned dates of publication.

To ONS Labour Market Division (LMD)

Scheduled delivery date for file: 24 July 2017
Achieved delivery date for file: 24 July 2017

Time lag between achieved delivery date and the end of the reference period: 22 days

Data file for other users

Scheduled availability date for regional public and government normal release user files: 16 August 2017

Recipients

Bank of England
Department for Business, Energy and Industrial Strategy

Department for Communities and Local Government
Department for Education and Skills
Department for Enterprise, Trade and Investment (Northern Ireland)
Department for Digital, Media, Culture and Sport
Department for Transport
Department for Work and Pensions
Department of Finance and Personnel (Northern Ireland)
Economic and Social Research Council/Data Archive
Health and Safety Executive
HM Treasury
Home Office
Low Pay Commission
Office for Standards in Education
Office of Manpower Economics
Scottish Government/Scottish Executive
Small Business Service
Welsh Government

Nôl i'r tabl cynnwys

6. Accessibility and clarity

Accessibility is the ease with which users are able to access the data, also reflecting the format(s) in which the data are available and the availability of supporting information. Clarity refers to the quality and sufficiency of the metadata, illustrations and accompanying advice.

The UK Data Archive at Essex University provides free access to the various LFS datasets.

A highly disaggregated dataset, which covers a wealth of data for local areas, is available free from NOMIS.

The Social Surveys Team provide LFS data for a fee, and can be contacted by phone (+44 (0)1633 455678) or email: socialsurveys@ons.gov.uk

Labour market data, including data from the LFS, are published every month through statistical bulletins. These include text, tables and charts. Data contained within the bulletins are available to download, free of charge.

For questions relating to labour market statistics, please contact: labour.market@ons.gov.uk

For general queries about the LFS, please contact: lfs@ons.gov.uk

Nôl i'r tabl cynnwys

7. Comparability

Comparability is the degree to which data can be compared over time and domain.

Background

The Labour Force Survey (LFS) began in 1973 and was carried out every 2 years until 1983. Between 1984 and 1991, data were collected annually and the survey has been running in its present form, with quarterly sampling, since spring 1992. It is carried out under European Union regulations, which specify the way in which the survey should be conducted, the quality of the results that member states supply to Eurostat and the timetable for supplying results. Although the LFS began as a survey designed to meet international obligations, its primary purpose is now (as stated in section 2.1, Relevance), "the prompt publication of key aggregate, whole economy, indicators, for the integrated assessment of labour market conditions" (Review of the Labour Force Survey, ONS, 2002).

Definitions

The definitions of the three economic activity groups – employed, unemployed and economically inactive – which are used in the LFS are the standard International Labour Organisation (ILO) definitions.

Economically active – those aged 16 or over, who are either employed or unemployed in the survey reference week.

Employed – those aged 16 or over, who are regarded as in employment if they did at least 1 hour of work in the reference week (as an employee, self-employed, unpaid workers in a family business or participants in government-supported training schemes) and those who had a job that they were temporarily away from (for example, if they are on holiday).

Unemployed – those aged 16 or over, who are without work, want a job, have actively sought work in the last 4 weeks and are available to start work in the next 2 weeks; or are out of work but have found a job and are waiting to start it within the next 2 weeks.

Economically inactive – those who are neither in employment nor unemployed. This group includes, for example, all those who are looking after a home or family, have a long-term illness or disability that prevents them working or are retired.

Unpaid family workers – those who are doing unpaid work in a family business.

Questionnaire changes

New questions for April to June 2017 (AJ17):

Questions on sickness absence have been added, and some old questions replaced: HWW4WK replaced with EMPSICK4; HWWRET replaced with HWRET12E and HWRET12S; ILLST17 DIFPER, WKSK4, ABSWK, CONTAB, ILNE12M and ILNE12SE added as new questions.

A further new question has been added – INTETM – which captures a respondent's intention to remain in the UK for a year if they arrived less than 12 months prior to interview.

Amended questions for April to June 2017 (AJ17): None.

Deleted questions for April to June 2017 (AJ17): INTUSE has been made a January to March (JM) question only so will not appear in other quarters from AJ17 onwards.

Fieldwork issues

No field work issues for this period.

Methodology

See Section 1 for full details of methodological changes; in January and March 2011 (JM11) a change was implemented to move some wave 1 interviews into the telephone unit, rather than being face-to-face interviews as would normally be the case.

Nôl i'r tabl cynnwys

8. Coherence

Coherence is the degree to which data that are derived from different sources or methods, but which refer to the same phenomenon, are similar.

Data sources

The LFS is one of a number of sources of data about the labour market. Some sources provide data that overlap with LFS data on employment, unemployment and earnings. Office for National Statistics (ONS) has published guidance about the strengths and limitations of each source in relation to these topics and has indicated which source is the most appropriate for different purposes. Details can be found in the Labour Market Guide.

Employment, unemployment and economic inactivity

The LFS is the source recommended by ONS for certain employment-related statistics (for example, estimates of the number of people in employment or unemployed). The LFS is also a unique source of comprehensive, coherent information about economic inactivity, where it provides information separately about people who want a job and those who do not.

Number and industrial composition of jobs

The workforce jobs (WFJ) series provides estimates of the number of jobs in the UK economy and is the source recommended by ONS for both the number of jobs and the industrial composition of jobs. Workforce jobs consist of the sum of employee jobs, self-employment jobs, jobs in the armed forces and government-supported trainees. Civilian workforce jobs are available by geographical region, sex and broad industry. Total workforce jobs are available by sex and broad industry.

Earnings

For estimates of change in earnings (for example, pay growth in the economy), a non-LFS source, the Average Weekly Earnings (AWE) (formerly the Average Earnings Index (AEI)) is the most suitable source. It provides industry and whole-economy information, but excludes small employers, the self-employed and government- supported trainees. Pay, commission, bonuses, overtime and pay award arrears are included, but redundancy payments and benefits in kind are excluded.

The Annual Survey of Hours and Earnings (ASHE) includes information about the levels, distribution and make-up of earnings and hours worked for employees in different occupations, industries, ages and regions. It should be used when the information required is not available from the AWE (such as for occupational groups, or regional analyses), and is the preferred source of the earnings of full-time employees, and of the average hourly earnings of all employees. The LFS should be used when the information is not available from the AWE or from ASHE, and is the preferred source of data about the earnings of part-time and low-paid employees. There is an ONS guide to sources of data on earnings and income.

Nôl i'r tabl cynnwys

9. Summary of methods

The LFS covers private households, including persons who are temporarily absent. The resident population comprises persons who regard the sample address as their main address, and also those who have lived in the dwelling for more than 6 consecutive months, even if they do not regard this as their principal dwelling. Persons absent for more than 6 months are not regarded as members of the resident population. A private household comprises one or more persons whose main residence is the same dwelling and/or who share at least one meal per day. Students living in halls of residence and pupils at boarding school are sampled via the private households of their parents. In Great Britain, an additional sample is drawn from persons living in National Health Service accommodation.

The year is divided into quarters of 13 weeks. Prior to January 2006, these were seasonal quarters: winter (December to February), spring (March to May), summer (June to August) and autumn (September to November). From January 2006, the LFS has been conducted on the basis of calendar quarters: Quarter 1 – January to March, Quarter 2 – April to June, Quarter 3 – July to September and Quarter 4 – October to December.

For most of Great Britain, the survey base is the Royal Mail's PAF (Postcode Address File), a database of all addresses receiving mail. The list is limited to addresses receiving fewer than 25 items of post per day, so as to exclude businesses. Because of the very low population density in the far north of Scotland (north of the Caledonian Canal), telephone directories are used as sampling frames, and interviews are carried out by telephone because face-to-face interviews would be too expensive. In Northern Ireland POINTER, which is the government's central register of domestic properties, is used.

In Great Britain, a systematic sample is drawn each quarter from the three sampling bases, yielding 16,640 PAF addresses, 75 telephone numbers for the north of Scotland and 36 units of National Health Service housing. As the PAF is broken down geographically, the systematic sampling ensures that the sample is representative at regional level. In Northern Ireland, a simple random sample is drawn, each quarter, from each of three strata, giving 650 addresses in all.

A rotation system comprising 5 waves is used. Respondents are interviewed five times at 13-week intervals and one-fifth of the sample is replaced each quarter. Interviews are carried out on a face-to-face (CAPI) or telephone (CATI) basis with the help of portable computers for the interviews in the first wave. In the far north of Scotland (north of the Caledonian Canal) and for interviews in the second to fifth waves, wherever possible, interviews are carried out by telephone.

Nôl i'r tabl cynnwys

10. Technical definitions

Imputation

If a household (or someone within a household) is unavailable for interview, but was interviewed in the previous wave, responses from the previous wave are rolled forward. This is referred to as “imputation”. Imputation is carried out to minimise non-response bias in estimates, while simultaneously improving precision by boosting the sample size. The rationale is that most LFS variables do not change from one quarter to another for most people. Responses are rolled forward for one wave only. Data are not rolled forward after a second consecutive non- response. Tables and charts (at person or household level) containing responses that have been rolled forward from the previous wave are denoted by the term “including imputed”. Tables and charts that do not contain responses that have been rolled forward from the previous wave are denoted by the term “excluding imputed”.

Method of calculating sampling variability

The sampling variability is the spread of results that would be obtained if different samples were drawn. A confidence interval is a range of values, defined by a lower and upper bound, which indicates the variability of an estimate. Statistical methods are used to calculate the sampling variability from which the confidence interval can be determined. For example, with a 95% confidence interval, it is expected that in 95% of the survey samples, the resulting confidence interval will contain the true value that would be obtained by surveying the whole population.

Method of calculating response rates

The response rate indicates how many interviews were achieved as a proportion of those eligible for the survey. The formula used is as follows:

RR equals (FR plus PR) divided by (FR plus PR plus OR plus CR plus RHQ plus NC plus RRI*)

where RR is response rate, FR is full response, PR is partial response, OR is outright refusal, CR is circumstantial refusal, RHQ is refusal to HQ, NC is non contact, RRI is refusal to re-interview, *applies to waves 2 to 5 only.

Definitions of response outcome categories

A full response denotes a household in which each household member has answered all applicable questions.

A partial response denotes a household in which questions were not completed because someone refused to be interviewed, refused part way through the questionnaire or refused to let someone else answer on his or her behalf. However, at least one question block must have been completed. If only part information has been collected for a one-person household, it is coded as a refusal or non-contact.

An outright refusal is a household that refuses to respond to the survey and the interviewer feels that there is no chance of an interview at the current or in any future wave.

A circumstantial refusal is a household where the respondent refuses to respond because of a temporary circumstance (for example, going on holiday, too busy during the field period). A circumstantial refusal enables an interviewer to call back at the next wave.

A refusal to HQ is a household that contacts headquarters to refuse to participate in the survey in response to the advance letter.

A non-contact arises when an address is occupied, but where it has not been possible to contact any member of the household in the field period.

A refusal to re-interview is a household that takes part in the survey (at one or more of waves 1 to 4) but which, when asked to take part in the next wave (waves 2 to 5), refuses.

Method of calculating income response rates

The income question is asked at wave 1 and wave 5 only. Individuals aged 16 to 69 who are in employment in the reference week, form the sub-set of respondents who are eligible for these questions. The percentage response rates for the income questions are based on all eligible, in-scope respondents at wave 1 and all eligible, in-scope respondents at wave 5. The total response rate is the aggregate response rate for income for the quarter (wave 1 and wave 5), based on all eligible, in-scope respondents.

NS-SEC

NS-SEC is the National Statistics Socio-Economic Classification, which replaces previous classifications which were based on social class and social and economic group.

Proxy response

The LFS has to complete fieldwork to a tight timetable and interview as many of the sampled households as possible, which leaves limited time for recalls. LFS interviewers try to interview every adult (aged 16 and over) in each sampled household. However, when a household member is unavailable for interview, interviewers accept information by proxy from another responsible adult in the household. The proxy respondents are normally people living with a partner on behalf of their partner, and parents on behalf of their adult offspring who live with them.

Attrition

Attrition is the term applied to respondents who begin the survey but subsequently drop out. It has been known for some time that these respondents tend to have different characteristics to those who remain in all waves of the survey, which can, therefore, result in attrition bias. For example, if respondents in a particular age band have a higher tendency to drop out (attrition rate) than respondents in other age bands, then they will be under- represented in subsequent waves of the survey and in estimates.

Nôl i'r tabl cynnwys