Pam Tate
Office for National Statistics, Room D140,
Government Buildings, Newport, NP10 8XG, UK
E-mail: pam.tate@ons.gov.uk
Recent research in ONS on data editing processes for business surveys has focused on developing new methods that would improve efficiency, without impacting adversely on data quality. A major element in this has been the development of suitable methodology for selective (or significance) editing - an approach that aims to reduce the amount of editing by concentrating the checking of suspicious data on cases where it is thought likely to have a material effect on the survey estimates.
Such a methodology was developed for the Monthly Inquiry for the Distribution and Services Sector (MIDSS), and successfully piloted, achieving a reduction of some 40% in validation follow-up with negligible effect on the survey outputs. The approach has accordingly been implemented on MIDSS, and is now being extended and adapted to other surveys.
This paper briefly describes the selective editing methodology for MIDSS and its effects. It then discusses the factors that need to be considered when extending and adapting the method to other surveys. Some of the key issues are illustrated by reference to the process of development of suitable methods for the Monthly Production Inquiry, Annual Business Inquiry and Monthly Wages and Salaries Survey. Lastly, further issues for investigation are described.