The quality profile is a user-oriented summary of the main quality features of an indicator. It provides a guidance for the use and the analysis of the indicator and gives input to the selection processes of any new indicator sets.
More in-depth information e.g. also on concepts, definitions, classifications and timeliness is given in the Eurostat metadata available for most of the indicators.
Scope of the quality profiles for Europe 2020 indicators
The quality profiles, which cover all Europe 2020 headline indicators, are developed by Eurostat in close co-operation with the National Statistical Institutes of the EU-MemberStates, candidate and EFTA countries.
Dimensions: terms and grades
The criteria used in the quality profile are based on the European Statistics code of practice and have been tailored to meet the users' needs.
The following quality criteria are covered:
•Overall assessment of accuracy and comparability:
The overall technical assessment of the indicator is based on the criteria of accuracy and comparability. Three quality grades are used: A, B, C. The indicators which need “to be (further) developed” are graded under a fourth category.
•Objective and relevance of the indicator:
Under the objective section is described what phenomenon the indicator is intended to measure. Relevance refers to the extent to which the statistical data meet the needs of the users.
This dimensions explain characteristics of the indicator which may lead to restriction of its use in publications, relating e.g. to the complexity of an indicator, a lack of an unambiguous scientific basis or to the coherence with other existing indicators, lack of comprehensive metadata etc.
•Data availability:
The data availability refers to the existing data. It shows the earliest and the latest year available. In addition, important information on time series is given (e.g. lack of data or derogation for certain countries or any other restrictions).
•Overall accuracy:
The accuracy assessment is based on existing quality information in the domain the indicator is constructed: the indicator should originate from reliable sources meeting high standards and involving statistical expertise as regards the technique and methodology applied (sampling procedure, response rates, calculation of errors, legal basis, etc.).
•Comparability:
Comparability measures the effect of the differences in the applied statistical concepts and measurement procedures when the statistical data are compared between geographic areas, over time or between different domains. Two dimensions are evaluated:
- Comparability across countries:
The quality profile assesses the data availability for the different countries, differences among countries in definitions and classifications as well as divergences in statistical concepts.
- Comparability over time:
The indicator has to be comparable from one year to another. The state and length of comparable time series are reported, and also breaks in time series and the impact of this change on the results.
•Development perspective for improving the quality of the indicator:
The development perspective for improving the quality of an indicator is provided, including, as far as possible, a qualitative estimation of the related additional costs in terms of implications for the producers of data and burden for the respondents.
•Contribution to quality of the set/potential for an integrated policy analysis:
The quality profile also includes an assessment of how well the indicator contributes to an integrated analysis of the whole set. It introduces a notion of relativity of indicator quality. Depending on which other indicators feature on the list, the quality criteria of one indicator may be seen in a different light.
