ISO/TS 8000-81:2021 pdf download – Data quality — Part 81: Data quality assessment: Profiling.
1 Scope This document specifies a procedure for data profiling to generate the foundation for performing data quality assessment. This profiling is applicable to data sets that are either originally in a structure of tables and columns or are the output from a transformation to create such a structure. NOTE 1 Data profiling is applicable to all types of database technology. The following are within the scope of this document: — performing structure analysis to determine data element concepts; — performing column analysis to identify relevant data elements, including statistics about a data set; — performing relationship analysis to identify dependencies in a data set. The following are outside the scope of this document: — methods for extracting and sampling data to be profiled from a data set; — deriving data rules; — measuring the extent of nonconformities in a data set. NOTE 2 ISO 8000-8 specifies approaches to measuring data and information quality. This document can be used in conjunction with, or independently of, quality management systems standards. 2 Normative references The following documents are referred to in the text in such a way that some or all of their content constitutes requirements of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies. ISO 8000-2, Data quality — Part 2: Vocabulary 3 Terms and definitions For the purposes of this document, the terms and definitions given in ISO 8000-2 apply. ISO and IEC maintain terminological databases for use in standardization at the following addresses: — ISO Online browsing platform: available at https:// www .iso .org/ obp — IEC Electropedia: available at http:// www .electropedia .org/
5.3 Outputs The output from structure analysis is a data element concept. 6 Column analysis 6.1 Inputs The inputs to column analysis are a data set and a corresponding data element concept from structure analysis (see Clause 5). 6.2 Scope of activities Column analysis consists of: — extracting data elements from the data element concept; — comparing the data elements with the values in the data set; — determining the value domain. NOTE The methods for extracting data elements include discovery, assertion testing and visual inspection. These methods can be supported by automated tools.