Some standard content:
ICS 35.240,70
National Standard of the People's Republic of China
GB/T 19333,5-2003/IS0 19105:2000 Geographic infermation---Conformance and testing(ISO19105.2000,IDT)
Published on November 19, 2003
General Administration of Quality Supervision, Inspection and Quarantine of the People's Republic of China
Implemented on June 1, 2004
-YKAONT KAca-
GB/T19333.5—2003/IS0 19105:2000 This part of GB/T19333 is equivalent to the international standard ISO19105; 2000 (E) "Geographic Information Conformance and Testing" (English
version].
Considering the actual application needs of my country, this part has made the following editorial changes when adopting the international standard: a) "This international standard\ is the same as \"part\"; b) The foreword of the international standard is deleted;
The introduction of this part adopts the introduction of ISO19105: but a few changes are made; e
d) The names and codes of the international standards that have been equivalently adopted mentioned in the ISO19105 standard text are replaced by the names and codes of the national standards that have been equivalently adopted:
The names and codes of the international standards that have been equivalently adopted mentioned in the ISO19105 standard text The "ISO geographic information series standards" and "ISO geographic information standards" have been replaced by "geographic information series national standards" and "geographic information national standards"; f) an informative Appendix C has been added.
The ISO19100 series of standards is a set of structured geographic information standards with the general title of "geographic information" developed by the International Organization for Standardization's Geographic Information Technology Committee (ISO/TC211). Its content covers all aspects of geographic information management, application and services. It is expected that my country will, based on domestic actual needs, modify and adopt most of the standards, and gradually formulate a series of structured geographic information national standards with the general title of "geographic information". The "geographic information series national standards" or "geographic information national standards" in this part refer specifically to this type of standards. For detailed information about ISO19100 series standards, please refer to Appendix C of this part. This part is a basic standard in the national standard of structured geographic information system. Each standard in the national standard of geographic information system needs to design specific consistency clauses in accordance with the rules described in this standard. All objects that claim to be consistent with the national standard of geographic information should perform consistency testing in accordance with the framework and procedures given in this standard. Appendix A of this part is a normative appendix, while Appendix B and Appendix C are informative appendices. This part is proposed and managed by the National Technical Committee for Geographic Information Standardization. Drafting unit of this part: China National Institute of Standardization. Main drafters of this part: Li Xiaolin, Dong Lianxu, Xing Liqiang, Feng Wei, Liu Zhiting. GB/T19333.5—2003/IS019105.2000 introduces the current work of geographic information standardization: to establish a series of structured standards for information about objects or phenomena that are directly or indirectly related to places on the earth. These standards can specify methods and services for geographic information for data management (including definition and deduction) and the acquisition, processing, analysis, access, presentation and transmission of geographic information data in mathematical/electronic form between different users, systems and locations. This work will be connected to appropriate standards in information technology and data where possible, and provide a framework for the concurrent operation of departmental specific applications using geographic data.
This part provides a framework, concepts and methodology for testing, and proposes the criteria to be achieved when declaring consistency with the national standards for geographic information. This standard is based on GB/T17178, which describes the consistency and testing in the field of open system interconnection (OSI). This standard is based on parts of three national standards: GB/T16656.31, which describes the conformance and testing of industrial automation systems and integration, and GB/T17555, which describes the conformance and testing of computer graphics and image processing. In addition to the consistency test framework described in the three standards being used in this standard, some concepts have been modified to apply to the specific field of geographic information. If data and systems cannot be tested to determine whether they are consistent with relevant geographic information standards, the standardization goals in the field of digital geographic information cannot be fully achieved. Conformance testing is to test the product to be tested according to the specific characteristics required by a certain standard in order to determine the degree of consistency achieved by the product. Conformance Testing includes testing of the implementation capabilities, which is done both against the conformance requirements in the relevant standards and against the statements of the implementation capabilities. The Abstract Test Suite (ATS) framework for the National Standard for the Present Information Series is standardized. The standardization of ATS requires a definition for national standards and the use of a common test methodology as well as appropriate test methods and procedures: The purpose of this standard is to: define the test methodology, provide a framework for a specific ATS, and define the procedures to be followed during conformance testing. This part also includes test methods, however any organization that intends to use the test methods defined in this standard should carefully consider the constraints related to its applicability. Conformance testing does not include robustness testing, acceptance testing and performance testing. Testing, because various geographic information standards have different requirements for these aspects. The main structure of this part is as follows: Chapter 5 provides a general framework for consistency, which contains the definition of conformance implementation; Chapter 6 describes the conformance testing methodology; Chapter 7 discusses the possible test methods for testing the conformance of national standards for buried information; Chapter 8 discusses the relationship between AS and executable test suite (EIS); Appendix A provides guidance and related templates for writing conformance clauses; Appendix B gives the management organization mechanism for conformance testing; Appendix C provides an overview of IS geographic information system standards; Finally, a list of references related to conformance testing is listed. 1 Scope
GB/T 19333.5—2003/IS0 19105:2000 Geographic Information Conformance and Testing
This part specifies the framework, concepts and methodology of testing, gives the principles to be achieved when claiming conformance to a series of national standards for geographic information, and provides a framework for determining abstract test suites (AIS) and the procedures that should be followed during conformance testing. Statements of conformance may be made for data, software products or services, or by specifications (including private or functional standards). Standardization of test methods and guidelines for conformance of geographic information standards will facilitate verification of conformance to other standards. Verifiable conformance is extremely important for geographic information applications to achieve data transmission and sharing. This part of ISO 14001 applies to all stages of validation and testing. These stages are characterized by the following main activities: a) Definition of ATSs consistent with the national standards of the geographic information series; b) Definition of test methods consistent with the national standards of the geographic information series; e) The conformance evaluation process implemented by the test laboratory for a customer, culminating in the generation of a conformance test report. This part of ISO 14001 specifies requirements and provides guidance for the procedures to be followed when conducting conformance testing of the national standards of the geographic information series. It contains only information that meets the following purposes: b) To gain credibility in the test as a measure of conformance; c) To make the results of corresponding tests conducted at different locations and at different times comparable; and c) To facilitate communication between the parties involved in the above activities. This part of ISO 14001 provides a certification framework in informative annex B (which may be accompanied by management procedures after conformance testing). The following items are not within the scope of this standard: a) Description of procurement and contract requirements. b) Testing according to test methods specified for specific applications or specific systems. ) Acceptance tests, performance tests and robustness tests. The framework established by this part includes the concept of executable test suites (EIS). The nature of ETSs dictates that it is impossible to standardize them; therefore, standardization of ETSs is not within the scope of this standard. 2 Conformance
2. 1 Conformance requirements
This part defines two types of conformance: Class A and Class B. Class A is about the conformance between the specification (including any special standard or functional standard) and the national standard for geographic information as a whole. Class B is about the conformance of conformance clauses. These conformance clauses are defined in this part. For special standards, in addition to Class A conformance, further conformance requirements are given by IS019106
Note: Conformance clauses are defined in Appendix A.
2.2 Abstract test suites
2. 2.1A Type of conformance test cases
a) Test purpose: Verify the conformance with the national standards of geographic information series. b) Test method: Manually check whether all specifications (including special standards and functional standards) that claim to be consistent with the national standards of geographic information series have conformance clauses. Their conformance clauses should not exclude the conformance of any standard in the national standards of geographic information series. The conformance test should be carried out in accordance with the requirements of Chapter 6 of this part. The test method used should comply with Chapter 7 of this part. 1) IS010156 will be organized by the National Geographic Information Standardization Committee to become a standard in the national standards of geographic information series GB/T19333.5-2003/ESO 19105:2000.
c) Reference: GB/T 19333.5.
Test type: Capability test.
2.2.2 Type of conformance test cases for type B
Test purpose: Verify whether the conformance clauses are written correctly. Test method, manual verification of whether the conformance clauses are written in accordance with the provisions of the normative annex A of this standard. b)
Reference: GB/T 19333, 5, Annex A.
Test type: capability test.
3 Terms and definitions
The following terms and definitions apply to this part: 3.1
Abstract test case
abstract test ease
Ca Ease test for a specific requirement,
KNrKAca-
Note: An abstract test case is a formal basis for executable test or test case. One or more test objectives are included in the abstract test case. An abstract test case does not depend on the implementation or the value. It should be complete enough to clearly assign the test decision to each potential observable test result (i.e. the result of the test activity). 3.2
abstract test method
object test method
a method for testing an implementation that is not different from a specific test procedure. 3.3
abstract test module
a collection of abstract test cases associated with an abstract test module.
NOTE: Abstract test modules can be nested hierarchically. 3.4
abstract test suiteabstract test suiteATS
an abstract test module that defines the full set of requirements to be met by an implementation for conformance. NOTE: Object test suites are described in the conformance clause. 3.5
acceptance testing
the process by which the user (user) determines whether an implementation meets the acceptance criteria and whether the user can accept the implementation. NOTE 1 This process includes the design and execution of several types of tests (e.g., functionality, tolerance, performance tests) to demonstrate that the implementation meets the user requirements. NOTE 2 Acceptance testing is not considered part of performance testing. 3.6
Basic test
Initial capability test designed to identify those non-conformities that are evident. 3.7
capahility test
Capability test
Test designed to determine whether an implementation under test (IUT) conforms to the particular characteristics of a standard as described in the test date. 3.8
conformance
Conformity
Meeting specified requirements.
Conformance assessment processConformity assessment process of assessing the conformity of an implementation of a standard. 3.10
Conformance clause
Clause required to meet the requirements of a standard3. 11
Conformance testConformance testingTesting of a product to determine the degree to which the product has achieved conformity. 3.12
--Conformance test reportconformance test reportGB/T19333.5—2003/ISO 19105:2000 A summary of the degree of conformity with the specific standard and all test details that support this general summary. 3.13
Conforming implementationConforming implementationAn implementation that meets the requirements.
Executable test caseexecutabletestcaseA special test performed on the implementation of a specific requirement. Note that abstract tests are instantiated results after assignment. 3.15
Executable test suite
+executable test suite
A collection of executable test cases.
Failure verdictfailverdict
A conforming test verdict.
NOTE: A non-conformance may be a non-conformance with the purpose of the test or with one or more of the conformance requirements of the corresponding standard. 3.17Www.bzxZ.net
Falsification test
A test that looks for errors in an implementation.
NOTE: If an error is found, it can be concluded that the implementation does not conform to the standard; however, the absence of errors does not mean that the implementation conforms to the standard. Unlike verification testing, falsification testing can only indicate non-conformance. For technical and economic reasons, falsification testing is adopted as a test method in conformance testing in many cases.
Implementation
Implementation of a specification:
NOTE: In the context of a relevant national standard for geographic information systems, an implementation includes the specification of geographic information services and data sets. 3.19
Implementation Conformance StatementICS
Optional statement of an implementation. 3.20
Implementation eXtra Information for Test Implementation eXtra Information for Test CB/T19333.52003/IS019105.2000IXIT
KNrKAca-
Statement containing all the relevant information about the IUT and its corresponding system under test (SUT) that will enable the test laboratory to run an appropriate test suite for this IUT. NOTE The IXIT usually provides details about the organization and storage of SUT concepts, access and modification of the SUT, etc. 3.21
inconclosiveverdict A test verdict that can neither be judged as pass nor fail. 3.22
no nun-cenformance
failure to meet one or more specified requirements. 3.23
passverdict
a test verdict that is consistent.
Performance testing is the measurement of the performance characteristics of the IUT, such as throughput under different conditions, responsiveness, etc. NOTE: Performance testing is not considered a part of conformance testing. 3.25
robustnesstesting
Robustness testing
The process of determining the ability of the IUT to handle erroneous data. NOTE: Robustness testing is considered a part of conformance testing. 3.26
System Under Test
Computer hardware, software and communication networks required to support the IUT. 3.27
Testing laboratory is the organization that completes the conformance evaluation process.
verification test
Verification test
A test that rigorously proves that the IUT is correct. 4 Abbreviations This standard uses the following abbreviations: ATS: Object Test Suite; EFS: Executable Test Suite; ICS: Implementation-Conformance Statement; IUT: Implementation Under Test; IXI: Implementation Test Supplement; SUT: System Under Test. 5 Overall Framework for Conformance 5.1 Overview GB/T 19333.5--2003/IS0 19105:2000 In the context of the relevant national standards for geographic information, an implementation demonstrates conformance if it meets the conformance requirements of the applicable national standards for geographic information. These conformance requirements are expressed in the conformance clauses of each national standard for geographic information. 5.2 Conformance clauses
All testable national standards for geographic information contain conformance clauses. Conformance clauses specify all the requirements that must be met to claim conformance to the standard. …Conformance clauses are the starting point for conformance testing. Annex A of this standard gives the requirements for conformance clauses. 5.3 Conformance requirements
Conformance requirements can be divided into:
a) mandatory requirements: these requirements should be followed in all cases; b) conditional mandatory requirements: these requirements should be followed if the conditions stated in the specification apply; c) optional requirements: if some applicable optional requirements need to be followed, then these requirements can be selected to adapt to the implementation. In addition, a conformance requirement can be expressed in different ways: a) affirmative: stating what is required to be done, b) determinate: stating what is not required to be done. In order to manage optional collections of subsets of national standards such as special standards, the level of conformance shall be specified (see normative annex A). 5.4 Implementation Conformance Statement
In order to assess the conformance of a particular implementation, there shall be a statement that the options have been implemented. This will help the implementation to perform conformance testing against the relevant requirements (and only against these requirements). Such a statement is called an "Implementation Conformance Statement (ICS)". This statement only contains options within the framework of requirements specified by the relevant national standard for geographic information, and shall not include options outside this framework.
This statement allows the test laboratory to better understand the system under test (SUT) used in the conformance assessment process and helps to identify the boundaries of the test domain.
This statement can be generated by using the ICS questionnaire. The IES questionnaire can be provided by the test laboratory. It is a questionnaire used as a framework to document the capabilities of the SUT that are necessary to undertake conformance testing. For further information on ICS, see GB/T17178.1*ISO964613-41 and GB/T16656.3155.5 Conformant Implementations
Conformant implementations shall meet the conformance requirements of the application of national standards for geographic information and shall be consistent with the ICS. Such implementations shall pass all tests established in the test domain, including tests for any optional requirements that it claims to support. Conformant implementations may support additional capabilities not described in the corresponding national standard, provided that these capabilities are not expressly prohibited in the standard: 6 Conformance Testing Methodology
6.1 Overview
This clause describes the conformance testing methodology, the different types of conformance tests used, and other information that the client must provide to the testing laboratory.
6.2 Types of Conformance Tests
6.2.1 Overview
…The goal of conformance testing is to determine whether the implementation being tested conforms to the requirements expressed in the relevant national standard for geographic information. According to the scope of conformance provided by the test type, tests can be identified as two types: a) Basic tests: provide preliminary evidence of conformance to the 1L process. If the ATS specifies that tests are to be used as basic tests, these tests should be used for initial conformance evaluation. Basic tests are as far as possible. h) Capability tests verify that the observed IUT capabilities are consistent with the capabilities declared by the ICS. Capability tests provide comprehensive tests as far as possible within the entire scope of the conformance requirements specified by the corresponding national standard for geographic information. Capability tests are standardized. 2) Executable test cases can be obtained based on these basic tests, so system tests (internal tests) can be performed before the application of basic tests and capability tests is carried out in the test laboratory. The same is true for capability tests, but the above is more applicable to basic tests. GB/T 19333. 5-2003/IS0 19105:2000 tests.
TTKAONIKAca-
The ATS specified in the conformance policy clause specifies which capability tests should be used as basic tests. AIS does not include basic tests beyond the capability test set. In simple cases, basic tests may not be required. 6.2.2 Basic tests Basic tests provide limited testing of the IUT to determine whether more detailed testing is appropriate. Basic tests may be in abstract or executable form. Basic tests may be used to determine the degree of conformance before deciding whether to perform detailed capability testing. Basic tests are simple capability tests. Conformance clauses identify those test cases that may be used as basic tests. Basic tests should be used to: a) detect obvious nonconformances, and 6) as an initial step to decide whether to perform capability testing. Basic tests should not be used alone to: a) determine whether an implementation conforms, or 1.) ensure that the cause of an assertion failure is determined. 6.2.3 Capability tests Capability tests may be in abstract or executable form. They are intended to test the implementation as exhaustively as possible within the scope of the conformance requirements specified in the specification. Capability tests should be provided to verify mandatory capabilities and those optional capabilities that are confirmed to be supported by the ICS. Capability tests should be used to: a) verify that the capabilities of the IUT are sufficient to meet the conformance requirements, that is, to determine whether the implementation is conforming, and b) to investigate the cause of failure. Capability tests should not be used to: a) test the behavior associated with each implemented capability in detail, or b) to ensure the completeness of the implemented capabilities. Individual capability tests within the ATS are standardized tests. 6.3 Implementation Test Supplementary Material To test an implementation, the test laboratory needs information about the IUT and the environment in which the test is conducted. The test implementation submitted by the customer should provide the above information as the Implementation Test Supplementary Material (IXIT). The IXIT can be completed using a question-and-answer procedure created by the IXIT. IXIT should include:
a) Information about the IUT that the test laboratory needs in order to be able to run the appropriate executable test suite for the UT and analyze the results;
6) References to relevant ISs and other management information. IXIT should not conflict with related Ss. This compatibility check should be carried out during the preparation of the test to rule out any incompatibilities. When the ICS provides the test laboratory with information on the definition of the test domain, IXIT provides information on how to perform the test. In particular, it provides details on the storage and organization of concepts in the SUT, as well as methods for accessing and modifying the SUT. IXIT also includes a system of conversion rules between IUT concepts and corresponding national standards for geographic information. Each consistency evaluation process should have an IXI. For further information on IXIF, see GB/T17178.121, ISO9646131 and GB/T16656.315. 6.4 Conformance evaluation
6. 4, 1 Process overview
The conformance evaluation process revolves around all conformance testing activities that are necessary to determine the conformance of the corresponding geographic information system standard.
The conformance evaluation process includes four stages: a) test preparation;
b) test run;
c) result analysis;
d) conformance test report.
The conformity evaluation process is shown in Figure 1.
IXIT Spring
ICS Interval
Test preparation
ICS &IXT
6.4.2 Test preparation
Test operation
GB/T19333.5—2003/IS0 19105:2000 Determination and promotion
Result analysis
Test report
Test report
Figure 1 Overview of the conformity evaluation process
The test preparation stage should include the following steps: a) Generate management information: b) Generate S for testing and IXIT;
c) Determine the test method and ATS;
d) Review the ICS by analyzing the conformance statement according to the corresponding conformance requirements:) Review the IXIT, including the compatibility check against the corresponding JCS:f) Based on the ICS and IXIT, select the initial abstract test cases and assign values to the parameters;g) Prepare the SUT:
Note: Before submitting the IUT for the test run phase,1) Select the final abstract test case.
By selecting the abstract test case and assigning values to the parameters (steps f) and h) above), an executable test suite is generated. At this point, the scope of the IUT and the conformance assessment process is fixed and cannot be changed afterwards. This is determined by the agreement between the customer and the test laboratory.
6.4.3 Test Run
The test run is the process of executing the executable test suite and recording the observed test results and other relevant information in the conformance log. The inputs to the IUT and the observed test results resulting from the execution of the test cases shall be recorded in the conformance log. Recording and saving all information generated during the test run phase 13T is necessary for the analysis phase and audit purposes. 6.4.4 Results Analysis
The results analysis shall be performed by evaluating the observed test results against the decision criteria specified in the abstract test case. Although there are significant differences between the test run and results analysis phases, the two can overlap in time. Test decisions can be stated as: pass, fail or inconclusive. Pass and fail are the two main decisions, but inconclusive decisions have to be used in individual cases. For each fail or inconclusive decision, a reason should be given: informative information may also be provided at the same time. a) "Pass decision" means that the observed test results provide evidence of conformance to the conformance requirements of the test objective of concern. The observed test results are valid with respect to the corresponding standards and ICS; GB/T 19333.5--2003/IS019105.2000HTYKAONIKACa-
b) "Fail decision" means that the observed test results show: either inconsistency with respect to the test month or inconsistency with respect to at least one of the conformance requirements of the corresponding standard: e.g. abort - regardless of the reason, the execution of the executable test case is terminated prematurely. c) "Inconclusive decision" means that the observed test results show neither a pass nor a fail decision. This decision should only appear in very individual cases. Example: test case error.
For a specific test result, a test decision made using the decision criteria associated with a specific abstract test case should be given. The determined test decisions should be synthesized into an overall summary of the IUT. 6.4.5 Conformance test report
Conformance test results should be described in a conformance test report. The report should be divided into two parts: summary and detailed information. Each conformance test report should be generated using a questionnaire. The first part should be an overall summary of the conformance status of the IUT. This overall summary should provide an overview of the decisions, where the decisions are obtained from the results of executing the test cases during the conformance evaluation process. The second part should document the results of each executable test case, based on the conformance log containing the observed test results, and also refer to all necessary documents for implementing the conformance evaluation process according to the specific standard. 6.5 Intrinsic characteristics of the conformance evaluation process
6.5.1 Reproducibility of results
In order to achieve the trustworthiness of conformance testing, it is required that whenever a given ST executable test case is executed, its running results are considered to be the same. tt||6.5.2 Comparability of results To achieve the goal of conformance testing, an overall summary of the conformance of the IUT should be independent of the test laboratory that performed the testing, whether it was performed by the provider (first party), the user (first party), or any (third party) test laboratory. The standardization of all procedures related to conformance testing should produce an overall summary that is comparable to that of the IUT. To achieve this goal, the following important factors should be considered, including: a) Careful design and clear specification of abstract test cases to indicate those conformance requirements that must be met, and how to determine when re-runs are allowed where appropriate; b) Detailed specification of the procedures followed by the test laboratory when it is necessary to repeat test cases; c) Detailed specification of the conformance test report; d) Detailed specification of the steps for writing the conformance test report. 6.5.3 Auditability of results
In order to ensure that all procedures are followed correctly, it is necessary to review the results of the observed executable test run. Regardless of whether the result analysis is done manually or automatically, all inputs and outputs should be recorded for each test case executed. It is the responsibility of the test laboratory to form a consistency log for each test run. 7 Test methods
7.1 Overview
Geographic information is complex and multifaceted. Most aspects of geographic information are covered by national standards. The implementation of these national standards for geographic information can reflect different aspects of geographic information. This means that the methods that can be used to test the above implementations will be diverse. 7.2 Conformance test methods
7.2.1 Overview
· There are two general methods for consistency testing:b) Details of the procedures followed by the test laboratory when it is necessary to repeat the test case:
d) Details of the steps for writing the conformance test report. 6.5.3 Auditability of results
In order to ensure that all procedures are followed correctly, it is necessary to review the results of the observed executable test run. Whether the result analysis is manual or automatic, all inputs and outputs should be recorded for each test case executed. It is the responsibility of the test laboratory to form a conformance log for each test run. 7 Test methods
7.1 Overview
Geographic information is complex and multifaceted. Geographic information national standards should address most aspects. The implementation of these national standards can reflect different aspects of geographic information. This means that there are many different methods that can be used to test the above implementations. 7.2 Conformance test methods
7.2.1 Overview
· There are two general methods for conformance testing:b) Details of the procedures followed by the test laboratory when it is necessary to repeat the test case:
d) Details of the steps for writing the conformance test report. 6.5.3 Auditability of results
In order to ensure that all procedures are followed correctly, it is necessary to review the results of the observed executable test run. Whether the result analysis is manual or automatic, all inputs and outputs should be recorded for each test case executed. It is the responsibility of the test laboratory to form a conformance log for each test run. 7 Test methods
7.1 Overview
Geographic information is complex and multifaceted. Geographic information national standards should address most aspects. The implementation of these national standards can reflect different aspects of geographic information. This means that there are many different methods that can be used to test the above implementations. 7.2 Conformance test methods
7.2.1 Overview
· There are two general methods for conformance testing:
Tip: This standard content only shows part of the intercepted content of the complete standard. If you need the complete standard, please go to the top to download the complete standard document for free.