This standard specifies the basic principles, requirements and methods for the evaluation of universal keyboard Chinese character encoding input methods. This standard applies to the evaluation and routine testing of input methods of different scales and scopes by institutions authorized by the national competent authorities. This standard also applies to user selection and input method designers' improvement or optimization plans. GB/T 14159-1993 Evaluation Rules for Universal Keyboard Chinese Character Encoding Input Methods GB/T14159-1993 Standard Download Decompression Password: www.bzxz.net
This standard specifies the basic principles, requirements and methods for the evaluation of universal keyboard Chinese character encoding input methods. This standard applies to the evaluation and routine testing of input methods of different scales and scopes by institutions authorized by the national competent authorities. This standard also applies to user selection and input method designers' improvement or optimization plans.

National Standard of the People's Republic of China
The evaluation rule for universal keyboard Chinese character coding input method1 Subject content and scope of application
CB/T14159-93
This standard specifies the basic principles, requirements and methods for the evaluation of universal keyboard Chinese character coding input method (hereinafter referred to as input method). This standard is applicable to the evaluation and oral testing of input methods of different scales and scopes conducted by institutions authorized by the national competent authorities. This standard is also applicable to user selection and input method designer's improvement or optimization plan. 2 Reference standards
GB2312 Basic set of Chinese character coding symbols for information exchange 3 Terminology
3. 1 Static average cude length for Chinese character coding input method charaeter For the character codebook (including separators and re-code selectors) corresponding to a given Chinese character set, the average number of keystrokes for each Chinese character is obtained after considering the frequency of use of the character (unit: key/word). 3.2 Static average code length for Chinese character and word For the character codebook and space codebook (including separators and re-code selectors) corresponding to a given Chinese character set and Chinese word set, the average number of keystrokes for each Chinese character is obtained after considering the frequency of use of the Chinese character. For words that are not encoded in the specified word set, the calculation is based on the encoding of each single word that makes up the word (unit: key/word). 3.3 Dynamic average code length for Chinese character and word Under the conditions of optimal input and an accuracy rate of not less than 98%, a given test text is input, and the average number of keystrokes for each Chinese character (including separators and re-code selectors, unit: key/word) is measured. 3, 4 static coincident cude rate for Chinese characterThe ratio of the sum of the usage frequencies of the coincident characters in the character codebook to the sum of the usage frequencies of all characters in the given character set within the given Chinese character set and word nest.
3.5Static coincident code rate for Chinese character and wordThe ratio of the sum of the usage frequencies of the coincident characters and words in the character codebook to the sum of the usage frequencies of all characters and words in the given character set and word nest within the given Chinese character set and word nest.
3.6Dynamic coincident code rate for Chinese character and wordThe ratio of the actual number of coincident code processing times to the total number of characters and words input when the specified test text is input under the conditions of optimal input and accuracy rate not less than 98%.
3.7Effective characterThe number of characters correctly input in the order of the test text. 3. B Correct rate for input Approved by the State Administration of Technology Supervision on February 16, 1993 and implemented on August 1, 1993
CB/T 14159-93
The ratio of the number of valid words to the sum of the number of words actually input (the actual number of words input includes the number of valid words, the number of wrong words and the number of words over-typed) and the number of words missed (unit: %)
3. 9 Input velocity
The ratio of the number of valid words input to the input time (unit: words/min). When the corresponding input correct rate is lower than the set value, the input rate is invalid.
3.10 Lasting typing capacity The product of the input velocity and the correct rate measured by the operator's continuous operation within the specified time (unit: words/min). 3.11 Typing time equivalent The ratio of the typing time of the key element combination (M, M,) to the average typing time of all key element combinations obtained based on the statistical analysis of a large number of keystroke operations by skilled operators.
3.12 Static coefficient of key position distribution staticcoefficien1for codeelementallocation The ratio of the average typing time equivalent value of each Chinese character to the static average code length after considering the usage frequency of Chinese characters in the character code book corresponding to the given Chinese character set.
3.13 Dynamic coefficient of key position distribution dynamic coefficient for codeelementallocation The ratio of the average typing time equivalent value of Chinese characters to the average code length of dynamic words when the given test text is input in the best input mode and the accuracy rate is not less than 98%. 3.14 Expected velocity factor The input effective number corresponding to the unit typing time equivalent value measured under the conditions of optimal input and the accuracy rate is not less than 98%.
3.15 Training time training timelimit The shortest training time (unit: h) required for the input speed and input accuracy to reach the set value while being relatively stable in the process of learning the Chinese character encoding keyboard input method for beginners.
3.16 Obligatary selective operator An operator strictly selected and trained according to unified regulations. 3.17 Optinal selective operator An operator selected and trained by the participating units. 3.18 General user General user refers to the general user of the population.
3.19 Special user Special user Refers to the personnel who have received special training and are specialized in input (typing, etc.). 4 General provisions
4.1 The national evaluation is organized and implemented by the National Chinese Character Input Scheme Evaluation Working Group Office (hereinafter referred to as the Evaluation Office) under the leadership of the National Chinese Character Input Scheme Evaluation Working Group, and the evaluation results are announced. 4.2 The routine technical tests are undertaken by the Chinese character input technology testing institutions authorized by the national competent authorities. 4.3 The evaluation and test results of each session (time) conducted in accordance with this standard shall be globally comparable within a certain period of time. 4.4 During the national evaluation activities, the evaluation office shall organize the formulation and publish the corresponding "implementation details" in advance according to this standard. 4.5 The evaluation work is divided into five stages: static testing, qualitative evaluation dynamic testing, data processing, and comprehensive evaluation. Test data, basic data, score data, total score and grade shall be given for each participating method. 4.6 The input method applying for national evaluation (hereinafter referred to as participating method) shall be qualified for participation only after passing the basic conditions review and completing relevant procedures. Each participating method may enter the dynamic test only after passing the initial evaluation of the static test and qualitative evaluation stages. 5 Basic requirements for applying for evaluation
5.1 Provide the research and development demonstration report, technical appraisal materials or regular test results of the Chinese character input system. GB/T 14159—93
5.2 Provide relevant technical ownership certification materials or the authorization certificate of the technology owner. 5.3 Provide a complete Chinese character encoding input method (such as: encoding rules, re-code processing technology, intelligent measures, etc.) and user manual, 5.4 Provide a complete Chinese character software (hardware) support system, and can be installed on a domestic general-purpose microcomputer to run. 5.5 Provide a complete code book sorted in the order of characters in GB2312 or a designated national standard character set and a disk file in the specified format.
5.6 Provide a complete code element table and key position table. 5.7 Provide a complete "learning material" or "training material". 5.8 Its encoding character set and word set should comply with the relevant national standards currently in force. 5.9 Any test method intended for full-time users must also provide two white-selected operators on time to participate in the special item daily test. 6 Static test
6.1 Without considering the software and hardware system functions and operator factors of the test method, the quality of the test method itself shall be checked and tested based on the technical information provided by the test method. 6.2 Inspection contents:
Number of code elements,
b. Chinese character set;
c. Word set;
Key position distribution;
Conformity between the code book and the current coding rules:
Multiple code numbers and multiple code tables:
Duplicate code processing!
System overhead.
6.3 Test content:
Static word average code length:
Static word average code length;
Static repeated code word number and repeated code table;
Static word repeated code ratio:
Static word repeated code rate:
Static key position distribution coefficient:
7 Qualitative evaluation
7.1 Qualitative evaluation items
7.1.1 Theoretical basis
The appropriateness of the theoretical basis of linguistics, coding, computer science, psychology, ergonomics, education and other disciplines cited by the test method.
7.1.2 Standardization degree
The degree to which the test method cites the national norms and standards for language and Chinese information processing. 7.1.3 Software and hardware compatibility degree
The compatibility and portability of the software and hardware used by the test method with the current mainstream computer software and hardware systems in China. 7.1.4 Ease of learning
The coding rules are concise, the code elements and key positions are easy to remember, and the additional knowledge and memorization rules are few; it is not easy to forget after learning. It is easy to recover when it is used, the rules have little ambiguity, and the code book and coding rules have a high degree of correspondence. 7.1.5 Degree of intelligence
GB/T 14159-93
Make full use of computer functions, word databases, and knowledge bases to improve input efficiency, reduce duplicate codes, reduce errors, enhance the friendliness of human-computer interfaces, and provide effective means for Chinese information processing. 7.1.6 Usability
Usage: flexible methods such as work state conversion and word conversion, simple and reasonable duplicate code processing; light mental and physical burden on operators, etc.
7.1.7 User autonomy
Provides users with means to expand and improve the system by themselves, such as users creating words, building databases, defining simple codes, and modifying the priority of selected words.
7.1.8 Help section
Help users to detect words that are difficult to encode, prompt wrong operation in time, prompt correct encoding, provide error means, etc. 7.1.9 System economy
Regarding system expenses, the performance-price ratio of special accessories and equipment, the price paid for application, etc. 7. 1. 10 Practicality
It has been applied in some departments, systems, and models, and user usage reports are provided. 7.1.11 Static test results
Evaluation of static character average code length, static word average code length, static character repetition rate, static word repetition rate, static key position distribution coefficient, etc.:
7.2 Qualitative evaluation expert group
Qualitative evaluation is undertaken by the expert group. The qualitative evaluation expert group shall be nominated by the Assessment Office and approved by the relevant competent authorities. The total number of people shall not be less than 9.
7.3 Qualitative evaluation grading
Qualitative evaluation shall be graded according to four levels (excellent, good, medium, and poor). 8 Dynamic test
8.1 Dynamic test is also called actual test. The operator uses an electronic computer to perform actual word input operations with this input method to obtain basic test data such as input rate and input accuracy. 8.2 Dynamic test is divided into two stages. The first stage is the basic item test, and the second stage is the special item test. All test methods must participate in the basic item test of the first stage. The test methods to be used for full-time use must also participate in the special item test of the second stage. 8.3 Basic item test
8.3.1 Each test method shall be tested under relatively equal conditions using a unified operation group composed of unified operators. The success of the operation group is the arithmetic mean of the test scores of each operator in the operation group. 8.3.2 The number of the selected operation group shall not be less than 5. The number of test days for this item is 11 days per month. The computer training time for the first 9 days is 3 hours per day, and the number of computer tests per day is 2 times. The last two days are for endurance test. In each session (time) of evaluation, these values ​​should remain relatively stable. 8.3.3 Basic project test content:
Input accuracy: take the arithmetic mean of the input accuracy of the operation group from the 2nd to the 5th day of the test period; a.
Input rate: take the arithmetic mean of the input rate of the operation group from the 7th to the 9th day of the test period; b.
Additional training time:
d. Endurance, the continuous input time is stipulated as 2 hours, 8.4 Special project test
8.4.1 Self-selected operation groups are used for testing. Each group consists of two self-selected operators, and the arithmetic mean of the scores of the two operators is taken as the operation group score.
8.4.2 Test contents of special items:
a. Correct rate of visual typing input;
Input rate of visual typing:
Correct rate of listening and typing input;
Input rate of listening and typing:
GB/T 14159-93
Sustainability (continuous input time is stipulated as 3h) expected rate factor,
Average code length of dynamic words;
Repetition rate of dynamic words,
Dynamic key position distribution coefficient.
8.5 Test text
8.5.1 The test text should be universal and representative. 8.5.2 The forms of test texts include continuous texts for visual typing, discrete texts and word texts, as well as unambiguous continuous texts and Helang texts for listening and typing. There should be an appropriate proportion of each type of text. 8.5.3 Establish a test question bank and use computer-assisted question setting. 8.6 Unified Selection of Operation Groups
8.6.1 Unified Selection of Operators
8.6.1.1 It should be ensured that the selected operators have a junior high school education or above, and that the conditions in terms of age, language proficiency, intelligence, psychological quality, English typing skills, and physical condition are sufficiently close. 8.6.1.2 Candidates must undergo strict tests on language knowledge, psychological quality, and English typing skills, and be selected according to the specified range. 8.6.1.3 Candidates should not have received special training and learning on Chinese character encoding input methods. 8.6.2 Unified Selection of Operation Groups
8.6.2.1 The unified selection of operation groups should be grouped equally, and the mean and standard deviation of the test data of each group should not exceed the specified value range.
8.6.2.2 The pairing of the unified selection of operation groups and the participating test methods should be determined by public lottery. 9 Data processing
9.1 Steps of data processing
9.1.1 Use the scoring program to organize the measured data obtained from the dynamic test, collect and archive in real time, and print out. 9.1.2 Calculate the basic data of all evaluation items according to the calculation formula. 9.1.3 Normalize the basic data and find the corresponding score data. 9.1.4 Classify the score data of each evaluation item and perform weighted average to find the corresponding total score of each test method. 9.1.5 According to the set user class level standard, give the score level of each test method. 9.1.6 Complete the statistics of various grades, archive and print out data statistics tables and score tables. 9.2 Setting of benchmark values
9.2.1 In order to ensure the global comparability of the evaluation, each evaluation item sets a set of stable benchmark values. Each set of benchmark values ​​includes: a starting value and an excellent value.
9.2.2 The benchmark values ​​of the evaluation items are proposed by the expert group authorized by the Evaluation Office and approved by the relevant competent authorities. 9.3 Normalization Processing
9.3.1 The single dimension, range and positive and negative directionality of the basic data of the evaluation items are not completely consistent. After normalization processing, they are converted into dimensionless and positive score data with the same range. 9.3.2 The benchmark value score method is used for normalization processing. For each evaluation item, if its basic data is worse than the starting value, the score data of this item is zero; if the basic data is equal to the starting value, the score data of this item is 40; if the basic data is equal to the excellent value, the score data of this item is 100; if the basic data is better than the starting value, the score data is linearly transformed according to the slope derived from the above provisions. 9.4 Setting of weights
9.4.1 Set stable weights for each evaluation item. GB/T 1415993
9.4.2 The weights of the evaluation items are proposed by the experts authorized by the evaluation office on the basis of investigation, research and statistical analysis, and are reviewed and approved by the relevant main departments.
9.5 Level setting
9.5.1 The test methods are classified into three levels: A, B, and C according to the applicable user categories (general users and full-time users). For the test methods that only participate in the basic project test, only the level of general users is evaluated. 9.5.2 The names and codes of the grades are as follows:
Grade names and codes
Grade names
General user class A grade
General user class B grade
General user class grade
Professional user class A grade
Professional user class grade
Professional user class grade
9.6 Calculation of total score
9.6.1 Total score of qualitative evaluation
The total score of qualitative evaluation is equal to the sum of the product of the score of each qualitative evaluation item and the corresponding weight. 9.6.2 Total score of basic items
Level linear algebra
The total score of basic items is the sum of the scores of each test of basic items and the corresponding weights. 9.6.3 Total score of special items
The total score of special items is equal to the sum of the scores of each test except the average code length of dynamic words, the repeated code rate of dynamic words, and the dynamic key position distribution coefficient and the corresponding weights. 9.6.4 Total score of general user class S,
The total score of general user class is equal to the sum of the total score of basic items, the total score of qualitative evaluation and the corresponding weights (general user class). 9.6.5 Total score of full-time user class Swww.bzxz.net
The total score of full-time user class is equal to the sum of the total score of basic items, the total score of qualitative evaluation, the total score of special items and the corresponding weights (full-time user class).
9.7 Grade assessment
9.7.1 Grade assessment of general user test methodsGeneral user class A grade:
:Shareholder class B grade:
General user class C grade:
Ab>Sy2Byb
SαByb
9.7.2 Grade assessment of professional user test methodsProfessional user class A grade:
Professional user class B;
Professional user class C grade:
10 Comprehensive assessment
10.1 After completing the first four stages of the above evaluation work, each working group should ask the evaluation office to provide all data statistics, summary and composition tables and the grades of each test method in a timely manner. GB/T14159—93
10.2 The evaluation office shall report the evaluation results to the evaluation working group and relevant national authorities in a timely manner. 10.3 The evaluation working group shall review the legality of the implementation of each step, the confidence of the data, the compliance of the participating units and individuals, etc., verify the data processing results, and make a decision on whether to confirm. 10.4 The evaluation working group or the authorized evaluation office shall announce the final grade assessment results of this (drinking) evaluation. 10.5 The test results of regular tests are only provided to the participants and will not be officially announced. Additional notes:
This standard was proposed by the China Institute of Standardization and Information Classification and Coding, and the China Institute of Standardization and Information Classification and Coding is responsible for interpreting this standard.
This standard was jointly drafted by the China Institute of Standardization and Information Classification and Coding, the 709th Institute of China State Shipbuilding Corporation, Shanghai Jiaotong University, the Chinese Character Encoding Committee of the Chinese Information Society, and Sun Yat-sen University. The main drafters of this standard are Cheng Nufan, Lin Donghai, He Yuancun, Hua Shaohe, Liu Bisong, Yang Xiqin, Huang Xiaodong, Jiang Shunbing, Hu Weiming,
Tip: This standard content only shows part of the intercepted content of the complete standard. If you need the complete standard, please go to the top to download the complete standard document for free.