Construct validity studies.
D. Construct validity studies. Reports of construct validity for a selection procedure should include the following information:
(1) User(s), location(s), and date(s) of study. Date(s) and location(s) of the job analysis and the gathering of other evidence called for by these guidelines should be provided (essential).
(2) Problem and setting. An explicit definition of the purpose(s) of the study and the circumstances in which the study was conducted should be provided. A description of existing selection procedures and cutoff scores, if any, should be provided.
(3) Construct definition. A clear definition of the construct(s) which are believed to underlie successful performance of the critical or important work behavior(s) should be provided (essential). This definition should include the levels of construct performance relevant to the job(s) for which the selection procedure is to be used (essential). There should be a summary of the position of the construct in the psychological literature, or in the absence of such a position, a description of the way in which the definition and measurement of the construct was developed and the psychological theory underlying it (essential). Any quantitative data which identify or define the job constructs, such as factor analyses, should be provided (essential).
(4) Job analysis. A description of the method used to analyze the job should be provided (essential). A complete description of the work behavior(s) and, to the extent appropriate, work outcomes and measures of their criticality and/or importance should be provided (essential). The report should also describe the basis on which the behavior(s) or outcomes were determined to be important, such as their level of difficulty, their frequency of performance, the consequences of error or other appropriate factors (essential). Where jobs are grouped or compared for the purposes of generalizing validity evidence, the work behavior(s) and work product(s) for each of the jobs should be described, and conclusions concerning the similarity of the jobs in terms of observable work behaviors or work products should be made (essential).
(5) Job titles and codes. It is desirable to provide the selection procedure user's job title(s) for the job(s) in question and the corresponding job title(s) and code(s) from the United States Employment Service's dictionary of occupational titles.
(6) Selection procedure. The selection procedure used as a measure of the construct should be completely and explicitly described or attached (essential). If commercially available selection procedures are used, they should be identified by title, form and publisher (essential). The research evidence of the relationship between the selection procedure and the construct, such as factor structure, should be included (essential). Measures of central tendency, variability and reliability of the selection procedure should be provided (essential). Whenever feasible, these measures should be provided separately for each relevant race, sex and ethnic group.
(7) Relationship to job performance. The criterion-related study(ies) and other empirical evidence of the relationship between the construct measured by the selection procedure and the related work behavior(s) for the job or jobs in question should be provided (essential). Documentation of the criterion-related study(ies) should satisfy the provisions of section 15B above or section 15E(1) below, except for studies conducted prior to the effective date of these guidelines (essential). Where a study pertains to a group of jobs, and, on the basis of the study, validity is asserted for a job in the group, the observed work behaviors and the observed work products for each of the jobs should be described (essential). Any other evidence used in determining whether the work behavior(s) in each of the jobs is the same should be fully described (essential).
(8) Alternative procedures investigated. The alternative selection procedures investigated and available evidence of their impact should be identified (essential). The scope, method, and findings of the investigation, and the conclusions reached in light of the findings should be fully described (essential).
(9) Uses and applications. The methods considered for use of the selection procedure (e.g., as a screening device with a cutoff score, for grouping or ranking, or combined with other procedures in a battery) and available evidence of their impact should be described (essential). This description should include the rationale for choosing the method for operational use, and the evidence of the validity and utility of the procedure as it is to be used (essential). The purpose for which the procedure is to be used (e.g., hiring, transfer, promotion) should be described (essential). If weights are assigned to different parts of the selection procedure, these weights and the validity of the weighted composite should be reported (essential). If the selection procedure is used with a cutoff score, the user should describe the way in which normal expectations of proficiency within the work force were determined and the way in which the cutoff score was determined (essential).
(10) Accuracy and completeness. The report should describe the steps taken to assure the accuracy and completeness of the collection, analysis, and report of data and results.
(11) Source data. Each user should maintain records showing all pertinent information relating to its study of construct validity.
(12) Contact person. The name, mailing address, and telephone number of the individual who may be contacted for further information about the validity study should be provided (essential).