Technical Documentation: 

Attendance and Turnover Test

 

Criterion‑Related Evidence of Validity for the Attendance and Turnover Test

 

Criterion‑related validity evidence describes the extent to which the test predicts important job outcomes. We conducted a study in which attendance was assessed by a supervisor's rating and turnover was assessed by having people self-report on the length of time they stayed in their jobs (longevity). Our research showed that the Attendance and Turnover Test predicts both attendance and turnover.

Criterion‑related validity evidence was collected by administering the test to 118 incumbents and by collecting self-report data on longevity and supervisor ratings of attendance. Table 1 presents the relationship (Pearson correlation coefficients) between the Attendance and Turnover Test score and the criteria.

Figure 1 shows the probability of excellent attendance (as rated by supervisors) as a function of the applicant's Attendance and Turnover Test score. Figure 2 shows the probability of staying on the job five or more years as a function of the Attendance and Turnover Test score.

Many employers prefer to determine the validity of a test for their own organizations. We encourage such research and our staff of industrial psychologists can provide any needed assistance.

 

Table 1. Validity of Test Scores for Predicting Job‑Related Criteria

Test Score

Attendance

On-the-Job

Longevity

On-the-Job

Attendance and Turnover Test

.19

.38

Note: Sample Size 118.

 

Probability Not Certainty

 

The Attendance and Turnover Test can be used to improve the probability of selecting applicants who will become employees with good attendance and who stay on the job for a considerable period of time. 

This test, although very useful in applicant screening, is far from a perfect screening tool. There will be some applicants who are selected on the basis of this test who will be undesirable employees. Likewise, this test will reject some applicants who would have been acceptable employees. This happens in all selection systems. The incorporation of this test into employers’ current selection systems is intended to reduce such errors.

Applicants can be deceptive when taking the test. Applicants can improve their scores by lying or by enhancing their desirable qualities.  The ODD score described below is our attempt to identify such individuals.

If the test suggests that the applicant will have excellent attendance and stay on the job a long time, but the references and background checks reveal that the candidate has recently had poor attendance and changed jobs frequently, we suggest that more credence be given to the background check and reference information because the best predictor of future behavior is past behavior.

 

Figure 1. Probability of Excellent Attendance

 

 

 

Attendance and

Turnover Test Score

Probability of

Excellent Attendance

3

24

4

27

5

31

6

35

7

39

8

43

9

47

10

51

11

55

12

59

13

63

14

67

 

 

 

 

 

 

 

 

 

 

 

Figure 2. Probability of Staying 5 Years or More On the Job

 

 
 

                                                                                                                                                                                                                                                                                                                                                                                                                            

Attendance and

Turnover Test  Score

Probability of

Staying 5 Years

or More

3

02

4

03

5

05

6

08

7

13

8

19

9

.28

10

38

11

50

12

62

13

72

14

81

 

 
ODD Score

The ODD score attempts to identify unusually desirable responses. If an applicant obtains an ODD score of 4 or higher, additional information on the applicant should be collected. 

An applicant may obtain a high ODD score by having an unusually large number of desirable qualities. Such applicants may make good employees. However, one may also obtain a high ODD score by exaggerating one’s positive qualities. Such applicants may make less than desirable employees. The dilemma is that it is not readily apparent whether the applicant will be a good or poor employee.  

To assist in making a decision about an applicant with a high ODD score, additional time should be spent with the applicant in interviews and available background and reference information on the applicant should be carefully reviewed.

 

 
Reliability

The Attendance and Turnover test is a composite of an attendance scale and a turnover scale. The attendance scale has an internal consistency reliability of .67. The turnover scale has an internal consistency reliability of .47. The attendance/turnover scale has an internal consistency reliability of .66.

 

 
Norms

The meaning of an applicant’s test score is increased when it can be compared with a reference group. We suggest that the most meaningful norms are those based on an organization’s current incumbents. The industrial psychologists at Work Skills First, Inc. can assist in preparing a norm table for individual organizations. However, such local norms are not always feasible to collect due to a limited number of incumbents or insufficient resources to test the incumbents.

For those organizations without local norms, we provide norms in Table 2. These norms were obtained by administering the test to 142 nursing assistants and home health aides in one hospital, two home health care facilities, and several nursing homes. We provide norms for the full sample of 142 incumbents and broken down by hospitals, nursing homes, and home health care organizations. The norms are provided separately by type of organization because the test scores varied meaningfully across the three types of employer. On average, scores are highest for the hospital employees and lowest for the home health care employees. The nursing home employees tended to score lower than the hospital employees but higher than the home health care employees.

The percentile scores associated with a given test score is the percentage of the employees in the norm group who scored lower than the test score. For example, for the attendance/turnover scale for the full sample norm group, a test score of 32 places the examinee at the 55‑56th percentile. This means that 55 to 56% of the norm group scored lower than this score.

 

 
Cut‑off Score

Employment test scores are typically linearly related to job performance criteria. Thus, the higher the score, the greater the probability that the applicant will perform well on the job. When employers have more applicants than open positions, employers may adopt a top‑down hiring strategy and consider the highest scoring applicants first. Those high scoring applicants who meet other selection criteria such as receiving favorable background and reference checks would be hired before lower scoring applicants.

Unfortunately, there are often labor shortages for many jobs, such that employers identify a minimal cut‑off score and will offer employment to anyone who scores above that minimal level and who meets other selection standards. One reasonable standard is to set a cut‑off score at the 20th percentile of incumbents. Thus, an employer might set the passing point of the Attendance and Turnover Test at the 20th percentile. Applicants who score above the 20th percentile would be considered viable applicants subject to further screening, such as background and reference checks.

Another method for setting a cut‑off score is to use the data in Figures 1 and 2. One can identify the minimum probability desired on each criterion and then select that score as the minimal cut‑off score. For example, if an employer wants applicants to have at least at 50% chance of excellent attendance, the Attendance and Turnover Test cut‑off score would be set at 10. 

The industrial psychologists at Work Skills First, Inc. can provide assistance in setting cut-off scores.

 

 
 

Table 2. Test Norms for the Attendance and Turnover Test Score for Nursing Assistants

 

 

Attendance and Turnover Score

 

Attendance and Turnover Score

Test

Score

Percentile

All

Hospital

Nursing

Home

Home

Health

Test

Score

Percentile

All

Hospital

Nursing

Home

Home

Health

100-99

14

14

14

14

50-49

 

 

 

 

98-97

 

 

 

 

48-47

 

12

 

 

96-95

 

 

 

13

46-45

 

 

 

 

94-93

 

 

 

 

44-43

11

 

 

 

92-91

 

 

 

 

42-41

 

 

 

 

90-89

 

 

 

 

40-39

 

 

 

 

88-87

 

 

 

 

38-37

 

 

 

 

86-85

13

 

 

 

36-35

 

 

 

 

84-83

 

13

 

12

34-33

10

11

 

9

82-81

 

 

13

 

32-31

 

 

11

 

80-79

 

 

 

 

30-29

 

 

 

 

78-77

 

 

 

 

28-27

 

 

 

 

76-75

 

 

 

 

26-25

 

10

 

 

74-73

 

 

 

 

24-23

 

 

 

 

72-71

 

 

 

 

22-21

 

 

10

 

70-69

 

 

 

11

20-19

 

 

 

 

68-67

 

 

 

 

18-17

 

 

 

8

66-65