| One of the most challenging tasks for managers | | | | Additionally, the incremental value of each is 27% |
| and executives is putting a selection process | | | | and 24%, respectively. Averaged across |
| together that truly selects the best candidate for | | | | occupations, a measure of GMA plus a |
| a given position. If you polled 100 companies, you | | | | well-designed work sample test will predict 42% |
| would likely find that each company has its own | | | | of a candidate's performance; GMA combined |
| distinct process and that the results over time | | | | with a structured interview will predict 40%. A |
| from that process have been mixed at best. The | | | | further advantage of both of these processes is |
| most important aspect of the hiring process is its | | | | their versatility in the selection of entry level or |
| predictive value: the ability to predict the future | | | | experienced workers. However, work samples |
| job performance of a given candidate. So what | | | | are easier to create for lower-level workers, who |
| hiring practices have the highest predictive value? | | | | typically have much more tangible results |
| Decades of research on selection processes has | | | | compared to higher-level managers. For example, |
| resulted in extremely valuable knowledge about | | | | it is much easier to use a work sample to count |
| the utility of various selection methods and the | | | | how many widgets a line operator produces than |
| superiority of specific selection assessments for | | | | it is to measure how well an HR director handles a |
| making the best hiring decisions. | | | | conflict situation. |
| Research over the past 25 years has shown that | | | | For this reason, structured interviews typically are |
| variability in work performance among incumbent | | | | used in place of work samples for candidates at |
| workers is very large. One way to standardize | | | | the manager level or above. Structured interviews |
| this variability is by measuring the dollar value of | | | | are highly versatile in that they offer a fixed |
| output. The accepted formula to measure the | | | | format, can be designed through a job analysis, |
| dollar value of output is a 40% standard deviation | | | | and may have an accompanying scoring manual. |
| of the mean salary of the job (Schmidt & | | | | Conventional structured interviews typically consist |
| Hunter, 1998). For example, if the average salary | | | | of a series of questions focusing on job |
| for a job is $40,000, then superior workers | | | | responsibilities, knowledge, and achievements in |
| (those producing in the 84th percentile for their | | | | previous jobs; however, they generally are not |
| job, or one standard deviation above the | | | | based on a formal job analysis. Two types of |
| average) produce $16,000 more than an | | | | structured interview techniques that do rely on |
| "average" employee and $32,000 more than a | | | | job analysis are the Situational Interview (SI) and |
| "poor" performer. Therefore, managers can | | | | the Patterned Behavior Description Interview |
| increase the economic value of candidates hired | | | | (PBDI). In the former, the interview questions |
| by creating a process that reduces the inherent | | | | involve specific work dilemmas designed to elicit |
| variability among performance of those hired; i.e. | | | | the applicant's intentions as a measure of their |
| by improving the likelihood of hiring a 'high | | | | future behavior. The PBDI, in contrast, is based on |
| performer.' | | | | the premise that the best predictor of future |
| What does the optimal process look like? Almost | | | | behavior is past behavior. Candidates are |
| 100 years of employment research concludes | | | | presented with some criterion relevant to the job |
| that the most valid single predictor of future job | | | | and are asked to recall a relevant past incident |
| performance is General Mental Ability (GMA). | | | | and to describe their specific behaviors in that |
| Among the various assessment procedures used | | | | incident. One added benefit of the PBDI, also |
| across all types and levels of occupations, GMA | | | | referred to generally as behavioral interviewing, is |
| has the combined highest validity and lowest | | | | its flexibility in allowing candidates to use examples |
| application cost (Moscoso, 2000). As a stand-alone | | | | from community engagement, volunteering |
| assessment technique, a work sample has slightly | | | | experiences, and educational history in addition to |
| higher predictive validity but is much more costly | | | | examples from work. |
| than a measure of GMA. For | | | | Regardless of the format, both conventional and |
| professional-managerial jobs, GMA predicts roughly | | | | structured interviews demonstrate significant |
| 34% of performance success in that job. For | | | | predictive value. In fact, research has shown that |
| lower level administrative jobs, it predicts 26%. | | | | the structured interview is one of the best |
| For this reason, any selection process should use | | | | predictors of job performance and training |
| some measure of general mental ability as a | | | | proficiency, and it generalizes across occupations |
| primary differentiator between candidates. From | | | | and organizations. |
| there the question is which procedure(s) will add | | | | In economic terms, the gains from increasing the |
| substantial incremental validity above GMA without | | | | validity of hiring methods can amount over time |
| prohibitive costs? | | | | to literally millions of dollars. Many organizations |
| Assessment Centers (AC's), a strategy employed | | | | rely solely on unstructured interviews for hiring |
| by numerous selection processes, meet the first | | | | decisions. In a competitive world, these |
| criteria but not the second. A 1998 review of | | | | organizations are creating an unnecessary |
| hundreds of assessment procedure studies found | | | | disadvantage for themselves. By adopting more |
| that AC's have substantial predictive validity | | | | valid hiring procedures, specifically a combination of |
| themselves but only add a 2% increase in validity | | | | general mental ability and either a work sample or |
| when combined with a measure of GMA. In other | | | | a structured interview, they could drastically |
| words, applicants who score well on measures of | | | | improve their competitive advantage. |
| intelligence typically also perform well in AC's, so | | | | Our selection assessments at Roselle Leadership |
| there is little to no additional value in putting | | | | Strategies, Inc. include four ability tests aimed at |
| candidates through expensive assessment | | | | calculating a candidate's true GMA, as well as |
| centers, which typically cost thousands of dollars | | | | personality tests, proprietary open-ended |
| per candidate. | | | | sentences and a structured interview aimed at |
| On the other hand, both work sample tests and | | | | determining how a candidate is likely to act and |
| structured interviews offer the same predictive | | | | perform on a day-to-day basis. Our primary |
| value as GMA, and significant incremental value | | | | objective is to reduce the variability in |
| when used in conjunction with GMA. A | | | | performance of employees hired in order to |
| well-designed work sample test will predict | | | | increase dramatically the economic value of each |
| approximately 29% of a candidate's performance | | | | hire, specifically, and of the organization, generally. |
| and a structured interview can predict 26%. | | | | |