Wonderlic test
The Wonderlic Contemporary Cognitive Ability Test (formerly the Wonderlic Personnel Test) is an assessment used to measure the cognitive ability and problem-solving aptitude of prospective employees for a range of occupations. The test was created in 1939 by Eldon F. Wonderlic. It consists of 50 multiple choice questions to be answered in 12 minutes.[1][2][3] The score is calculated as the number of correct answers given in the allotted time, and a score of 20 is intended to indicate average intelligence.[2]
Type | Multiple choice |
---|---|
Developer / administrator | Wonderlic, Inc. |
Knowledge / skills tested | Math, vocabulary, and reasoning |
Purpose | Assessing cognitive ability and problem-solving aptitude of prospective employees |
Year started | 1936 |
Duration | 12 minutes |
Score / grade range | 0–50 (1 point per question; score of 20 intended to represent average intelligence) |
Languages | 12 different languages |
Scores / grades used by | Prospective employers; notably administered at the NFL Scouting Combine |
Variants | Wonderlic Personnel Test – Quicktest (WPT-Q); Wonderlic Scholastic Level Exam (SLE); WonScore |
Website | www |
Part of a series on |
Psychology |
---|
The most recent version of the test is WonScore, a cloud-based assessment providing a score to potential employers.[4][5] The Wonderlic test was based on the Otis Self-Administering Test of Mental Ability with the goal of creating a short form measurement of cognitive ability.[1][3][6] It may be termed as a quick IQ test.[7]
History
Created in 1936 by E. F. Wonderlic, the Wonderlic Personnel Test was the first short-form cognitive abilities test.[2][8] It was developed to measure general cognitive ability in the areas of math, vocabulary, and reasoning.[2][8] Wonderlic created and distributed the test as a graduate student in the psychology department at Northwestern University.[9][8] Regarding the time allotted to take the test, Wonderlic, in an article released in 1939, stated that "the length of the test was made such that only about two to five per cent of average groups complete the test in the twelve-minute time limit."[3]
Originally designed to aid in employee selection at companies such as AT&T[10] and Oscar Mayer in the 1940s, the Wonderlic Personnel Test has been used by both the United States Armed Forces and the National Football League. During World War II, the Navy began using the Wonderlic Personnel Test to select candidates for pilot training and navigation. From 1940–1960 the test was supplied for free as the data was valuable to E. F. Wonderlic. In the 1970s Tom Landry, coach of the Dallas Cowboys, was the first to use the Wonderlic Personnel Test to predict player performance.[2] Formerly used in the annual NFL Combine as a form of pre-draft assessment,[2][8] the NFL stopped administering the test in 2022.[11]
The Wonderlic test is continually updated with repeated evaluations of questions.[12][13] Also, beginning in the 1970s, Wonderlic began to develop other forms of the Wonderlic Personnel, some of which include: Wonderlic Perceptual Ability Tests, Wonderlic Scholastic Level Exam, or the Wonderlic Contemporary Cognitive Ability Test.
Other Wonderlic tests
The tests are divided into three different types: cognitive ability, personality, and motivation.
Cognitive Ability
Released in the 1990s, the Wonderlic Personnel Test measures an individual's capability of solving problems and learning. The Wonderlic Personnel Test has two different forms: the Wonderlic Personnel Test--Quicktest (30 questions in 8 minutes) and the Wonderlic Personnel Test (50 questions, 12 minutes). The Wonderlic Personnel Test – Quicktest differs from the Wonderlic Personnel Test in that it is not proctored. The Wonderlic Personnel Test is a much more comprehensive test.[14][15]
The Wonderlic SLE is the scholastic version of the Wonderlic Personnel Test and is commonly administered to nursing school and medical program applicants.[16]
Personality
The Wonderlic Personality tests measure personal characteristics that are widely accepted as being predictive of a candidate's expected job performance. Wonderlic claims that using the Wonderlic Personality Test to select individuals whose traits are aligned with the demands of the position, employers can improve employee productivity, employee satisfaction and customer service while reducing recruitment costs and employee turnover.[17]
Added during the 1990s, the Wonderlic Personality Test contains two sections. The Wonderlic Five-Factor Personality Profile and the Wonderlic Seven-Factor Personality Profile. The Wonderlic Five-Factor Personality Profile tests individuals on five primary dimensions of the individual's personality: extraversion, agreeableness, conscientiousness, emotional stability/neuroticism, and openness to experience.[18] These are essentially the same constructs as the Big Five personality traits, also known as the Five Factor Model.
Motivation
Averaging 10–15 minutes, the 58-item assessment is based on the Holland/RIASEC workplace motivation model. It evaluates a candidate’s interests, which helps predict how motivated they will be by the actual responsibilities of the job. The more motivated they are by those responsibilities, the likelier they will succeed in that position.[19]
Sample questions
Similar to other standardized tests, the Wonderlic Cognitive Ability Test presents its questions in an open response.[3] The types of questions that have appeared in the oldest versions of the Wonderlic test include: analogies, analysis of geometric figures, arithmetic, direction following, disarranged sentences, judgment, logic, proverb matching, similarities, and word definitions. However, the questions may take different angles depending upon the ‘intelligence’ of the question setters.[3][9][7] Practice questions will include:
- If a piece of rope cost 20 cents per 2 feet, how many feet can you buy for 30 dollars?
- Which of the numbers in this group represents the smallest amount? a) 0.3 b) 0.08 c) 1 d) 0.33
- A high-speed train travels 25 feet in 1/3 second. In 4 seconds, the train will have traveled __?__ feet.[20]
- A clock lost 2 minutes and 36 seconds in 78 days. How many seconds did it lose per day?[20]
Application to industrial-organizational psychology
The Wonderlic test, as a vocational and intelligence test, falls under the field of Industrial and Organizational Psychology. As a personnel test the Wonderlic is used to gauge an applicant's job potential, educational potential, and training potential.[21] Six forms of this test are made available (A, B, C, D, E, and F) in which Wonderlic suggests that when two of these versions are to be used, the best combinations are A and B or D and F.[22] However, a study conducted by psychologists Kazmier and Browne (1959) shows that neither of these forms can be regarded as directly equivalent.[22] While there is no lack of tests that could be used in place of the Wonderlic, such as the IQ or the Mechanical Aptitude Test, it is a quick and simple vocational test for personnel recruitment and selection.[13] The Wonderlic test has been peer reviewed by the American Psychological Association and has been deemed worthy of field applications to the industrial use of personnel testing.[23] Other sources can be found on the database APA PsycNET.[24]
Reliability
In 1956, Weaver and Boneau reported in the Journal of Applied Psychology that two of the five forms, A and B, that were published at the time were harder than the others which caused scores on those forms to be significantly lower than scores obtained on forms C–F.[25] Concerning these observed differences, Weaver and Boneau state: "This accords with the history of the development of the test. Forms D, E, and F are made up of items selected from the Otis Higher, while A and B were developed later and include types of items not found in the Otis."[25] Those findings, seemingly, invalidate the claim that those forms were equivalent or consistent.[25] E. N. Hay made a similar observation as well. Hay found that form F was significantly easier than Form D.[26] Furthermore, Kazmier found Form B to be the most difficult of the five forms and, thus, recommended that it "not be regarded as directly equivalent to any of the forms."[6] Kazmier also found Forms D and F to be significantly different from each other and recommended that these forms be regarded as inequivalent.[6] In a study of the Wonderlic's test-retest reliability, conducted in 1992, Stuart McKelvie "concluded that conscious repetition of specific responses did not seriously inflate the estimate of test-retest reliability."[27] To put it simply, one's memory of some of the answers does not significantly affect one's score on the Wonderlic.[27]
In 1982, Carl Dodrill conducted a study in which 57 adults were administered the Wonderlic twice over a five-year period. In the Journal of Consulting and Clinical Psychology, Dodrill reported that the test-retest reliability for the Wonderlic was .94.[28] According to a 1989 article in Psychological Reports, the Wonderlic scored a r=.87 on the reliability scale compared along with the Pearson test score of r=.21.[29]
Validity
In an article written in Psychological Reports, T. Matthews and Kerry Lassiter report that the Wonderlic test "was most strongly associated with overall intellectual functioning," which is what it is purported to measure.[29] However, Matthews and Lassiter did not find the Wonderlic to be a successful measure of fluid and crystallized intelligence, and they stated that "the Wonderlic test scores did not clearly show convergent or divergent validity evidence across these two broad domains of cognitive ability."[29] In academic testing, the Wonderlic test has shown high correlations with aptitude tests such as the General Aptitude Test Battery.[29]
A more recent study by Hicks and colleagues from the Georgia Institute of Technology similarly argued that evidence concerning the test's validity was limited. Their research showed "that Wonderlic has no direct relationship to fluid intelligence once its commonality to working memory capacity is accounted for", and that the Wonderlic "was a significant predictor of working memory capacity for subjects with low fluid intelligence, but failed to discriminate as well among subjects with high fluid intelligence". These findings suggest that the Wonderlic is less informative when administered to higher-than-average ability individuals or groups, meaning there is more measurement error and less practical utility in giving the test to individuals higher in cognitive ability. Partially on this basis, they argued that organizations interested in personnel selection should consider administering measures of established constructs that are grounded in a more theoretical framework, such as fluid intelligence or working memory capacity.[30]
Legal matters
Jordan v. New London
In May 1997, Robert Jordan filed a lawsuit against the city of New London, Connecticut, alleging violation of the Equal Protection Clause of the United States and Connecticut constitutions, in a case that was referred to by several media outlets as "Too Smart To Be A Cop",[31][32] based on the city's application of scores generated by the Wonderlic test.
Jordan was born and raised in New London, and had previous experience in law enforcement, working as a part-time officer in near-by Groton Long Point, and as a seasonal officer for the Connecticut Department of Environmental Protection. In fall 1996, Jordan requested an interview with Keith Harrigan, New London's Assistant City Manager in charge of personnel. Harrigan informed Jordan that he was ineligible because he scored too high on the written portion of the Wonderlic test intended to evaluate cognitive ability. New London had decided to consider only applicants who scored between 20 and 27 on the written examination. Jordan scored a 33 on the exam, the equivalent of having an IQ of 125.
Jordan filed suit in the United States District Court for the District of Connecticut, where his case was dismissed by Judge Peter C. Dorsey, who noted: "The guarantee of equal protection under the Fifth Amendment is not a source of substantive rights or liberties, but rather a right to be free from invidious discrimination in statutory classifications and other governmental activity. It is well settled that where a statutory classification does not itself impinge on a right or liberty protected by the Constitution, the validity of the classification must be sustained unless the classification rests on grounds wholly irrelevant to the achievement of [any legitimate government] objective....[Jordan] may have been disqualified unwisely but he was not denied equal protection."[33] The dismissal was upheld on appeal to the United States Court of Appeals for the Second Circuit.
Griggs v. Duke Power Co.
Central tendency of Wonderlic scores
Serving as a quantitative measure for employers, scores are collected by the employers and the applicant's score may be compared to a professional standard, as is the case with security guards or, simply, compared to the scores of other applicants who happen to be applying for the same or similar positions at that time.[21] Each profession has its own, unique, average; therefore, different professions require different standards.[3][21] Wonderlic, Inc. claims a minimum score of 10 points suggests a person is literate.[9]
Average score in the NFL by position
The Wonderlic test is used in the NFL Scouting Combine. Paul Brown introduced the test to the league in the late 1960s.[34] According to Paul Zimmerman's The New Thinking Man's Guide to Pro Football,[35] the average score of an NFL player by position as of 1984 was:
- Offensive tackle – 26
- Center – 25
- Quarterback – 24
- Guard – 23
- Tight end – 22
- Safety – 19
- Linebacker – 19
- Cornerback – 18
- Wide receiver – 17
- Fullback – 17
- Halfback – 16
An average football player usually scores around 20 points.[9] Quarterbacks and offensive linemen usually have higher scores.[34] Most teams want at least 21 for a quarterback.[36]
Predictor of success in the NFL
John P. Lopez of Sports Illustrated proposed a 26–27–60 rule to predict a quarterback's success in the NFL (at least a 26 on the Wonderlic, at least 27 college starts, and at least 60% pass completion) and listed several examples of successes and failures based on the rule.[37] A 2005 study by McDonald Mirabile found that there is no significant correlation between a quarterback's Wonderlic score and a quarterback's passer rating, and no significant correlation between a quarterback's Wonderlic score and a quarterback's salary.[38] Similarly, a 2009 study by Brian D. Lyons, Brian J. Hoffman, and John W. Michel found that Wonderlic scores failed to positively and significantly predict future NFL performance, draft position, or the number of games started for any position.[39][34] Lyons said that Wonderlic's "limited return on investment" for the NFL is contrary to general mental ability being a very strong predictor of job performance for most careers; "because it's so physically based, the results point to that [GMA] really doesn't matter".[34] Donovan McNabb, whose score was the lowest of the five quarterbacks taken in the first round of the 1999 NFL Draft, had the longest and most successful career.[40]
The Lyons study also found that the relationship between Wonderlic test scores and future NFL performance was negative for a few positions, indicating the higher a player scores on the Wonderlic test, the worse the player will perform in the NFL.[39] For tight ends and defensive backs, it was found that lower scores indicated increased achievements.[41] According to Pat McInally, who was selected by the Cincinnati Bengals in the fifth round of the 1975 NFL Draft, George Young told him that his perfect score caused him to be selected later than he would have otherwise.[42] NFL reporter Matt Verderame reported that New England Patriots offensive lineman Joe Thuney avoided answering Wonderlic questions so he would not score too high.[43] McInally speculated that "coaches and front-office guys don't like extremes one way or the other, but particularly not on the high side. I think they think guys who are intelligent will challenge authority too much".[44] Mike Florio of Profootballtalk.com agreed with McInally:[45]
Scoring too high can be as much of a problem as scoring too low. Football coaches want to command the locker room. Being smarter than the individual players makes that easier. Having a guy in the locker room who may be smarter than every member of the coaching staff can be viewed as a problem – or at a minimum as a threat to the egos of the men who hope to be able when necessary to outsmart the players, especially when trying in some way to manipulate them.
Job performance in the NFL also includes deviance. A 2016 study found that the Wonderlic significantly predicted future arrests, referred to as criminal off-duty deviance, with players testing below the league average being almost twice as likely to get arrested in the future as players who scored above the league average.
See National Football League player conduct controversy.[46]
In popular culture
A simplified and condensed version of the Wonderlic test appeared in older editions of the Madden NFL video game series.[2] The questions usually consist of basic math and English questions. For example, "If Adrian Peterson rushes for 125 yards in a game, how many yards will he have at the end of the season if he keeps up with this pace?". Players have four answers to choose from when taking this version of the test.[47]
See also
References
- Aiken, L. R. (1998). Tests and Examinations: Measuring abilities and performance. New York: John Wiley & Sons. p. 293. ISBN 978-0-4711-9263-3.
- Pollick, Michael. "What is the Wonderlic Personnel Test". www.wisegeek.com. Retrieved March 29, 2012.
- Wonderlic, E. F.; Hovland, C. I. (December 1939). "The Personnel Test: a restandardized abridgment of the Otis S–A test for business and industrial use". Journal of Applied Psychology. 23 (6): 685–702. doi:10.1037/h0056432.
- "WonScore by Wonderlic Review" Finances Online. Retrieved 2020-03-05.
- "Newton Partners With Wonderlic for Pre-Hire Assessments" Newton Software. Retrieved 2020-03-05.
- Kazmier, Leonard J.; Browne, C .J. (1959). "Comparability of Wonderlic Test Forms in Industrial Testing". Journal of Applied Psychology. 43 (2): 129–132. doi:10.1037/h0045688.
- "Personality and Aptitude Career Tests. (2004). "Wonderlic personnel test: A short and quick iq test". personality-and-aptitude-career-tests.com. Retrieved November 20, 2012.
- "History". wonderlic.com. 2012.
- Merron, Jeff (2007). "Taking Your Wonderlics". espn.go.com.
- "How A Multiple-Choice Test Became A Fixture Of The NFL Draft" Five Thirty Eight. Retrieved 2020-03-05.
- O'Connell, Robert (March 2, 2022). "Without the Wonderlic, the N.F.L. Finds Other Ways to Test Football I.Q." The New York Times. Archived from the original on March 3, 2022. Retrieved January 21, 2023.
- "History". wonderlic.com. Retrieved May 14, 2012.
- Lindzey, Gardner (November 1, 1949). "Remarks on the use of the Wonderlic Personnel Test as a 'pre-test.'". Journal of Clinical Psychology. Retrieved March 8, 2012.
- "Ready. Test. Go". Wonderlic. Retrieved December 8, 2012.
- "Wonderlic Test – Cognitive Ability Test". All Practice Test. December 6, 2011. Retrieved April 12, 2012.
- "What Is the Wonderlic?". Beat the Wonderlic. Retrieved March 13, 2017.
- "Wonderlic". Retrieved July 23, 2012.
- "Description of Five Factor Model". Retrieved April 10, 2012.
- "Motivation" Wonderlic.com. Retrieved 2020-03-15.
- "Free Wonderlic Practice Test – 50 Questions, 12 Minutes". Beat the Wonderlic. Retrieved March 13, 2017.
- Wonderlic Personnel Test Manual. Northfield, IL: E.F. Wonderlic & Associates, INC. 1983.
- Kazmier, L.J. & Browne C.G.(1959). Comparability of Wonderlic test forms in industrial testing. Journal of Applied Psychology. 43(2):129–132.
- Dobrill, Carl; Warner, Holly (February 1988). "Further studies of the Wonderlic Personnel Test as a brief measure of intelligence". Journal of Consulting and Clinical Psychology. 56 (1): 145–147. doi:10.1037/0022-006X.56.1.145. PMID 3346441.
- "PsycNET". psycnet.apa.org.
- Weaver, H. B.; Boneau, C. A. (1956). "Equivalence of Forms of the Wonderlic Personnel Test: A Study of Reliability and Interchangeability". Journal of Applied Psychology. 40 (2): 127–129. doi:10.1037/h0047065.
- Hay, E. N. (1952). "Some research findings with the Wonderlic Personnel Test". Journal of Applied Psychology. 36 (5): 344–345. doi:10.1037/h0061766.
- McKelvie, Stuart J. (January 1992). "Does memory contaminate test-retest reiliability". Journal of General Psychology. 119 (1): 59–72. doi:10.1080/00221309.1992.9921158. PMID 1613489.
- Dodrill, Carl (1983). "Long-Term Reliability of the Wonderlic Personnel Test". Journal of Consulting and Clinical Psychology. 51 (2): 316–317. doi:10.1037/0022-006X.51.2.316.
- Matthews, T; Kerry S. Lassiter (2007). "What Does the Wonderlic Personnel Test Measure?". Psychological Reports. 100 (3): 707–712. doi:10.2466/pr0.100.3.707-712. PMID 17688083. S2CID 41253312.
- Hicks, K. L., Harrison, T. L., & Engle, R. W. (2015). "Wonderlic, working memory capacity, and fluid intelligence". Intelligence, 50, 186–195 doi:10.1016/j.intell.2015.03.005.
- "Too Smart to be a Cop?". CBS News.
- Yglesias, Matthew (May 2013). "Too Smart to be a Cop?". Slate.
- "Jordan v. New London". www.aele.org.
- Ledbetter, D. Orlando (March 6, 2010). "NFL's success using Wonderlic Test subject to interpretation". Atlanta Journal-Constitution. Archived from the original on May 27, 2010. Retrieved May 14, 2012.
- Zimmerman, Paul (1984). The New Thinking Man's Guide to Pro Football. Simon and Schuster. ISBN 9780671453947.
The New Thinking Man's Guide to Pro Football.
- Pompei, Dan (April 19, 2010). "Notre Dame's Clausen wild card in NFL draft". Chicago Tribune.
- Lopez, John P. (July 8, 2010). "The Rule of 26–27–60 helps predict NFL quarterback success or failure". Sports Illustrated. Archived from the original on October 18, 2013.
- Mirabile, McDonald P. (Spring 2005). "Intelligence and Football: Testing for Differentials in Collegiate Quarterback Passing Performance and NFL Compensation". The Sport Journal. United States Sports Academy. 8 (2). Retrieved April 25, 2011.
- Lyons, Brian D.; Hoffman, Brian J.; Michel, John W. (July 1, 2009). "Not Much More than g? An Examination of the Impact of Intelligence on NFL Performance". Human Performance. 22 (3): 225. doi:10.1080/08959280902970401. S2CID 145416436.
- Gladwell, Malcolm (December 15, 2008). "Most Likely to Succeed". The New Yorker. Retrieved January 12, 2013.
- Shipley, Amy (October 25, 2011). "Ryan Fitzpatrick's Wonderlic score: What does it mean?". The Washington Post. Archived from the original on February 24, 2012. Retrieved January 21, 2023.
- Lopresti, Mike (September 26, 2011). "Harvard's Ryan Fitzpatrick gets passing grades for 3–0 Bills". USA Today. Retrieved October 3, 2011.
- Jordan Heck (July 30, 2019). "Patriots player avoided Wonderlic questions so he wouldn't 'scare teams off' with his intelligence". Sporting News.
- McClellan, Bob (June 15, 2006). "McInally continues to perfect the Wonderlic". Rivals.com. Archived from the original on October 24, 2013. Retrieved April 25, 2011.
- Florio, Mike (February 28, 2011). "Greg McElroy gets a 48 on the Wonderlic". Profootballtalk.com. NBC Sports. Retrieved April 25, 2011.
- Seifert, Kevin (April 12, 2016). "Using data to predict arrest rates of NFL draft picks". ESPN.com. Retrieved February 10, 2019.
- EA Sports (2005). "NFL Superstar", Madden NFL 2006 (manual) (in English). Electronic Arts, page 11.
External links
- Official website
- Merron, Jeff (February 28, 2002). "Taking your Wonderlics". ESPN Page 2. Retrieved September 13, 2016.
- Reilly, Rick (April 23, 2001). "Liccing My Wounds". Sports Illustrated. Retrieved September 13, 2016.