Testing effect

The testing effect is the finding that long-term memory is often increased when some of the learning period is devoted to retrieving the to-be-remembered information.[1] The effect is also sometimes referred to as retrieval practice, practice testing, or test-enhanced learning.[2][3][4] Retrieval practice may be the best way to refer to the testing effect because the benefits of retrieval-related testing are not limited to tests. It can be more broad like flash cards or quizzes.The testing effect on memory should be distinguished from more general practice effects, defined in the APA Dictionary of Psychology (2007) as "any change or improvement that results from practice or repetition of task items or activities." The term testing effect is also sometimes used in a more general sense; The Oxford Dictionary of Psychology (2003) defines a testing effect as "any effect of taking tests on the respondents, a typical example being test sophistication." Whereas psychologists who develop tests for personality and intelligence want to avoid practice effects, cognitive psychologists working with educators have begun to understand how to take advantage of tests—not as an assessment tool, but as a teaching/learning tool.[5]

It is useful for people to test their knowledge of the to-be-remembered material during the learning process, instead of only reading or otherwise passively studying the material. For example, a student can use flashcards to self-test and receive feedback as they study. The testing effect provides a larger benefit to long-term memory when the tested material is difficult enough to require effort, the rate of retrieval success is high, and feedback with correct answers is given after testing.

Empirical evidence

Video explanation

The first documented empirical studies on the testing effect were published in 1909 by Edwina E. Abbott.[6][7] An important step in proving the existence of the testing effect was presented in a 1992 study by Carrier and Pashler.[8] Carrier and Pashler showed that testing does not just provide an additional practice opportunity, but produces better results than other forms of studying. In their experiment, learners who tested their knowledge during practice later remembered more information than learners who spent the same amount of time studying the complete information. The abstract summarizes the results as follows:

In the pure study trial (pure ST condition) method, both items of a pair were presented simultaneously for study. In the test trial/study trial (TTST condition) method, subjects attempted to retrieve the response term during a period in which only the stimulus term was present (and the response term of the pair was presented after a 5-sec delay). Final retention of target items was tested with cued-recall tests. In Experiment 1, there was a reliable advantage in final testing for nonsense-syllable/number pairs in the TTST condition over pairs in the pure ST condition. In Experiment 2, the same result was obtained with Eskimo/English word pairs. This benefit of the TTST condition was not apparently different for final retrieval after 5 min or after 24 h. Experiments 3 and 4 ruled out two artifactual explanations of the TTST advantage observed in the first two experiments. Because performing a memory retrieval (TTST condition) led to better performance than pure study (pure ST condition), the results reject the hypothesis that a successful retrieval is beneficial only to the extent that it provides another study experience.

Carrier and Pashler's study did not reveal a very large advantage of testing over studying, but paved the way for numerous further studies that have shown a more marked advantage.[9] The results of a 2010 study by Agarwal et al. showed that the desirable difficulty of open-book and closed-book tests better enhanced learning compared to restudying or testing without feedback.[10] Additionally, a study done by Roediger and Karpicke showed that students in a repeated-testing condition recalled much more after a week than did students in a repeated-study condition (61% vs. 40%), even though students in the former condition read the passage only 3.4 times and those in the latter condition read it 14.2 times.[11] Another study by Butler investigated the possibility that testing only promotes the learning of a specific response. The results showed that the mnemonic benefits of retrieving information from memory are seen well beyond this retention of a specific response.[12] Thus, most studies show greater advantages for testing compared to passive studying as it relates to long-term retention of to-be-remembered information. However, some studies have produced results contrary to this claim.[13] Using retrieval practices also produces less forgetting than studying and restudying.[14]

Preconditions to measurement

Retrieval success

Retrieval practice is a founded twist on the testing effect and is used widely across many classrooms in order to help students recall information prior to an exam, excluding inhabitable influences. Studies in retrieval practice were founded in 1987 by John. L Richards, who first scripted his findings in a published newspaper in New York. In order for a testing effect to be demonstrated, the test trials must have a medium to high retrieval success. If the test trials are so difficult that no items are recalled, or if there is not proper feedback providing answers to the non-recalled items, then minimal information will be encoded and stored to memory.[15][16][17]

Time between retrieval practice and performance measure

Benefits of testing are often only visible after a substantial delay and not immediately after practice, when outcomes may even be better for passively restudied materials than for tested materials.[18][19] Some authors suggest that this can be explained in part by limited retrieval success during practice.[16][17][20]

Retrieval difficulty

According to the retrieval effort hypothesis, "difficult but successful retrievals are better for memory than easier successful retrievals". For example, Pyc and Rawson showed that repeated testing is more beneficial for learning if the intervals between repeated testing are long and each test is therefore more difficult than when the intervals are short and tests are easy.[21] This finding is related to the theory that certain conditions that make learning more effortful through so-called desirable difficulties are beneficial.[15] Another finding showed that weaker cues for recalling information will be more beneficial to future recollection compared to that of stronger cues.[22] Although these strong cues were shown to be more advantageous for initial recall, these stronger cues reduced the likelihood of activating more elaborative information that could be beneficial for retention. On the hand, the weak cues better allowed the to-be-remembered information to be better retained over time, enhancing long-term memory of the information.

Cognitive accounts

Two views have arisen as to why testing seems to provide such a benefit over repeated study. The first view, provided by McDaniel,[23] states that testing allows people to formulate newer, more lasting connections between items than does repeated study. The second view, provided by Karpicke and Roediger[24] studied the effect of testing on memory retention. For their study, they had participants study two different passages; passage one and passage two. They had the participants study passage 1 twice, and passage 2 once. However, passage two was tested on instead of being restudied.One week later they tested them on both passages, and they noticed that passage two was better recalled then passage one.[25] They found that re-studying or re-reading memorized information had no effect, but trying to recall the information had an effect. New findings[26] show more support for the second view. Spacing has also been shown to improve memory in younger and older adults. The spacing effect improves long-term memory from learning material with a break in between learning other information, while the testing effect improves long-term memory by restudying learned information through testing.[27] Both of these methods have been combined to be referred to as space retrieval practice.

Applications

Flashcards are an application of the testing effect. Here, flashcard software Anki is used to review a mathematical formula through active recall. First, only the question is displayed. Then the answer is displayed too, for verification.

Before much experimental evidence had been collected, the utility of testing was already evident to some perceptive observers. In his 1932 book Psychology of Study, C. A. Mace said "On the matter of sheer repetitive drill there is another principle of the highest importance: Active repetition is very much more effective than passive repetition. ... there are two ways of introducing further repetitions. We may re-read this list: this is passive repetition. We may recall it to mind without reference to the text before forgetting has begun: this is active repetition. It has been found that when acts of reading and acts of recall alternate, i.e., when every reading is followed by an attempt to recall the items, the efficiency of learning and retention is enormously enhanced."[28] In other words, the testing effect shows that when material is reviewed, the reviewer actively challenges their memory to recall than when re-reading or re-studying the materials. This is called active recall.[29]

Clearly the largest application for any human memory studies of learning effects is for education and finding better ways to relate information to students at every grade level.[30] Extensive research has been done in this area in the last decade. With findings showing that the testing effect can have a greater impact after a delay[31] even though students themselves seemed more confident in studying (which turned out to be false in the data). Additional reviews[32][33] have sought to provide more reliable results of the testing effect to improve education, a trend that after nearly 100 years, seems to be catching on.

“Administering interim tests during studying is a potent strategy to promote and sustain the effectiveness of self-regulated learning across a learning phase.”[25] As a result, teachers should persuade their students to constantly test themselves as part of their studying techniques.[25]

The testing effect is highly transferable. This means that the instructor can teach it in anyway that they want. In addition, they can give the students any format of test that they want, and the testing effect will still apply. Yang et al. did an experiment testing this.[25] They had one group learn and study the material by reading more information with less visuals, and they had another group have more visuals to study from than verbal text. They split both groups into two groups: one that restudied and one that was tested on what they just learned. The groups that were tested were given a fill in the blank test. Then all of the groups were tested by a multiple choice test. In both cases, the participants that were tested twice did better.[25] This shows that testing will result in better recall despite how the teacher teaches, or how the tests are formatted.

"The testing effect is covered in the second module of the Teaching and Learning Strategies for Higher Education online short course, presented by Harvard’s Bok Center for Teaching and Learning in collaboration with GetSmarter and in association with HarvardX."[34]

See also

References

  1. ↑ E. Bruce Goldstein (2010-06-21). Cognitive Psychology: Connecting Mind, Research and Everyday Experience. Cengage Learning. p. 231. ISBN 978-1-133-00912-2. Archived from the original on 2016-11-20. Retrieved 2016-10-16.
  2. ↑ Roediger, H. L.; Butler, A. C. (2011). "The critical role of retrieval practice in long-term retention" (PDF). Trends in Cognitive Sciences. 15 (1): 20–27. doi:10.1016/j.tics.2010.09.003. hdl:10818/24277. PMID 20951630. Archived from the original (PDF) on 2017-12-15. Retrieved 2022-03-14.
  3. ↑ Dunlosky, J.; Rawson, K. A.; Marsh, E. J.; Nathan, M. J.; Willingham, D. T. (2013). "Improving students' learning with effective learning techniques: Promising directions from cognitive and educational psychology". Psychological Science in the Public Interest. 14 (1): 4–58. doi:10.1177/1529100612453266. PMID 26173288. Archived from the original on 2021-08-29. Retrieved 2019-12-05.
  4. ↑ "Remember!". Retrieval Practice: A Powerful Strategy to Improve Learning. Archived from the original on 2016-03-08. Retrieved 2016-03-12.
  5. ↑ Bae, Christine L.; Therriault, David J.; Redifer, Jenni L. (2018). "Investigating the testing effect: Retrieval as a characteristic of effective study strategies". Learning and Instruction. 60: 206–214. doi:10.1016/j.learninstruc.2017.12.008. ISSN 0959-4752.
  6. ↑ Abbott, Edwina (1909). "On the analysis of the factors of recall in the learning process". Psychological Monographs: General and Applied. 11 (1): 159–177. doi:10.1037/h0093018. Archived from the original on 2018-05-29. Retrieved 2018-05-29 – via Ovid.
  7. ↑ Larsen, Douglas P.; Butler, Andrew C. (2013). Walsh, K. (ed.). Test-enhanced learning. In Oxford Textbook of Medical Education. pp. 443–452. ISBN 9780199652679. Archived from the original on 2021-08-29. Retrieved 2018-10-13.
  8. ↑ Carrier, M.; Pashler, H. (1992). "The influence of retrieval on retention" (PDF). Memory & Cognition. 20 (6): 632–642. doi:10.3758/bf03202713. PMID 1435266. Archived from the original (PDF) on 24 September 2015. Retrieved 17 August 2015.
  9. ↑ Roediger, H. L.; Karpicke, J. D. (2006). "Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention" (PDF). Psychological Science. 17 (3): 249–255. doi:10.1111/j.1467-9280.2006.01693.x. PMID 16507066. Archived from the original (PDF) on 13 May 2015. Retrieved 17 August 2015.
  10. ↑ Agarwal; et al. (2007). "Examining the Testing Effect with Open- and Closed-Book Tests". Applied Cognitive Psychology. 22 (7): 861–876. CiteSeerX 10.1.1.545.4826. doi:10.1002/acp.1391.
  11. ↑ Roediger, H. L.; Karpicke, J. D. (2006). "Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention" (PDF). Psychological Science. 17 (3): 249–255. doi:10.1111/j.1467-9280.2006.01693.x. PMID 16507066. Archived from the original (PDF) on 13 May 2015. Retrieved 17 August 2015.
  12. ↑ Butler, A.C. (2010). "Repeated testing produces superior transfer of learning relative to repeated studying". Journal of Experimental Psychology: Learning, Memory, and Cognition. 36 (5): 1118–1133. doi:10.1037/a0019902. PMID 20804289.
  13. ↑ Mulligan, N. W.; Picklesimer, M (2016). "Attention and the testing effect". Journal of Experimental Psychology: Learning, Memory, and Cognition. 42 (6): 938–950. doi:10.1037/xlm0000227. PMID 26618913.
  14. ↑ Toppino, T. C.; Cohen, M. S. (2009). "The testing effect and the retention interval: Questions and answers". Experimental Psychology. 56 (4): 252–257. doi:10.1027/1618-3169.56.4.252. PMID 19439397.
  15. 1 2 Bjork, R. A., & Bjork, E. L. (1992). A new theory of disuse and an old theory of stimulus fluctuation. Archived 2008-08-29 at the Wayback Machine In A. Healy, S. Kosslyn, & R. Shiffrin (Eds.), From learning processes to cognitive processes: Essays in honor of William K. Estes (Vol. 2, pp. 35-67). Hillsdale, NJ: Erlbaum. Based upon research done by: Izawa, C (1966). "Reinforcement-test sequences in paired associate learning". Psychological Reports. 18 (3): 879–919. doi:10.2466/pr0.1966.18.3.879.
  16. 1 2 Kornell, Nate; Bjork, Robert A.; Garcia, Michael A. (August 2011). "Why tests appear to prevent forgetting: A distribution-based bifurcation model" (PDF). Journal of Memory and Language. 65 (2): 85–97. doi:10.1016/j.jml.2011.04.002. Archived (PDF) from the original on 18 May 2015. Retrieved 15 May 2015.
  17. 1 2 van den Broek, Gesa S. E.; Segers, Eliane; Takashima, Atsuko; Verhoeven, Ludo (2 September 2013). "Do testing effects change over time? Insights from immediate and delayed retrieval speed". Memory. 22 (7): 803–812. doi:10.1080/09658211.2013.831455. hdl:2066/129864. PMID 23998337. Archived from the original on 25 April 2021. Retrieved 28 July 2014.
  18. ↑ Roediger, H. L.; Karpicke, J. D. (2006). "Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention" (PDF). Psychological Science. 17 (3): 249–255. doi:10.1111/j.1467-9280.2006.01693.x. PMID 16507066. Archived from the original (PDF) on 13 May 2015. Retrieved 17 August 2015.
  19. ↑ Toppino, Thomas C.; Cohen, Michael S. (1 January 2009). "The Testing Effect and the Retention Interval". Experimental Psychology. 56 (4): 252–257. doi:10.1027/1618-3169.56.4.252. PMID 19439397.
  20. ↑ Halamish, Vered; Bjork, Robert A. (2011). "When does testing enhance retention? A distribution-based interpretation of retrieval as a memory modifier". Journal of Experimental Psychology: Learning, Memory, and Cognition. 37 (4): 801–812. CiteSeerX 10.1.1.1033.8690. doi:10.1037/a0023219. PMID 21480751.
  21. ↑ Pyc, Mary A.; Rawson, Katherine A. (May 2009). "Testing the retrieval effort hypothesis: Does greater difficulty correctly recalling information lead to higher levels of memory?" (PDF). Journal of Memory and Language. 60 (4): 437–447. doi:10.1016/j.jml.2009.01.004. Archived from the original (PDF) on 2015-05-18. Retrieved 2015-05-15.
  22. ↑ Carpenter, S.K. (2009). "Cue Strength as a Moderator of the Testing Effect: The Benefits of Elaborative Retrieval". Journal of Experimental Psychology: Learning, Memory, and Cognition. 35 (6): 1563–1569. doi:10.1037/a0017021. PMID 19857026.
  23. ↑ McDaniel, M.A., &Fisher, R.P. (1991). Tests and test feedback as learning sources. Contemporary Educational Psychology, 16, 192–201.
  24. ↑ Karpicke, J. D., & Blunt, J. R. (2011)
  25. 1 2 3 4 5 Yang, Chunliang; Potts, Rosalind; Shanks, David R. (2018-04-11). "Enhancing learning and retrieval of new information: a review of the forward testing effect". NPJ Science of Learning. 3 (1): 8. doi:10.1038/s41539-018-0024-y. ISSN 2056-7936. PMC 6220253. PMID 30631469.
  26. ↑ Karpicke, J. D.; Blunt, J. R. (2011). "Retrieval practice produces more learning than elaborate studying with concept of mapping". Science. 331 (6018): 772–775. doi:10.1126/science.1199327. PMID 21252317.
  27. ↑ Mulligan, N. W.; Peterson, D. J. (2015). "The negative testing and negative generation effects are eliminated by delay". Journal of Experimental Psychology: Learning, Memory, and Cognition. 41 (4): 1014–1025. doi:10.1037/xlm0000070. PMID 25329076.
  28. ↑ Mace, C. A. (1932). The Psychology of Study. New York: R.M. McBride & Co. p. 39.
  29. ↑ "The Testing Effect". Revunote. 9 December 2014. Archived from the original on 2 January 2015. Retrieved 10 December 2014.
  30. ↑ "Remember!". Retrieval Practice: A Powerful Strategy to Improve Learning. Archived from the original on 2016-03-08. Retrieved 2016-03-12.
  31. ↑ Karpicke, J. D.; Roediger, H. L. (2008). "The critical importance of retrieval for learning". Science. 319 (5865): 966–968. Bibcode:2008Sci...319..966K. CiteSeerX 10.1.1.408.8947. doi:10.1126/science.1152408. PMID 18276894.
  32. ↑ McDaniel, M. A.; Roediger, H. L.; McDermott, K. B. (2007). "Generalizing test-enhanced learning from the laboratory to the classroom". Psychonomic Bulletin & Review. 14 (2): 200–206. doi:10.3758/bf03194052. PMID 17694901.
  33. ↑ Agarwal, P. K.; Bain, P. M.; Chamberlain, R. W. (2012). "The value of applied research: Retrieval practice improves classroom learning and recommendations from a teacher, a principal, and a scientist" (PDF). Educational Psychology Review. 24 (3): 437–448. doi:10.1007/s10648-012-9210-2. Archived from the original (PDF) on 30 June 2016. Retrieved 12 March 2016.
  34. ↑ "Testing Effect". teach.com. Archived from the original on 2019-09-29. Retrieved 2019-12-07.
    This article is issued from Offline. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.