Metamemory judgments and the benefits of repeated study: Improving recall predictions through the activation of appropriate knowledge.

Correspondence between judgments of learning (JOLs) and actual recall tends to be poor when the same items are studied and recalled multiple times (e.g., A. Koriat, L. Sheffer, & H. Ma’ayan, 2002). The authors investigated whether making relevant metamemory knowledge more salient would improve the association between actual and predicted recall as a function of repeated exposure to the same study list. In 2 experiments, participants completed 4 study–recall phases involving the same list of items. In addition to having participants make item-by-item JOLs during each study phase, after the 1st study–recall phase participants also generated change-in-recall estimates as to how many more or fewer words they would recall given another exposure to the same study list. This estimation procedure was designed to highlight repeated study as a factor that can contribute to recall performance. Activating metamemory knowledge about the benefits of repeated study for recall in this way allowed participants to accurately express this knowledge in a free-recall context (Experiment 2), but less so when the memory test was cued recall (Experiment 1). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The influence of delaying judgments of learning on metacognitive accuracy: A meta-analytic review.

Many studies have examined the accuracy of predictions of future memory performance solicited through judgments of learning (JOLs). Among the most robust findings in this literature is that delaying predictions serves to substantially increase the relative accuracy of JOLs compared with soliciting JOLs immediately after study, a finding termed the delayed JOL effect. The meta-analyses reported in the current study examined the predominant theoretical accounts as well as potential moderators of the delayed JOL effect. The first meta-analysis examined the relative accuracy of delayed compared with immediate JOLs across 4,554 participants (112 effect sizes) through gamma correlations between JOLs and memory accuracy. Those data showed that delaying JOLs leads to robust benefits to relative accuracy (g = 0.93). The second meta-analysis examined memory performance for delayed compared with immediate JOLs across 3,807 participants (98 effect sizes). Those data showed that delayed JOLs result in a modest but reliable benefit for memory performance relative to immediate JOLs (g = 0.08). Findings from these meta-analyses are well accommodated by theories suggesting that delayed JOL accuracy reflects access to more diagnostic information from long-term memory rather than being a by-product of a retrieval opportunity. However, these data also suggest that theories proposing that the delayed JOL effect results from a memorial benefit or the match between the cues available for JOLs and those available at test may also provide viable explanatory mechanisms necessary for a comprehensive account. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Aging and monitoring associative learning: Is monitoring accuracy spared or impaired?

Mixed lists of associatively related and unrelated paired associates were used to study monitoring of associative learning. Older and younger adults produced above-chance levels of relative accuracy, as measured by intraindividual correlations (γ) of judgments of learning (JOLs) with item recall. JOLs were strongly influenced by relatedness, and this effect was greater for older adults. Relative accuracy was higher for unrelated than for related pairs. Correlations of JOLs with item recall for a randomly yoked learner indicated that access to one's own encoding experiences increased relative accuracy. Both age groups manifested a contrast effect (lower JOLs for unrelated items when mixed with related items). Aging appears to spare monitoring of encoding, even though it adversely affects associative learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Comprehension as a basis for metacognitive judgments: Effects of effort after meaning on recall and metacognition.

We examined free recall and metacognitive judgments of ambiguous sentences studied with and without clues to facilitate their comprehension. Sentences were either studied without clues, with clues meaningfully embedded, or with clues following a 10-s interval delay. After presentation, subjects made judgments of comprehension (JCOMPs) or judgments of learning (JOLs). Puzzling over the meaning of sentences for several seconds prior to receiving the clue enhanced recall compared with studying sentences without clues or with embedded clues. This benefit of effort after meaning was not reflected in JCOMPs or JOLs. Rather, sentences considered relatively easy to understand received higher JOLs regardless of experimental condition. Although effort after meaning enhanced recall, subjects displayed no awareness of this benefit in their judgments. Our study adds to a growing literature showing students’ ignorance of factors affecting their own learning, which have important implications for education. Making learning conditions more difficult, thus requiring students to engage more cognitive effort, often leads to enhanced retention. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Aging, metamemory, and high-confidence errors: A misrecollection account.

Two experiments showed that older adults were worse than younger adults at judging the accuracy of their responses on source identification (i.e., who said what) and cued-recall tests. It is important to note that this age-related metamonitoring impairment occurred even after older and younger adults were matched on overall source accuracy and cued-recall accuracy. By contrast, older and younger adults showed comparable metamonitoring capacities when assessing the likely accuracy of old-new recognition judgments and responses to questions about general knowledge. These experiments are consistent with the misrecollection account of cognitive aging, which suggests that age-related memory impairments are due to older adults' vulnerability to making high-confidence errors when answering questions that require memory for specific details about recently learned events. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Note-taking in the employment interview: Effects on recall and judgments.

Although note-taking in the employment interview is highly recommended, little research has examined its effects. This study investigated the effects of note-taking styles, review of the notes, and content of the notes on participants' cued recall of information and decisions made from videotaped employment interviews. Note-taking increased recall accuracy but not judgment accuracy. Being able to review notes resulted in increased judgment accuracy for those taking conventional-style notes. The content of the notes also had important implications for conventional note-takers, suggesting some benefits of recording notes using the key-points style. The findings suggest that the act of note-taking may be more important for memory and legal reasons than for improving the decisions made by interviewers. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Familiarity and retrieval processes in delayed judgments of learning.

Two processes are postulated to underlie delayed judgments of learning (JOLs)--cue familiarity and target retrievability. The two processes are distinguishable because the familiarity-based judgments are thought to be faster than the retrieval-based processes, because only retrieval-based JOLs should enhance the relative accuracy of the correlations between the JOLs and criterion test performance, and because only retrieval-based judgments should enhance memory. To test these predictions, in three experiments, the authors either speeded people's JOLs or allowed them to be unspeeded. The relative accuracy of the JOLs in predicting performance on the criterion test was higher for the unspeeded JOLs than for the speeded JOLs, as predicted. The unspeeded JOL conditions showed enhanced memory as compared with the speeded JOL conditions, as predicted. Finally, the unspeeded JOLs were sensitive to manipulations that modified recallability of the target, whereas the speeded JOLs were selectively sensitive to experimental variations in the familiarity of the cues. Thus, all three of the predictions about the consequences of the two processes potentially underlying delayed JOLs were borne out. A model of the processes underlying delayed JOLs based on these and earlier results is presented. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Metacognition in motor learning.

Research on judgments of verbal learning has demonstrated that participants' judgments are unreliable and often overconfident. The authors studied judgments of perceptual-motor learning. Participants learned 3 keystroke patterns on the number pad of a computer, each requiring that a different sequence of keys be struck in a different total movement time. Practice trials on each pattern were either blocked or randomly interleaved with trials on the other patterns, and each participant was asked, periodically, to predict his or her performance on a 24-hr test. Consistent with earlier findings, blocked practice enhanced acquisition but harmed retention. Participants, though, predicted better performance given blocked practice. These results augment research on judgments of verbal learning and suggest that humans, at their peril, interpret current ease of access to a perceptual-motor skill as a valid index of learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Age differences in the monitoring of learning: Cross-sectional evidence of spared resolution across the adult life span.

Researchers of metacognitive development in adulthood have exclusively used extreme-age-groups designs. We used a full cross-sectional sample (N = 285, age range: 18–80) to evaluate how associative relatedness and encoding strategies influence judgments of learning (JOLs) in adulthood. Participants studied related and unrelated word pairs and made JOLs. After a cued-recall test, retrospective item strategy reports were collected. Results revealed developmental patterns not available from previous studies (e.g., a linear age-related increase in aggregate JOL resolution across the life span). They also demonstrated the value of investigating multiple cues' influences on JOLs. Multilevel regression models showed that both relatedness and effective strategy use positively and independently influenced JOLs. Furthermore, effective strategy use was responsible for higher resolution of JOLs for unrelated items (relative to related items). The effects of relatedness and strategy use with JOLs did not interact with age. The monitoring of learning is spared by adult development despite age differences in learning itself. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Recollection-based prospective metamemory judgments are more accurate than those based on confidence: Judgments of remembering and knowing (JORKS).

Five experiments were conducted to examine whether the nature of the information that is monitored during prospective metamemory judgments affected the relative accuracy of those judgments. We compared item-by-item judgments of learning (JOLs), which involved participants determining how confident they were that they would remember studied items, with judgments of remembering and knowing (JORKs), which involved participants determining whether studied items would later be accompanied by contextual details (i.e., remembering) or would not (i.e., knowing). JORKs were more accurate than JOLs when remember–know or confidence judgments were made at test and when cued recall was the outcome measure, but not for yes–no recognition. We conclude that the accuracy of metamemory judgments depends on the nature of the information monitored during study and test and that metamemory monitoring can be improved if participants are asked to base their judgments on contextual details rather than on confidence. These data support the contention that metamemory decisions can be based on qualitatively distinct cues, rather than an overall memory strength signal. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Affective valence influences participant's susceptibility to false memories and illusory recollection.

This study examined the influence of emotional valence on the production of DRM false memories (Roediger & McDermott, 1995). Participants were presented with neutral, positive, or negative DRM lists for a later recognition (Experiment 1) or recall (Experiment 2) test. In both experiments, confidence and recollective experience (i.e., “Remember-Know” judgments; Tulving, 1985) were also assessed. Results consistently showed that, compared with neutral lists, affective lists induced more false recognition and recall of nonpresented critical lures. Moreover, although confidence ratings did not differ between the false remembering from the different kinds of lists, “Remember” responses were more often associated with negative than positive and neutral false remembering of the critical lures. In contrast, positive false remembering of the critical lures was more often associated with “Know” responses. These results are discussed in light of the Paradoxical Negative Emotion (PNE) hypothesis (Porter, Taylor, & ten Bricke, 2008). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attributing study effort to data-driven and goal-driven effects: Implications for metacognitive judgments.

In self-paced learning, when the regulation of effort is goal driven (e.g., allocated to different items according to their relative importance), judgments of learning (JOLs) increase with study time. When it is data driven (i.e., determined by the ease of committing the item to memory), JOLs decrease with study time (Koriat, Ma’ayan, & Nussinson, 2006). Because the amount of effort invested in different items is conjointly determined by data-driven and goal-driven regulation, an attribution process must be postulated in which variations in effort are attributed by the learner to data-driven or goal-driven regulation before the implications for metacognitive judgments are determined. To support the reality of this process, the authors asked learners to adopt a facial expression that creates a feeling of effort and induced them to attribute that effort either to data-driven or to goal-driven regulation. This manipulation was found to determine the direction in which experienced effort affected metacognitive judgment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Source memory in the absence of successful cued recall.

Five experiments were conducted to address the question of whether source information could be accessed in the absence of being able to recall an item. The authors used a paired-associate learning paradigm in which cue-target word pairs were studied, and target recall was requested in the presence of the cue. When target recall failed, participants were asked to make a source judgment of whether a man or woman spoke the unrecalled item. In 3 of the 5 experiments, source accuracy was at or very close to chance. By contrast, if cue-target pairs were studied multiple times or participants knew in advance of learning that a predictive judgment would be required, then predictive source accuracy was well above chance. These data are suggestive that context information may not play a very large role in metacognitive judgments such as feeling-of-knowing ratings or putting one into a tip-of-the-tongue state without strong and specific encoding procedures. These same results also highlight the important role that item memory plays in retrieving information about the context in which an item was experienced. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Encoding fluency is a cue used for judgments about learning.

The authors used paired-associate learning to investigate the hypothesis that the speed of generating an interactive image (encoding fluency) influenced 2 metacognitive judgments: judgments of learning (JOLs) and quality of encoding ratings (QUEs). Results from Experiments 1 and 2 indicated that latency of a keypress indicating successful image formation was negatively related to both JOLs and QUEs even though latency was unrelated to recall. Experiment 3 demonstrated that when concrete and abstract items were mixed in a single list, latency was related to concreteness, judgments, and recall. However, item concreteness and fluency influenced judgments independently of one another. These outcomes suggest an important role of encoding fluency in the formation of metacognitive judgments about learning and future recall. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Separating bias and sensitivity in judgments of associative memory.

Ratings of the degree of association between words are linearly related to normed associative strengths, but the intercept is high, and the slope is shallow (the judgments of associative memory [JAM] function). Two experiments included manipulations intended to decrease the intercept and increase the slope. Discrimination training on many pairs of words and constraining ratings to sum to a constant both reduced the intercept but failed to change the slope. The intercept of the JAM function appears to contain a bias component that can be manipulated independently of the slope, which reflects sensitivity to associative strengths. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Does aging influence people's metacomprehension? Effects of processing ease on judgments of text learning.

In 2 experiments, the authors investigated whether age-related differences exist in metacomprehension by evaluating predictions based on the ease-of-processing (EOP) hypothesis. According to this hypothesis, judgments of how well a text has been learned are based on how easily each text was processed; easier processing results in higher judgments. Participants read either sentence pairs or longer texts and judged their learning of each immediately afterward. Although an age-related difference in the use of processing ease in judgments was observed with sentence pairs, for longer texts older and younger adults' judgments were similarly related to processing ease. In both experiments, age equivalence was also evident in the accuracy of the judgments at predicting performance on the criterion test. The overall pattern of results suggests that judging text learning remains largely intact with aging. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Processing Similarity Does Not Improve Metamemory: Evidence Against Transfer-Appropriate Monitoring.

The transfer-appropriate monitoring (TAM) hypothesis of metamemory predicts that judgment of learning (JOL) accuracy should improve when conditions during JOLs closely match conditions of the memory test. The authors devised 5 types of delayed JOLs for paired associates and varied them along with the type of memory test (cued recall or recognition). If the TAM hypothesis is correct, JOL and test type should interact to influence metamemory. Contrary to TAM, metamemory accuracy did not improve when JOL and test conditions matched but instead tended to vary according to whether the answer was apparent at time of JOL. Memory test scores and JOL magnitude were both greater when the correct target was evident during JOLs. Overall, the results are largely consistent with a monitoring retrieval view of delayed JOLs and do not support TAM as a viable account of JOL accuracy. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Repeated testing produces superior transfer of learning relative to repeated studying.

The present research investigated whether test-enhanced learning can be used to promote transfer. More specifically, 4 experiments examined how repeated testing and repeated studying affected retention and transfer of facts and concepts. Subjects studied prose passages and then either repeatedly restudied or took tests on the material. One week later, they took a final test that had either the same questions (Experiment 1a), new inferential questions within the same knowledge domain (Experiments 1b and 2), or new inferential questions from different knowledge domains (Experiment 3). Repeated testing produced superior retention and transfer on the final test relative to repeated studying. This finding indicates that the mnemonic benefits of test-enhanced learning are not limited to the retention of the specific response tested during initial learning but rather extend to the transfer of knowledge in a variety of contexts. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Confidence judgments in children's and adult's event recall and suggestibility.

The present work investigated the role of children's and adults' metacognitive monitoring and control processes for unbiased event recall tasks and for suggestibility. Three studies were conducted in which children and adults indicated their degree of confidence that their answers were correct after (Study 1) and before (Study 2) answering either unbiased or misleading questions or (Study 3) forced-choice recognition questions. There was a strong tendency for overestimation of confidence regardless of age and question format. However, children did not lack the principal metacognitive competencies when these questions were asked in a neutral interview. Under misleading questioning, in contrast, children's monitoring skills were seriously impaired. Within each age group, better metacognitive differentiation was positively associated with recall accuracy in the suggestive interview. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Solve the problem first: Constructive solution strategies can influence the accuracy of retrospective confidence judgments.

Two experiments tested whether differences in problem-solving strategies influence the ability of people to monitor their problem-solving effectiveness as measured by confidence judgments. On multiple choice problems, people tend to use either a constructive matching strategy, whereby they attempt to solve a problem before looking at the response options, or a response elimination strategy, whereby they work backward from response options trying to find one that fits as a solution. Constructive matching gives rise to different cues that may enhance confidence monitoring. Experiment 1 showed that spontaneous constructive matching in nonverbal spatial reasoning problems was associated with better confidence calibration and resolution than response elimination. We manipulated strategy in Experiment 2 by requiring constructive matching and found improved monitoring. Implications for research on monitoring, overconfidence, and the association between skill and monitoring are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)