Memory lapses are common events in our daily lives, and subjective memory complaints are present across lifespan, even if with distinct qualitative features and with higher prevalence among the elderly (Bassett & Folstein, 1993; Dobbs & Rule, 1987; Ginó et al., 2010; Mendes et al., 2008; Pearman, 2009; Ponds, Commissaris & Jolles, 1997). In the case of older people, subjective memory complaints have been particularly associated with the management of daily living activities and perceived quality of life, and they have been studied as possible indicators of cognitive decline, mild cognitive impairment (MCI) and even dementia (e.g., Farias et al., 2009; Hong et al., 2014; Juncos-Rabadan et al., 2012; Maki et al., 2014; Montejo et al., 2012; Ogata et al., 2015; Rönnlund et al., 2015a; Rönnlund et al., 2015b; Waldorff et al., 2012). Despite the great importance of subjective memory complaints in elderly populations, the characterization of the same phenomenon in younger groups is also relevant to explore how memory changes are perceived across development, and how this self-report can be used in the evaluation of memory difficulties in specific age groups (Ginó et al., 2010; Pearman, 2009).
More than forgetting information about past events, research suggests individuals tend to report forgetfulness for previously planned intentions when the appropriate circumstances arise, that is they perceive prospective memory (PM) failures as more frequent than retrospective memory (RM) failures (Crawford et al., 2003; Hsu & Hua, 2011; Smith et al., 2000; Terry, 1988). Nevertheless, the number of reports dedicated to the development and study of psychometric properties of PM measures is inferior compared to RM measures (Thöne-Otto & Walther, 2008; Woods et al., 2008). This scenario has been changing in recent years due to the development of different objective and subjective measures that integrate both PM and RM functioning. One chief example is the Prospective and Retrospective Memory Questionnaire (PRMQ; Smith et al., 2000), in which the individuals are invited to subjectively judge the frequency of specific RM and PM lapses.
This brief questionnaire has been extensively applied in different cultural backgrounds, and in distinct healthy and clinical populations, revealing good psychometric properties (see Supporting Table S1). Even so, the study of how specific sociodemographic variables, namely sex and age, are related with the scores obtained in the PRMQ has been variable across studies and different cultural adaptations. While some studies revealed no differences between male and female participants (Crawford et al., 2006; Hsu & Hua, 2011; Rönnlund, Mäntylä & Nilsson, 2008; van der Werf & Vos, 2011), others found that male participants reported more RM (Crawford et al., 2003) or PM slips than female participants (Crawford et al., 2006). Additionally, in the study of Piauilino and colleagues (2010), the female participants showed more general memory failures than male participants. Concerning age, it is common to find no significant associations between age and PRMQ scores (Crawford et al., 2006; Crawford et al., 2003; Piauilino et al., 2010; Smith et al., 2000; van der Werf & Vos, 2011) or weak correlations between some scores (González-Ramírez & Mendoza-González, 2011; Hsu & Hua, 2011). Some of the former findings can be a result of large sample sizes (e.g., Crawford et al., 2003; González-Ramírez & Mendoza-González, 2011), since p-values are amenable to sample size variability (Cohen, 1990; Sullivan & Feinn, 2012). Hence, the general picture indicates that sex and age might not have a prominent influence in the PRMQ.
The main aim of this work is to provide, for the first time, data regarding the adaptation and the psychometric properties of the European Portuguese version of the PRMQ with a web-based sample of younger healthy participants. We also intend to probe how sex and age might play a role in the results obtained in this version. For this purpose, an analysis of measurement invariance is included to test if the concepts of the PRMQ are being measured in a similar way in distinct sex and age groups of the current sample.
A total of 1052 healthy participants, aged between 18 and 54 years old (M = 22.24, SD = 5.59), 71.6% female, and with an average of 14.24 years of formal education (SD = 2.37) collaborated in this study. A subset sample (n = 236) completed again the assessment with an average interval of 13.87 days (SD = 3.46). They were aged between 18 and 52 years (M = 23.28, SD = 5.72), 74.2% female, and had an average of 14.88 years of formal education (SD = 2.56).
This study was approved by the Ethics Subcommittee for Social and Human Sciences (SECSH) of University of Minho, and all the participants provided informed consent prior to their enrollment.
The assessment included a brief sociodemographic questionnaire and two memory questionnaires, the PRMQ (Smith et al., 2000) and the Questionnaire of Memory Lapses (QML; Pinto, 1990). The PRMQ is a short questionnaire composed of 16 items in which the participants are invited to evaluate the frequency of occurrence of distinct memory failures using a 5-point rating scale (1 – never; 5 – very often). It comprises two subscales with eight items each, a PM subscale (e.g., “Do you decide to do something in a few minutes’ time and then forget to do it?”) and a RM subscale (e.g., “Do you fail to recognize a place you have visited before?”). The total score corresponds to the sum of all items, which ranges between 16 and 80. Higher scores depict higher frequency of perceived and reported memory slips. The values of internal consistency (between 0.71 and 0.97) and of test-retest reliability (between 0.78 and 0.81) are adequate and above 0.70 as recommended (Burlingame et al., 1995) for different cultural adaptations (see Supporting Table S1).
The QML (Pinto, 1990) is a Portuguese measure with 36 items that evaluates the frequency of daily memory slips in a 7-point scale (1 – never; 7 – always). The score is based on the mean response of all items. The questionnaire has a good internal consistency, namely a good Cronbach’s alpha (total scale = 0.96) and a good split-half reliability (total scale = 0.92) (Vaz, Daniel & Vicente-Castro, 2011). The test-retest reliability was between 0.35 (item 19) and 0.90 (item 34), the average correlation amid items was 0.61 and regarded as acceptable (Pinto, 1990).
The translation of the PRMQ was based on the proposal of Cha, Kim and Erlen (2007) by using the combination of the translation/back-translation method, the committee approach, and the pretest procedure. After having the authorization from the responsible author, the translation from English to European Portuguese was independently conducted by three translators. The translated versions were then discussed in group to reach a single version by agreement of all members. The structure of most items was preserved, yet item 10 – “Do you intend to take something with you, before leaving a room or going out, but minutes later leave it behind, even though it’s there in front of you” – was an exception, because it suffered a significant change in the order of the words. This unique version was tested and discussed in a small group of participants (n = 10) to check the clearness of linguistic features and content. Small linguistic changes were incorporated in this phase. The back-translation was then performed by a Portuguese researcher that lived in the United Kingdom, and the resultant translation was compared with the original version to assure content equivalence. No major issues were observed in this stage. Finally, a pilot study was conducted with 16 university members to test, once again, the comprehensibility and the cultural equivalence of the items of the questionnaire.
Regarding the web-based procedure, the PRMQ and the QML were firstly converted to an online survey using the Google Forms (Google Inc., California, USA, 2016). The survey included four sequential parts. First the informed consent wherein only the participants that gave consent had access to the subsequent parts, second the sociodemographic and the health-related questions, third the PRMQ, and fourth the QML. In the last part of the QML, we also invited the participants to complete again both questionnaires with a temporal interval of approximately 10 days. The dissemination of this study was mainly achieved using social networking websites and with the aid of some Portuguese universities.
The construct validity was tested with a confirmatory factor analysis (CFA), and the selected models were based in previous studies (Crawford et al., 2006; Crawford et al., 2003; González-Ramírez & Mendoza-González, 2011; Hsu & Hua, 2011; Piaulino et al., 2010; Rönnlund, Mäntylä & Nilsson, 2008). Three models were scrutinized: Model 1 that considered a general episodic memory factor underpinning covariance among the 16 items; Model 2 that deemed the existence of two associated factors, a PM and a RM factor; Model 3 that proposed an orthogonal tripartite approach with a general episodic memory, a PM factor which included all the PM items, and a RM factor comprising the RM items. The maximum likelihood (ML) method was used to estimate all the parameters, since there is evidence showing that it can be robust to moderate violations of normality (Hu, Bentler & Kano, 1992; Muthén & Kaplan, 1985), offering also acceptable results for ordinal variables (Rhemtulla, Brosseau-Liard & Savalei, 2012). Different fit indices were used as indicators of good fit, namely a root mean squared error of approximation (RMSEA) value inferior to 0.06, a standardized root mean squared residual (SRMR) value below to 0.08, and a comparative fit index (CFI) above or equal to 0.95 (Bentler & Moijart, 1989; Hu & Bentler, 1999).
For the model with the best fit indices, we also performed a multi-group CFA (MGCFA) with the ML method to examine the measurement invariance (MI) across sex and age. The female group was composed of 753 participants and the male group had 294. The age groups were formed by diving the sample in three approximately equal parts (n = 372/375/304), using 19 and 22 years as cutoffs. The idea was to verify if the constructs were being measured in a similar way in the former groups by applying a series of gradually stringent invariance tests (van de Schoot, Lutlig & Hox, 2012): configural invariance, metric invariance, scalar invariance, uniqueness MI, and structural invariance. To evaluate the goodness of fit across MI models, a change of ≤0.01 in CFI (ΔCFI) and of ≤0.015 in RMSEA (ΔRMSEA) were used as recommended invariance indicators (Chen, 2007; Cheung & Rensvold, 2002). The convergent validity was tested with a Pearson’s product-moment correlation between the PRMQ scores and the mean responses in the QML.
Regarding the reliability features of the PRMQ, the internal consistency was explored by using the Cronbach’s alpha, and the test-retest reliability was based on Pearson’s correlations between the first and the second moment of assessment in a subgroup of participants. The influence of sociodemographic variables was tested by applying Pearson’s correlations for age and independent samples t-tests for sex. The interpretation of all correlation coefficients followed the literature standards (Cohen, 1988; Mukaka, 2012). Additionally, we also performed a paired-sample t-test to evaluate if there was any statistically significant difference between the frequency of reported RM and PM failures.
The results were interpreted as statistically significant for p < 0.05, and we reported Cohen’s d as a measure of effect size for t-tests (Cohen, 1988; Sullivan & Feinn, 2012). The statistical analyses were conducted with the IBM Statistical Package for the Social Sciences Statistics software, version 22 (IBM SPSS Statistics for Windows, Armonk, NY), and with the AMOS software, version 23 (IBM SPSS AMOS, Chicago).
The first step in the data analysis was to obtain the descriptive statistics for each item of the PRMQ, and to assure that all the values of the 5-point rating scale were used in each item (see Table 1).
|Items||M||SD||Skewness||Kurtosis||General episodic memory factor||PM factor||RM factor|
A summary of the fit indices of the three models can be found in Table 2. For all the models, we observed that the chi-square (χ2) statistic was statistically significant (p < 0.05), which suggests a poor fit to the observed data. Even so, the χ2 is recognized to be highly sensitive to sample size, hence it is difficult to retain the null hypothesis. In this case, the analysis of the fit indexes is essential. More specifically, the Model 1 showed a poor fit with a CFI below 0.95 and a RMSEA above 0.06. The standardized item loadings varied between 0.33 and 0.67, and the loading average was 0.57 (see Supporting Figure S1). A similar result was found for Model 2, the CFI was inferior to 0.95, and the RMSEA marginally superior to 0.06. The standardized item loadings ranged between 0.56 and 0.69 for the PM factor (average was 0.63), between 0.36 and 0.67 for the RM factor (average was 0.55), and there was an association of 0.90 between factors (see Supporting Figure S2). The Model 3 that comprised three orthogonal factors, the general episodic memory factor, the RM factor and the PM factor was the model with the best fit indices, namely it yielded a RMSEA below 0.06, a SRMR below 0.08 and a CFI marginally below the cutoff value of 0.95. Despite this, not all the item loadings were satisfactory (see Table 1 and Supporting Figure S3). Indeed, most of the items presented higher loadings in the general episodic factor than in the PM and the RM factors.
|1. General episodic memory factor||652.956||104||0.071||0.046||0.895|
|2. RM and PM associated factors||578.801||103||0.066||0.043||0.909|
|3. Tripartite model||352.027||88||0.053||0.033||0.949|
|Multigroup analysis across sex|
|Multigroup analysis across age|
The results of the MGCFA across sex and age can be accessed in Table 2. Although the χ2 statistics were once again significant for all models (p < 0.05), the fit indices of SRMR and RMSEA were satisfactory, and the CFI ranged between 0.93 and 0.95, revealing values slightly under the cutoff point. Moreover, the goodness of fit of sex and age MI models was sponsored by a ΔCFI and ΔRMSEA below 0.01. These results support the claim that the PRMQ is an analogous measure in these groups.
The correlations between the average frequency of daily memory lapses obtained from the QML and the PRMQ scores were all satisfactory, positive, and statistically significant (p < 0.001). More particularly, the correlation was higher for the total PRMQ (r = 0.85), then for the PM subscale (r = 0.80), and finally for the RM subscale (r = 0.78).
In Table 3, it is presented the descriptive statistics of the total and the subscales scores of the PRMQ, and the correlations subscale-total and subscale-subscale which were satisfactory. The internal consistency values, estimated with the Cronbach’s alpha, were also acceptable (Burlingame et al., 1995): 0.89 for the total scale, 95% CI [0.88, 0.90], 0.84 for the PM subscale, 95% CI [0.83, 0.85], 0.78 for the RM subscale, 95% CI [0.76, 0.80]).
|M (SD)||Range||Skewness||Kurtosis||PRMQ total score||PM score||RM score|
|PRMQ total score||39.10 (9.26)||17–74||0.54||0.44||–||0.94*||0.92*|
|PM score||20.98 (5.28)||9–40||0.49||0.21||0.94*||–||0.72*|
|RM score||18.13 (4.70)||8–37||0.60||0.63||0.92*||0.72*||–|
From the subset sample that completed the PRMQ in two different assessments, it was possible to obtain positive, strong and statistically significant correlations (p < 0.001) between the total PRMQ scores (r = 0.85), the PM scores (r = 0.83) and the RM scores (r = 0.82). These results suggested that the PRMQ has a good temporal stability.
Concerning the variable sex, it was possible to observe no statistically significant differences between male and female participants in the total score, t(1045) = 1.56, p = 0.118, d = 0.11, 95% CI [–0.25, 2.23], and in the RM score, t(1045) = 0.65, p = 0.514, d = 0.04, 95% CI [–0.42, 0.84]. Yet there was a significant difference for the PM score, t(1045) = 2.16, p = 0.031, d = 0.15, 95% CI [0.07, 1.49]) wherein female participants reported higher frequency of daily PM related lapses (M = 21.18, SD = 5.24) in comparison with male individuals (M = 20.40, SD = 5.28). Even so, the magnitude of the difference was small (Cohen, 1988; Sullivan & Feinn, 2012).
In the case of age, the results yielded statistically significant negative correlations for the total PRMQ score (r = –0.09, p = 0.004), for the PM score (r = –0.09, p = 0.003), and for the RM score (r = –0.074, p = 0.017). However, all these correlation coefficients can be regarded as negligible (Cohen, 1988; Mukaka, 2012; Sullivan & Feinn, 2012).
We further analyzed if there were differences between the frequency of PM and RM failures. A paired-sample t-test revealed that the PM scores (M = 20.98, SD = 5.28) were significantly superior to the RM scores (M = 18.13, SD = 4.70), t(1051) = 24.63, p < 0.001, d = 0.76, 95% CI [2.63, 3.08]), still the magnitude of this difference was once more small.
The main goal of this study was to provide validity and reliability evidence for the European Portuguese version of the PRMQ. In accordance with previous studies (see Supporting Table S1), this version showed satisfactory values of internal consistency, as well as good test-retest reliability, asserting the PRMQ as a reliable instrument.
Regarding the construct validity, although the tripartite model was the one with the best fit indices as already found in former investigations (Crawford et al., 2006; Crawford et al., 2003; González-Ramírez & Mendoza-González, 2011; Hsu & Hua, 2011; Piauilino et al., 2010; Rönnlund, Mäntylä & Nilsson, 2008; van der Werf & Vos, 2011), it was also observable that not all the items loaded in the expected factors. A similar pattern was reported in studies using an exploratory factor analysis (Benites & Gomes, 2007; González-Ramírez & Mendoza-González, 2011). So far, only two studies found satisfactory item loadings for the tripartite model (Crawford et al., 2003; Rönnlund, Mäntylä & Nilsson, 2008). Interestingly, in other studies (Crawford et al., 2006; González-Ramírez & Mendoza-González, 2011), the items loaded higher when considering the model with only a general episodic memory factor, even if the fit indices were not satisfactory. Moreover, the Model 2 which showed a good correlation between PM and RM factors also pointed to shared variance among items, supporting an implicit general memory factor (González-Ramírez & Mendoza-González, 2011). Higher item loadings were obtained in this model in comparison with the Model 3 in which the same factors were considered independent. These results can pose some difficulties to the use of the PM and RM factors, hence when using these subscales, it is important to take into account that they gather specific and shared variance (Crawford et al., 2003). In the case of MI across age and sex with the tripartite model, it was possible to find evidence of measurement equivalence between different sample subgroups. Thus, this is one of the first studies showing that the PRMQ can be used and interpreted in a similar way in distinct sex and age subgroups.
The convergent and divergent validity of the PRMQ has been mildly addressed in the literature, yet the results obtained so far seem contradictory. Some studies find associations between the PRMQ scores and other general self-report measures of memory (e.g., Gondo et al., 2010; van der Werf & Vos, 2011), while others report only a relation for the RM subscale and not for the total score nor the PM score (e.g., Benites & Gomes, 2007). In here, we provided some evidence of convergent validity with the QML (Pinto, 1990) for all scores, which fits well with the notion of common variance underlying PM and RM factors. More importantly, the evidence so far shows that the PRMQ has some convergent validity at least when similar self-report measures are used (van der Werf & Vos, 2011; Vestergren et al., 2011), which is not always the case when using objective memory tasks (Lee et al., 2016; Paquet et al., 2017; Thompson et al., 2015; Uttl & Kibreab, 2011).
Considering that we assured by means of MI that the questionnaire was being interpreted in a similar way regardless of sex, no statistically significant differences between male and female participants were observed for the total PRMQ and the RM scores. Even so, a small difference appeared in the case of the PM score, showing higher frequency of PM slips in female than in male participants. A similar outcome was found for the total PRMQ score in the Brazilian study (Piauilino et al., 2010). Since the differences were small, these results can be understood as an effect of sample size (Crawford et al., 2003). Thus, this study supports the idea that sex does not seem to have a prominent role in the self-report of memory failures (Hsu & Hua, 2011; Ponds, Commissaris & Jolles, 1997; van der Werf & Vos, 2011).
In the case of age and after assuring MI in different age subsets of the sample, statistically significant yet weak correlations between age and PRMQ scores were found, probably due to the large sample size, which is in line with previous investigations (Crawford et al., 2006; Crawford et al., 2003; González-Ramírez & Mendoza-González, 2011; Hsu & Hua, 2011; Piauilino et al., 2010; van der Werf & Vos, 2011). From the literature standpoint, this is an intriguing finding because other studies have been supporting the existence of a decline with age in both PM and RM objective measures (e.g., Deary et al., 2009; Zimmermann & Meier, 2006). Furthermore, some studies also convey the idea that subjective memory complaints are more frequently reported in aged groups (e.g., Dobbs & Rule, 1987; Ponds, Commissaris & Jolles, 1997). In the light of this evidence, firstly, some studies reveal that subjective memory complaints do not increase with age (e.g., Mendes et al., 2008; Rowell et al., 2016; Smith et al., 2000), and the results found here lend evidence to such pattern. Secondly, it is important to consider that the literature has also been showing weak associations between objective and subjective measures of memory functioning (Mendes et al., 2008; Paquet et al., 2017; Thompson et al., 2015; Uttl & Kibreab, 2011), hence the same pattern across age may not be verified for both type of measures. Indeed, other variables such as mood seem to be particularly correlated with self-report measures of memory functioning (Bassett & Folstein, 1993; Pearman, 2009), and this result holds true for younger and middle-age adults (Mendes et al., 2008; Rowell et al., 2016). While objective tests seem to provide a more reliable approximation to memory functioning, subjective measures allow to explore other factors, such as memory self-efficacy, self-awareness and mood (Roche, Fleming & Shum, 2002; Rönnlund et al., 2011). In this sense, self-report measures allow the possibility to explore the beliefs underlying personal memory abilities. Also, when persons are aware of their abilities, they tend to implement distinct strategies to prevent possible failures and to assure their success (McDonal-Miszczak, Gould & Tychynski, 1999; Meeks, Hicks & Marsh, 2007). Thus, the information extracted from both objective and subjective measures is diverse and, more importantly, it can complement each other (Fleming et al., 2009; Mioni, McClintock & Stablum, 2014).
Regarding the comparison between the frequency of PM and RM failures, we were not able to replicate the finding that PM problems are more frequently reported than RM problems (Crawford et al., 2003; Hsu & Hua, 2011; Piauilino et al., 2010; Smith et al., 2000), since the difference found was small in magnitude. This result dovetails with the higher item loadings obtained for the general episodic memory factor in all the models tested, suggesting no clear distinction between the evaluation of RM and PM items.
It is noteworthy that only the Dutch adaptation of the PRMQ had an internet-based sample (van der Werf & Vos, 2011), so the present study is the second to use an internet-based procedure. This can raise some issues including the equivalence between web-based and paper-and-pencil approaches, and the sample bias in favor of younger and highly educated individuals. Regarding the first, this study suggests no major differences between procedures, at least in younger adults, since similar outcomes of reliability and validity were obtained. In fact, our team conducted a pilot study with the paper-and-pencil version of the PRMQ in a sample of 85 participants (age: 17–48 years), and it was possible to find good positive correlations between the QLM (Pinto, 1990) and the PRMQ scores (Total: 0.77; PM: 0.79; RM: 0.68; all p < 0.001), and good internal consistency (Total: 0.89; PM: 0.90; RM: 0.78). Even so, future studies are warrant to test the equivalence of internet-based and paper-and-pencil procedures. Concerning the sample bias, this is precisely one central limitation. Therefore, the results obtained here are restricted as we did not have a representative sample of the European Portuguese population. Furthermore, this ends up introducing other shortcomings such as the impossibility to study in a more comprehensive manner the influence of age, and even the role of formal education which can be an important factor to consider (e.g., Hsu & Hua, 2011). In this sense, future studies can extend the findings reported here by enrolling a more representative sample, especially middle-age and elderly participants with lower levels of formal education.
Overall, the results obtained here offer the first evidence of validity and reliability for the European Portuguese translation of the PRMQ. This is an important step since there are few available measures in Portuguese for the assessment of episodic memory complaints.
This work was funded by the Portuguese Foundation for Science and Technology (FCT) under a Doctoral grant (PD/BD/105964/2014) of the FCT PhD Programmes with the support of the Operational Programme for Human Capital (POCH). It was partially conducted at Psychology Research Centre (UID/PSI/01662/2013), University of Minho, supported by the FCT and the Portuguese Ministry of Education and Science through national funds and co-financed by FEDER through COMPETE2020 under the Portugal2020 Partnership Agreement (POCI-01-0145-FEDER-007653). The authors would like to thank particularly the original authors of the questionnaire, and the institutions that responsively helped to spread the word regarding the study, namely University of Porto and University of Beira Anterior. We would like to acknowledge Joana Coutinho, Alberto Crego, and Ana Seara-Cardoso for aiding with the translation procedures. Special thanks are also due to the members of the Neuropsychophysiology Laboratory and the Human Memory Research Group of the University of Minho for the feedback in the early stages of the questionnaire adaptation. The authors would like to acknowledge all the participants that collaborated in this work, and the reviewers whose comments helped to improve the manuscript.
The authors have no competing interests to declare.
Bassett, S. S., & Folstein, M. F. (1993). Memory complaint, memory performance, and psychiatric diagnosis: A community study. Journal of Geriatric Psychiatry and Neurology, 6(2), 105–111. DOI: https://doi.org/10.1177/089198879300600207
Benites, D., & Gomes, W. B. (2007). Tradução, adaptação e validação preliminar do Prospective and Retrospective Memory Questionnaire (PRMQ). Psico-USF, 12(1), 45–54. DOI: https://doi.org/10.1590/S1413-82712007000100006
Bentler, P. M., & Moijart, A. (1989). Choice of structural model by parsimony: A rationale based on precision. Psychological Bulletin, 106(2), 315–317. DOI: https://doi.org/10.1037/0033-2909.106.2.315
Burlingame, G. M., Lambert, M. J., Reisinger, C. W., Neff, W. M., & Mosier, J. (1995). Pragmatics of tracking mental health outcomes in a managed care setting. Journal of Mental Health Administration, 22(3), 226–236. DOI: https://doi.org/10.1007/BF02521118
Cha, E. S., Kim, K. H., & Erlen, J. A. (2007). Translation of scales in cross-cultural research: Issues and techniques. Journal of Advanced Nursing, 58(4), 386–395. DOI: https://doi.org/10.1111/j.1365-2648.2007.04242.x
Chen, F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. DOI: https://doi.org/10.1080/10705510701301834
Cheung, G., & Rensvold, R. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. DOI: https://doi.org/10.1207/S15328007SEM0902_5
Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45(12), 1304–1312. DOI: https://doi.org/10.1037/0003-066X.45.12.1304
Crawford, J. R., Henry, J. D., Ward, A. L., & Blake, J. (2006). The Prospective and Retrospective Memory Questionnaire (PRMQ): Latent structure, normative data and discrepancy analysis for proxy-ratings. British Journal of Clinical Psychology, 45, 83–104. DOI: https://doi.org/10.1348/014466505X28748
Crawford, J. R., Smith, G., Maylor, E. A., Della Sala, S., & Logie, R. H. (2003). The Prospective and Retrospective Memory Questionnaire (PRMQ): Normative data and latent structure in a large non-clinical sample. Memory, 11(3), 261–275. DOI: https://doi.org/10.1080/09658210244000027
Deary, I. J., Corley, J., Gow, A. J., Harris, S. E., Houlihan, L. M., Marioni, R. E., Starr, J. M., et al. (2009). Age-associated cognitive decline. British Medical Bulletin, 92(1), 135–152. DOI: https://doi.org/10.1093/bmb/ldp033
Dobbs, A. R., & Rule, B. G. (1987). Prospective memory and self-reports of memory abilities in older adults. Canadian Journal of Psychology, 41(2), 209–222. DOI: https://doi.org/10.1037/h0084152
Farias, S. T., Cahn-weiner, D. A., Harvey, D. J., Bruce, R., Mungas, D., Kramer, J. H., & Chui, H. (2009). Longitudinal changes in memory and executive functioning are associated with longitudinal change in instrumental activities of daily living in older adults. The Clinical Neuropsychologist, 23(3), 446–461. DOI: https://doi.org/10.1080/13854040802360558
Fleming, J., Kennedy, S., Fisher, R., Gill, H., Gullo, M., & Shum, D. (2009). Validity of the Comprehensive Assessment of Prospective Memory (CAPM) for use with adults with traumatic brain injury. Brain Impairment, 10(1), 34–44. DOI: https://doi.org/10.1375/brim.10.1.34
Ginó, S., Mendes, T., Maroco, J., Ribeiro, F., Schmand, B. A., Mendonça, A., & Guerreiro, M. (2010). Memory complaints are frequent but qualitatively different in young and elderly healthy people. Gerontology, 56(3), 272–277. DOI: https://doi.org/10.1159/000240048
Gondo, Y., Renge, N., Ishioka, Y., Kurokawa, I., Ueno, D., & Rendell, P. (2010). Reliability and validity of the Prospective and Retrospective Memory Questionnaire (PRMQ) in young and old people: A Japanese study. Japanese Psychological Research, 52(3), 175–185. DOI: https://doi.org/10.1111/j.1468-5884.2010.00433.x
González-Ramírez, M. T., & Mendoza-González, M. E. (2011). Spanish version of the Prospective and Retrospective Memory Questionnaire (PRMQ-S). The Spanish Journal of Psychology, 14(1), 385–391. DOI: https://doi.org/10.5209/rev_SJOP.2011.v14.n1.35
Hong, J. Y., Sunwoo, M. K., Chung, S. J., Ham, J. H., Lee, J. E., Sohn, Y. H., & Lee, P. H. (2014). Subjective cognitive decline predicts future deterioration in cognitively normal patients with Parkinson’s disease. Neurobiology of Aging, 35(7), 1739–1743. DOI: https://doi.org/10.1016/j.neurobiolaging.2013.11.017
Hsu, Y.-H., & Hua, M. S. (2011). Taiwan version of the Prospective and Retrospective Memory Questionnaire: Latent structure and normative data. Archives of Clinical Neuropsychology, 26(3), 240–249. DOI: https://doi.org/10.1093/arclin/acr012
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. DOI: https://doi.org/10.1080/10705519909540118
Hu, L., Bentler, P. M., & Kano, Y. (1992). Can test statistics in covariance structure analysis be trusted? Psychological Bulletin, 112(2), 351–362. DOI: https://doi.org/10.1037/0033-2909.112.2.351
Juncos-Rabadan, O., Pereiro, A. X., Facal, D., Rodriguez, N., Lojo, C., Caamaño, J. A., Eiroa, P., et al. (2012). Prevalence and correlates of cognitive impairment in adults with subjective memory complaints in primary care centres. Dementia and Geriatric Cognitive Disorders, 33(4), 226–232. DOI: https://doi.org/10.1159/000338607
Lee, S., Ong, B., Pike, K. E., Mullaly, E., Rand, E., Storey, E., Kinsella, G. J., et al. (2016). The Contribution of Prospective Memory Performance to the Neuropsychological Assessment of Mild Cognitive Impairment. The Clinical Neuropsychologist, 30(1), 131–149. DOI: https://doi.org/10.1080/13854046.2015.1135983
Maki, Y., Yamaguchi, T., Yamagami, T., Murai, T., Hachisuka, K., Miyamae, F., Yamaguchi, H., et al. (2014). The impact of subjective memory complaints on quality of life in community-dwelling older adults. Psychogeriatrics, 14(3), 175–181. DOI: https://doi.org/10.1111/psyg.12056
McDonal-Miszczak, L., Gould, O. N., & Tychynski, D. (1999). Metamemory predictors of prospective and restrospective memory performance. The Journal of General Psychology, 126(1), 37–52. DOI: https://doi.org/10.1080/00221309909595350
Meeks, T. J., Hicks, J. L., & Marsh, R. L. (2007). Metacognitive awareness of event-based prospective memory. Consciousness and Cognition, 16(4), 997–1004. DOI: https://doi.org/10.1016/j.concog.2006.09.005
Mendes, T., Ginó, S., Ribeiro, F., Guerreiro, M., Sousa, G., Ritchie, K., & Mendonça, A. (2008). Memory complaints in healthy young and elderly adults: Reliability of memory reporting. Aging & Mental Health, 12(2), 177–182. DOI: https://doi.org/10.1080/13607860701797281
Mioni, G., McClintock, S. M., & Stablum, F. (2014). Understanding, assessing and treating prospective memory dysfunctions in traumatic brain injury patients. In Traumatic Brain Injury, 401–436. DOI: https://doi.org/10.5772/57307
Montejo, P., Montenegro, M., Fernández, M. A., & Maestú, F. (2012). Memory complaints in the elderly: Quality of life and daily living activities. A population based study. Archives of Gerontology and Geriatrics, 54(2), 298–304. DOI: https://doi.org/10.1016/j.archger.2011.05.021
Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38(2), 171–189. DOI: https://doi.org/10.1111/j.2044-8317.1985.tb00832.x
Ogata, S., Hayashi, C., Sugiura, K., & Hayakawa, K. (2015). Association between subjective memory complaints and impaired higher-level functional capacity in people aged 60 years or older. Archives of Gerontology and Geriatrics, 60(1), 201–205. DOI: https://doi.org/10.1016/j.archger.2014.10.015
Paquet, L., Verma, S., Collins, B., Chinneck, A., Bedard, M., & Song, X. (2017). Testing a novel account of the dissociation between self-reported memory problems and memory performance in chemotherapy-treated breast cancer survivors. Psycho-Oncology. Advance online publication. DOI: https://doi.org/10.1002/pon.4389
Pearman, A. (2009). Predictors of subjective memory in young adults. Journal of Adult Development, 16(2), 101–107. DOI: https://doi.org/10.1007/s10804-009-9063-1
Piauilino, D. C., Bueno, O. F. A., Tufik, S., Bittencourt, L. R., Santos-Silva, R., Hachul, H., Pompéia, S., et al. (2010). The Prospective and Retrospective Memory Questionnaire: A population-based random sampling study. Memory, 18(4), 413–426. DOI: https://doi.org/10.1080/09658211003742672
Ponds, R., Commissaris, K., & Jolles, J. (1997). Prevalence and covariates of subjective forgetfulness in a normal population in The Netherlands. International Journal of Ageing and Human Development, 45(3), 207–221. DOI: https://doi.org/10.2190/MVQ1-WB58-875H-Y4X0
Rhemtulla, M., Brosseau-Liard, P. E., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373. DOI: https://doi.org/10.1037/a0029315
Roche, N. L., Fleming, J. M., & Shum, D. H. K. (2002). Self-awareness of prospective memory failure in adults with traumatic brain injury. Brain Injury, 16(11), 931–945. DOI: https://doi.org/10.1080/02699050210138581
Rowell, S. F., Green, J. S., Teachman, B. A., & Salthouse, T. A. (2016). Age does not matter: Memory complaints are related to negative affect throughout adulthood. Age & Mental Health, 20(12), 1255–1263. DOI: https://doi.org/10.1080/13607863.2015.1078284
Rönnlund, M., Mäntylä, T., & Nilsson, L. G. (2008). The Prospective and Retrospective Memory Questionnaire (PRMQ): Factorial structure, relations to global subjective memory ratings, and Swedish norms. Scandinavian Journal of Psychology, 49(1), 11–18. DOI: https://doi.org/10.1111/j.1467-9450.2007.00600.x
Rönnlund, M., Sundström, A., Adolfsson, R., & Nilsson, L. G. (2015a). Self-Reported memory failures: Associations with future dementia in a population-based study with long-term follow-up. Journal of the American Geriatrics Society, 63(9), 1766–1773. DOI: https://doi.org/10.1111/jgs.13611
Rönnlund, M., Sundström, A., Adolfsson, R., & Nilsson, L. G. (2015b). Subjective memory impairment in older adults predicts future dementia independent of baseline memory performance: Evidence from the Betula prospective cohort study. Alzheimer’s & Dementia, 11(11), 1385–1392. DOI: https://doi.org/10.1016/j.jalz.2014.11.006
Rönnlund, M., Vestergren, P., Mäntylä, T., & Nilsson, L. G. (2011). Predictors of self-reported prospective and retrospective memory in a population-based sample of older adults. The Journal of Genetic Psychology, 172(3), 266–284. DOI: https://doi.org/10.1080/00221325.2010.538450
Smith, G., Della Sala, S. D., Logie, R. H., & Maylor, E. A. (2000). Prospective and retrospective memory in normal ageing and dementia: A questionnaire study. Memory, 8(5), 311–321. DOI: https://doi.org/10.1080/09658210050117735
Sullivan, G. M., & Feinn, R. (2012). Using effect size—or why the p value is not enough. Journal of Graduate Medical Education, 4(3), 279–282. DOI: https://doi.org/10.4300/JGME-D-12-00156.1
Terry, W. S. (1988). Everyday forgetting – Data from a diary study. Psychological Reports, 62(1), 299–303. DOI: https://doi.org/10.2466/pr0.1922.214.171.1249
Thompson, C. L., Henry, J. D., Rendell, P. G., Withall, A., & Brodaty, H. (2015). How valid are subjective ratings of prospective memory in mild cognitive impairment and early dementia? Gerontology, 61(3), 251–257. DOI: https://doi.org/10.1159/000371347
Thöne-Otto, A. I. T., & Walther, K. (2008). Assessment and treatment of prospective memory disorders in clinical practice. In: Kliegel, M., McDaniel, M. A., & Einstein, G. O. (eds.), Prospective memory: Cognitive, neuroscience, developmental, and applied perspectives, 321–345. New York, NY: Taylor & Francis Group/Lawrence Erlbaum Associates.
Uttl, B., & Kibreab, M. (2011). Self-report measures of prospective memory are reliable but not valid. Canadian Journal of Experimental Psychology, 65(1), 57–68. DOI: https://doi.org/10.1037/a0022843
van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. DOI: https://doi.org/10.1080/17405629.2012.686740
van der Werf, S. P., & Vos, S. (2011). The Prospective and Retrospective Memory Questionnaire: Psychometric properties and normative data of a dutch translation. Netherlands Journal of Psychology, 66(4), 120–128.
Vestergren, P., Rönnlund, M., Nyberg, L., & Nilsson, L. G. (2011). Development of the Cognitive Dysfunction Questionnaire (CDQ) in a population based sample. Scandinavian Journal of Psychology, 52(3), 218–228. DOI: https://doi.org/10.1111/j.1467-9450.2010.00861.x
Waldorff, F. B., Siersma, V., Vogel, A., & Waldemar, G. (2012). Subjective memory complaints in general practice predicts future dementia: A 4-year follow-up study. International Journal of Geriatric Psychiatry, 27(11), 1180–1188. DOI: https://doi.org/10.1002/gps.3765
Woods, S. P., Moran, L. M., Dawson, M. S., Carey, C. L., Grant, I., & Group, T. H. N. R. C. (HNRC). (2008). Psychometric characteristics of the Memory for Intentions Screening Test. The Clinical Neuropsychologist, 22(5), 864–878. DOI: https://doi.org/10.1080/13854040701595999