The Reinforcement Sensitivity Theory (RST; Gray, 1970, 1987; Gray & McNaughton, 2000) is a frequently used theoretical framework for explaining motivated behaviour and emotion (Smillie, Pickering, & Jackson, 2006) that is very relevant to the period of adolescence (Galván, 2013; Romer & Hennessy, 2007). However, few questionnaires measuring the RST-constructs have been validated in samples of adolescents.
Originally, the RST discriminates between three independent biological systems: the Behavioural Inhibition System (BIS), activated by conditioned aversive signals and leading to inhibition, the Behavioural Activation System (BAS), activated by conditioned appealing stimuli and leading to approach behaviour, and the Fight-Flight System, activated by unconditioned aversive stimuli and leading to defensive aggression or escape behaviour (Gray, 1970, 1987). Most studies focus on the BIS and the BAS, with interindividual differences in the sensitivity of these systems which are thought to reflect the personality dimensions anxiety and impulsivity respectively (Gray, 1987). Individuals with a highly reactive BIS system are expected to experience high levels of anxiety and to be more cautious, while individuals with a highly reactive BAS system are assumed to display high levels of impulsivity and more risk-taking behaviors (Carver & White, 1994).
In 2000, the RST was revised (Gray & McNaughton, 2000). In this revision, the distinction between conditioned and unconditioned stimuli disappeared. As such, the BIS is now assumed to inhibit all ongoing behaviour whenever conflicts arise due to competing motivational objectives, implying that it no longer functions as a punishment system, but rather serves as a system for conflict detection and resolution (Smillie et al., 2006). The BAS is assumed to mediate responses to all appetitive stimuli (Gray & McNaughton, 2000) and the Fight-Flight System, now called the Fight-Flight-Freeze-System, is thought to be responsible for all reactions to aversive stimuli, leading to aggressive behaviour or fear (Gray & McNaughton, 2000).
Instruments measuring the revised RST-concepts are rare and have seldom been validated (Cogswell, Alloy, van Dulmen, & Fresco, 2006). In contrast, several questionnaires have been constructed to measure BIS and BAS sensitivity as defined by the original RST, such as the BIS/BAS Scales (Carver & White, 1994) and the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ; Torrubia, Avila, Molto, & Caseras, 2001). The BIS/BAS Scales consist of one BIS-scale and three BAS-subscales, namely BAS-Drive (the persistent pursuit of desired goals), BAS-Fun Seeking (the desire for new rewards and a willingness to approach potentially rewarding events) and BAS-Reward Responsiveness (the positive responsivity to reward) (Carver & White, 1994). The SPSRQ (Torrubia et al., 2001) discriminates between the facet scales Sensitivity to Punishment (SP) and Sensitivity to Reward (SR), assessing BIS and BAS functioning respectively. This questionnaire differs from the BIS/BAS Scales in the sense that the items of the BIS/BAS Scales measure reactions to general cues of punishment and reward, whereas the items of the SPSRQ are related to specific cues of punishment and reward, which is more in line with the theoretical propositions of the RST (Matthews & Gilliland, 1999; Torrubia et al., 2001).
Several suggestions have been made regarding how to interpret the scores obtained on these questionnaires within the revised RST. According to the revised RST, BIS as conceptualized by the original theory is a combination of both the revised BIS- and Fight-Flight-Freeze-System- sensitivity (Corr, 2004; Harrison, O’Brien, Lopez, & Treasure, 2010). In line with the theory, it has been proposed that the BIS-scale of the BIS/BAS Scales and the SP-scale of the SPSRQ might include items measuring the sensitivity of the revised BIS as well as the Fight-Flight-Freeze-System (e.g., Smillie et al., 2006). Therefore, some authors propose a subdivision of the BIS-scale of the BIS/BAS Scales into a BIS- and a Fight-Flight-Freeze-System- subscale (e.g., Heym, Ferguson, & Lawrence, 2008; Vervoort et al., 2010). An additional complexity of the interpretation within the revised RST relates to the theorized relation between BIS and BAS. According to the original RST, BIS and BAS are two orthogonal systems (i.e., separable subsystems hypothesis) (Pickering, 1997). Therefore, the scales of both the BIS/BAS Scales and the SPSRQ are developed to be uncorrelated (Carver & White, 1994; Torrubia et al., 2001). Due to limited evidence for BIS and BAS as independent systems, the revised RST posited that although the biological substrates of BIS and BAS may be independent, the behavioural outcome will in most cases be determined by a combination of both BIS and BAS (Corr, 2001, 2004; Vervoort et al., 2010).
Although the validity of these questionnaires, originally developed for adult populations, is well-established in adults (Jorm et al., 1998; Torrubia et al., 2001) and in children (Luman, van Meel, Oosterlaan, & Geurts, 2012; Muris, Meesters, de Kanter, & Timmerman, 2005), they have rarely been psychometrically evaluated among adolescents. This is surprising given the frequent use of the BIS/BAS Scales (e.g., Jones, Tai, Evershed, Knowles, & Bentall, 2006; Knyazev, Slobodskaya, & Wilson, 2004; Ko et al., 2008; Loxton & Dawe, 2001) and the SPSRQ (e.g., Delgado-Rico, Río-Valle, González-Jiménez, Campoy, & Verdejo-García, 2012; Matton, Goossens, Vervaet, & Braet, 2015; Moreno-López, Soriano-Mas, Delgado-Rico, Rio-Valle, & Verdejo-García, 2012; Verdejo-García et al., 2010) in this age group, and the importance to measure the constructs among adolescents. Indeed, the role of BIS and BAS might be very important during adolescence given that reward processing peaks during this developmental age period whereas inhibitory capacities are generally lower compared to other age groups (Galván, 2013; Romer & Hennessy, 2007). Furthermore, variations in BIS and BAS sensitivity can explain individual differences in personality and psychopathology (e.g., Harrison, Treasure, & Smillie, 2011; Heym, Kantini, Checkley, & Cassaday, 2015; Soler et al., 2014). Two studies report findings concerning the factor structure of the BIS/BAS Scales in adolescent samples (Cooper, Gomez, & Aucote, 2007; Yu, Branje, Keijsers, & Meeus, 2011) with Cooper et al. (2007) finding evidence for a four-factor model in an Australian population, whereas Yu et al. (2011) found evidence for a two-factor model in a Dutch population. Regarding the SPSRQ there is even less clarity, since, to our knowledge, this questionnaire has never been validated among adolescents until now.
The first goal of the present study was to perform Exploratory Structural Equation Modeling (ESEM) on both scales to examine the two-factor structure in an adolescent sample. Secondly, we investigated the internal consistency of both questionnaires. Thirdly, the convergent validity was examined by looking at the correlations of both questionnaires with each other and with a related measure of temperament. For this purpose, we used the Temperament and Character Inventory – short form (TCI-SF; Cloninger, Svrakic, & Przybeck, 1993; Duijsens & Spinhoven, 2001). The TCI-SF is based on the personality model of Cloninger, which is related to the RST but focuses on the level of personality rather than on the level of biological substrates (Cloninger, 1987; Cloninger et al., 1993). Four temperament factors are discriminated within this model: Harm Avoidance (i.e., inhibition of responses in the face of aversive stimuli), Novelty Seeking (i.e., responding actively to novel stimuli), Reward Dependence (i.e., responding positively to conditioned signals of reward) and Persistence (i.e., hard-working, stable and persistent despite frustration and fatigue) (Cloninger, 1987; Cloninger et al., 1993). Harm Avoidance and Novelty Seeking are seen as the two main dimensions within this model and are theoretically related to BIS and BAS as defined by the original RST (e.g., Carver & White, 1994; Torrubia et al., 2001).
Based on the theoretical assumptions of the RST (Gray, 1970, 1987; Gray & McNaughton, 2000), and previous findings in Dutch adolescents (Yu et al., 2011), we expected that a two-factor model of both the BIS/BAS Scales and the SPSRQ would show an acceptable fit and good internal consistency. As the factor structure of these scales has never been investigated in a sample of Flemish adolescents, we followed the principle of parsimony, which suggests that simpler models should be tested before advancing to more complicated models (American Psychological Association, 1985). It was further hypothesized that within these two-factor models the BIS-scale would be positively related to the SP-scale, while the BAS-scale would be positively related to the SR-scale. In line with the separable subsystem hypothesis, we expect no correlation between scales measuring BIS sensitivity (i.e., BIS-scale and SP-scale) and BAS sensitivity (i.e., BAS-scale and SR-scale). We further hypothesize that measures of BIS sensitivity would be positively related to Harm Avoidance and measures of BAS sensitivity to Novelty Seeking and Reward Dependence, given the theoretical overlap between these constructs. Based on previous research, a positive association was expected between measures of BAS sensitivity and the Persistence-scale (Mardaga & Hansenne, 2007).
The present study was part of a larger study on temperament (see Matton, Goossens, Braet, & Vervaet, 2013) for which nine Flemish secondary schools agreed to participate. This resulted in a sample of 567 participants (39.5% boys; 14–19 years, Mage = 15.73, SD = 1.37) after the removal of 12 outlier scores (z-scores > ± 3). Different educational levels were represented in the sample (i.e., 64.9% general education; 31.9% technical education; 3.0% vocational education; 0.2% missing). All school principals received information about the goal and design of the study and completed active informed consents. Parents were informed about the study via a passive informed non-consent document, meaning that they had to sign the document if they did not want their adolescent to participate. Participants completed active informed consents after receiving general information about the study. The completion of the questionnaires took place during school hours in the presence of a researcher and a teacher. The total study took about one hour in each class. This procedure was approved by the university’s ethical committee.
BIS/BAS Scales. The Dutch version of the BIS/BAS Scales (see http://www.ekgp.ugent.be/pages/nl/vragenlijsten/BISBAS_scales.pdf) is developed by Franken, Muris, and Rassin (2005) and based on the original self-report scales for adults (Carver & White, 1994). The BIS/BAS Scales were developed to assess dispositional BIS- and BAS-sensitivities and contain 24 items on a four point scale, ranging from ‘totally disagree’ (score 1) to ‘totally agree’ (score 4). Two main scales are distinguished, a BIS-scale (7 items) and a BAS-scale (13 items). The remaining 4 items are fillers.
Sensitivity to Punishment and Sensitivity to Reward Questionnaire. The SPSRQ (Torrubia et al., 2001) was developed to assess BIS- and BAS- functioning by the SP- and SR-scales respectively. This questionnaire was translated and adapted for Dutch children and adolescents by Verbeken (2009) and contains 44 items (i.e., 22 items for each scale), answered on a five point scale ranging from ‘never’ (score 1) to ‘always’ (score 5) (see Appendix A). Four items referring to the rewards of drugs, jobs or paying in a restaurant were removed from the original 48-item item questionnaire because these situations were less appropriate for this age group. Secondly, to decrease the difficulty of the items, they were transformed from questions into statements.
Temperament and Character Inventory – short form. The TCI-SF (Cloninger et al., 1993; Duijsens & Spinhoven, 2001) consists of 105 items and is developed to measure the previously described temperament dimensions of Novelty Seeking, Harm Avoidance, Reward Dependence and Persistence, as well as three character dimensions (i.e., Self-Directedness; Cooperativeness, and Self-Transcendence). Each of the seven scales consists of 15 items. As Gray’s concepts of BIS and BAS-sensitivity refer to stable traits, only the four temperament scales were included. Each item is formulated as a statement and is answered by marking ‘correct’ (score 1) or ‘incorrect’ (score 0). Internal consistency in the present sample was good for Harm Avoidance (Cronbach’s α = .84), and acceptable for Reward Dependence (Cronbach’s α = .75), Persistence (Cronbach’s α = .71) and Novelty Seeking (Cronbach’s α = .70).
The hypothesized two-factor structure of the BIS/BAS Scales and the SPSRQ was tested in Mplus 7.4 (Muthén & Muthén, 1998–2015) using Exploratory Structural Equation Modeling (ESEM; Asparouhov & Muthén, 2009). ESEM was applied since it integrates the advantages of both a standard confirmatory factor analysis (i.e., assessing the fit of an a priori model using different SEM parameters and specification of correlated residuals) and exploratory factor analysis (i.e., estimations of cross loadings; Marsh, Morin, Parker, & Kaur, 2014; Wiesner & Schanding, 2013). The latter is important since instruments measuring psychological concepts such as BIS and BAS may have cross loadings (Asparouhov & Muthén, 2009; Marsh et al., 2009). Indeed, limited evidence was found for BIS and BAS as completely orthogonal systems. In order to estimate model parameters, we used Robust Maximum Likelihood Estimation on all data. This full-information estimator provides test statistics and standard errors that are robust to non-normality, non-independence of observations and ordered-categorical variables (Muthén & Muthén, 1998–2015), and handles missing values (Graham, 2009), which were missing completely at random as shown by the Missing Completely At Random test (Little, 1988) (BIS/BAS Scales: χ2 (454) = 472.21, p = .26; SPSRQ: χ2 (1765) = 1756.68, p = .55).
Model fit was assessed by relative or normed Chi square (chi-square/degrees of freedom; χ²/df), the Comparable Fit Index (CFI), Root Mean Squared Error of Approximation (RMSEA), and Standardized Root Mean square Residual (SRMR) for fit relative to a null-model. Values of a χ²/df ≤ 5 indicate an acceptable model fit, values ≤ 3 point to a good model fit and values ≤ 2 suggest a very good model fit (Kline, 2015; Schumacker & Lomax, 2004). Cut-off values ≥ .90 for the CFI indicate adequate model fit (Hu & Bentler, 1999). Values of the RMSEA ≤ .05 indicate a good model fit, values ≤ .08 point to an approximate model fit and values ≤ .10 suggest an acceptable model fit (Chen, Curran, Bollen, Kirby, & Paxton, 2008). Cut-off values ≤ .08 for the SRMR suggests a good model fit (Hu & Bentler, 1999). Although these cut-off values are frequently used, they should be handled with caution in social sciences, as factor loadings are usually lower in that research area (Heene, Hilbert, Draxler, Ziegler, & Bühner, 2011). In order to improve model fit, modification indices of residual correlations with values greater than .20 were examined. The models were retested after adding correlated residuals and the removal of poorly loading items, defined as having a factor loading below .30 on the expected factor and a factor loading of .30 or more on the opposite factor, or having poor factor loadings on both factors (Cogswell et al., 2006).
Reliabilities of the original scales and modified scales (i.e., removal of poorly loading items) were tested via Cronbach’s alpha. To test the convergent validity of the BIS/BAS Scales and the SPSRQ, Pearson correlations were calculated between both modified questionnaires as well as with the TCI-SF.
BIS/BAS Scales. The fit indices of the ESEM models can be found in Table 1. The full 20-item model indicates a good model fit according to SRMR and normed Chi square, an approximate model fit according to RMSEA, but does not show adequate fit according to CFI. Examination of the item pairs indicated high residual correlations between some of the BAS items, more specifically item 3 with item 9 (i.e., very similar wording), item 4 with item 5 (i.e., neighbouring items in the questionnaire and both point to the recurrent striving for a desired goal), item 10 with item 15 (i.e., both about fun here and now), item 9 with item 20 (i.e., both about the pursuit of feeling good) and item 2 with item 22 (i.e., both point to no fear). After removal of poorly loading items (i.e., item 4, item 5, item 10, item 18, item 22, and item 23) and adding two correlated errors within the BAS item pool, a modified 14-item model was constructed. According to the four fit indices, the modified 14-item model points to a good model fit. All items have a high loading (> .30) on one of the factors, and the pattern confirms the expected differentiation of BIS and BAS (see Table 2).
|Full model (20 items)||439.67***||151||2.91||.82||.06||.05|
|Modified model (14 items)||135.98***||62||2.19||.94||.05||.04|
|Full model (44 items)||1920.80***||859||2.24||.78||.05||.05|
|Modified model (36 items)||1033.81***||552||1.87||.89||.04||.04|
|BIS/BAS items||F1 BIS||F2 BAS|
|2. Even if something bad is about to happen to me, I rarely experience fear or nervousness.||–.39***||.14**|
|8. Criticism or scolding hurts me quite a bit.||.66***||–.09|
|13. I feel pretty worried or upset when I think or know somebody is angry at me.||.67***||–.01|
|16. If I think something unpleasant is going to happen I usually get pretty “worked up”.||.57***||.03|
|19. I feel worried when I think I have done poorly at something.||.57***||.06|
|24. I worry about making mistakes.||.55***||.04|
|3. I go out of my way to get things I want.||–.11*||.48***|
|7. When I get something I want, I feel excited and energized.||.17***||.42***|
|9. When I want something, I usually go all-out to get it.||.02||.67***|
|12. If I see a chance to get something I want, I move on it right away.||–.01||.43***|
|14. When I see an opportunity for something I like, I get excited right away.||.12*||.42***|
|15. I often act on the spur of the moment.||.06||.40***|
|20. I crave excitement and new sensations.||–.14*||.53***|
|21. When I go after something I use a “no holds barred” approach.||–.08||.50***|
SPSRQ. The fit indices of the ESEM models can be found in Table 1. The full 44-item model indicates a good model fit according to RMSEA, SRMR and normed Chi square, but does not show adequate fit according to CFI. Examination of the item pairs indicated high residual correlations between some of the SR items, more specifically item 17 with item 29 (i.e., both about quick gains), item 21 with item 35 (i.e., both about competition), item 3 with item 5 (i.e., image, center of attention), item 17 with item 1 (i.e., rewards and gains), item 23 with item 25 (i.e., both about pleasant events), item 34 with item 18 (i.e., shy, insecure), item 19 with item 2 (i.e., illegal, forbidden), item 43 with item 27 (i.e., activity), and item 32 with item 22 (i.e., speaking in public). After removal of poorly loading items (i.e., item 4, item 7, item 13, item 14, item 23, item 25, item 27 and item 31) and adding 7 correlated errors, a modified 36-item model was constructed. The modified 36-item model indicates a good model fit according to RMSEA and SRMR, and a very good model fit according to normed Chi square. Although the model improved according to the CFI, it is still slightly below the cut-off of CFI for an adequate model fit. All items have a high loading (> .30) on one of the factors, and the pattern confirms the expected differentiation of SP and SR (see Table 3).
|SPSRQ-items||F1 SP||F2 SR|
|1. The good prospect of obtaining a reward motivates me strongly to do some things.||.02||.39***|
|3. I like being the centre of attention.||–.17**||.51***|
|5. I spend a lot of time on obtaining a good image.||.07||.49***|
|9. In a group, I try to make my opinions the most intelligent or the funniest.||.08||.57***|
|11. I often take the opportunity to meet people I find attractive.||.02||.54***|
|15. The possibility of social advancement moves me to action, even if this involves not playing fair.||.25***||.33**|
|17. I generally give preference to those activities that imply an immediate gain.||.03||.52***|
|19. I often have trouble resisting the temptation of doing forbidden things.||–.09||.38***|
|21. I like to compete and do everything I can to win.||–.11**||.36***|
|29. I sometimes do things for quick gains.||–.01||.56***|
|33. I would take risks to get rewarded.||–.08||.52***|
|35. I like to put competitive ingredients in all of my activities.||–.04||.49***|
|37. I would like to be a socially powerful person.||.13*||.45***|
|39. I like displaying my physical abilities, even though this may involve danger.||–.20***||.60***|
|41. When I get something I really want, I feel excited and full of energy.||.04||.31***|
|43. I like exciting and new activities.||–.23***||.44***|
|2. I often refrain from doing something because I am afraid of it being illegal.||.52***||–.03|
|6. I am often afraid of new or unexpected situations.||.64***||–.05|
|8. It is difficult for me to telephone someone I do not know.||.43***||–.06|
|10. I often renounce my rights when I know I can avoid a quarrel with a person or an organization.||.48***||.09*|
|12. I am troubled by punishments.||.44***||.15**|
|16. I am easily discouraged in difficult situations.||.62***||.06|
|18. I am a shy person.||.59***||–.20***|
|20. I avoid demonstrating my skill for fear of being embarrassed.||.64***||.01|
|22. When I am with a group, I have difficulties selecting a good topic to talk about.||.53***||–.01|
|24. I is often difficult for me to fall asleep when I think about things I have done or must do.||.46***||.01|
|26. I would be bothered if I had to return to a store when I noticed I was given the wrong change.||.38***||–.03|
|28. Whenever I can, I avoid going to unknown places.||.46***||.10*|
|30. I am often worried by things that I said or did.||.59***||.12**|
|32. I generally try to avoid speaking in public.||.52***||–.12**|
|34. I think that I could do more things if it was not for my insecurity or fear.||.71***||–.04|
|36. Comparing myself to people I know, I am afraid of many things.||.73***||–.07|
|38. I often find myself worrying about things to the extent that performance in intellectual abilities is impaired.||.46***||.24***|
|40. I often refrain from doing something I like in order not to be rejected or disapproved of by others.||.49***||.13*|
|42. Generally, I pay more attention to threats than to pleasant events.||.37***||.22***|
|44. I often refrain from doing something because of my fear of being embarrassed.||.73***||.01|
BIS/BAS Scales. The internal consistencies of the full BIS- and BAS-scales were .75 and .72 respectively. After the removal of items 4, 5, 10, 18, 22, and 23, the internal consistency of the modified BIS- and BAS-scales slightly decreased to .74 and .70 respectively.
SPSRQ. The internal consistencies of the full SP- and SR-scales were .88 and .81 respectively. After the removal of the problematic items 4, 7, 13, 14, 23, 25, 27 and 31, the internal consistency increased to .89 for the modified SP-scale and remained .81 for the modified SR-scale.
BIS and SP of the modified BIS/BAS Scales and SPSRQ were significantly positively related to each other as well as to Harm Avoidance. BAS and SR of the modified BIS/BAS Scales and SPSRQ were significantly positively related to each other as well as to Novelty Seeking. Additionally, the BIS scale of the modified BIS/BAS was significantly positively associated with Reward Dependence and Persistence. No significant correlation was found between BIS and BAS of the modified BIS/BAS Scales, and between SP and SR of the modified SPSRQ. Table 4 presents all correlations.
The BIS/BAS Scales (Carver & White, 1994) and the SPSRQ (Torrubia et al., 2001) are considered to be the two most prominent instruments to operationalize Gray’s RST-concepts (Cogswell et al., 2006). However, few studies have examined their psychometric properties among adolescents. Therefore, we examined the internal structure, reliability and convergent validity of the BIS/BAS Scales and the SPSRQ adapted for adolescents in a large adolescent community sample.
In the current sample, we found no conclusive evidence for the two-factor structure of the initial full item questionnaires. Three of the four fit statistics indicated a reasonable fit for the initial two-factor models of both questionnaires. After removal of problematic items, and the addition of correlated errors in the measurement models, all fit indices indicated a good fit for the BIS/BAS Scales. These results are in line with the theoretical assumptions of the RST (Gray, 1970, 1987; Gray & McNaughton, 2000), and previous findings obtained in Dutch adolescent samples (Yu et al., 2011). In the case of the SPSRQ, three of the four fit indices pointed to a good to very good model fit, while a fourth fit index was slightly below the cut-off score of an adequate model fit. Taking all fit indices into account, it seems reasonable to conclude that acceptable fit has been obtained. Regarding the poorly loading items of both questionnaires, several of them have been found to be problematic in previous research as well (Cogswell et al., 2006; Heubeck, Wilkinson, & Cologon, 1998; Jorm et al., 1998; Torrubia et al., 2001; Yu et al., 2011).
The internal consistencies of the modified scales were acceptable for the BIS/BAS Scales and good for the SPSRQ. Regarding construct validity of the modified scales, the relations were mainly in line with the expectations, with significant positive associations between the BIS and SP, and between BAS and SR. Moreover, BIS and SP were also positively associated with Harm Avoidance, and BAS and SR were positively associated with Novelty Seeking. Except for a significant negative correlation between BAS and SP, no other significant correlations were found between measures of the two different theoretical constructs. The non-significant correlations between scales assessing BAS functioning and scales assessing BIS functioning are in line with the original RST suggesting that BIS and BAS are orthogonal and unrelated systems. The significant correlation between BAS and SP supports the Joint Subsystem Hypothesis (Corr, 2001, 2004) suggesting that behavioural and emotional outcomes may be the result of the combined BIS and BAS sensitivities (Corr, 2001, 2004). Unexpectedly, we found that the BIS-scale was significantly and positively related to Persistence. Since the ‘drive’ component of the BAS-scale is theoretically related to Persistence, a positive correlation was expected between Persistence and the BAS-scale instead of the BIS-scale (Mardaga & Hansenne, 2007). It would be relevant to investigate whether this finding is age-specific, culture specific or instrument-specific. It is also possible that Persistence is not uniquely associated with the BAS or with the BIS, but depends on the combination of both.
This study has several strengths, such as the use of a large community sample of adolescents and the inclusion of both the BIS/BAS Scales and the SPSRQ. However, several weaknesses have to be noted as well. The distribution of educational level in the study sample differed from the Flemish adolescent population (i.e., 40% general education; 31% technical education and 25% vocational education, “Vlaams Onderwijs in Cijfers,” 2014–2015) as indicated by the high and low number of adolescents in general education and vocational education, respectively. Future research should replicate the current study in a representative sample. It is further unsure to what extent people are able to report on BIS and BAS sensitivities themselves (e.g., Smillie et al., 2006). Further research is needed to clarify this issue and may show the necessity to develop behavioural measures of BIS and BAS. This is important given the various domains in which BIS and BAS sensitivity plays a role in adolescence, such as risk taking behaviour (e.g., Romer & Hennessy, 2007) and eating disorders (e.g., Matton et al., 2013, 2015). Furthermore, both the BIS/BAS Scales and the SPSRQ are based on the original RST. Future research should incorporate the adaptations of the revised RST to achieve a more specific distinction between motivated behaviours (Heym et al., 2008; Smillie et al., 2006).
In conclusion, the present results indicate some psychometric problems in the full item sets of BIS/BAS Scales and SPSRQ. Moreover, the results show that the use of a two-factor model to analyze data gathered with the modified BIS/BAS Scales (reduced to 14 items) or modified SPSRQ (reduced to 36 items) is more appropriate, although there is still room for improvement. Based on the internal consistencies and convergent validity of the 14-item BIS/BAS Scales and the 36-item SPSRQ in the current study, both modified questionnaires are considered valid and reliable indices of BIS and BAS sensitivity in Flemish adolescents. For future research in Flemish adolescents, we strongly recommend to use the questionnaires without the malfunctioning items.
The additional files for this article can be found as follows:
This research was funded by the Research Foundation Flanders (FWO).
The authors have no competing interests to declare.
Asparouhov, T. and Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal 16(3): 397–438, DOI: https://doi.org/10.1080/10705510903008204
Carver, C. S. and White, T. L. (1994). Behavioral Inhibition, Behavioral Activation, and affective responses to impending reward and punishment – The BIS BAS scales. Journal of Personality and Social Psychology 67(2): 319–333, DOI: https://doi.org/10.1037/0022-3522.214.171.1249
Chen, F., Curran, P. J., Bollen, K. A., Kirby, J. and Paxton, P. (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods & Research 36(4): 462–494, DOI: https://doi.org/10.1177/0049124108314720
Cloninger, C. R. (1987). A systematic method for clinical description and classification of personality variants: A proposal. Archives of general psychiatry 44(6): 573–588, DOI: https://doi.org/10.1001/archpsyc.1987.01800180093014
Cloninger, C. R., Svrakic, D. M. and Przybeck, T. R. (1993). A psychobiological model of temperament and character. Archives of general psychiatry 50(12): 975–990, DOI: https://doi.org/10.1001/archpsyc.1993.01820240059008
Cogswell, A., Alloy, L. B., van Dulmen, M. H. and Fresco, D. M. (2006). A psychometric evaluation of behavioral inhibition and approach self-report measures. Personality and Individual Differences 40(8): 1649–1658, DOI: https://doi.org/10.1016/j.paid.2005.12.008
Cooper, A., Gomez, R. and Aucote, H. (2007). The behavioural inhibition system and behavioural approach system (BIS/BAS) scales: Measurement and structural invariance across adults and adolescents. Personality and Individual Differences 43(2): 295–305, DOI: https://doi.org/10.1016/j.paid.2006.11.023
Corr, P. J. (2001). Testing problems in JA Gray’s personality theory: a commentary on Matthews and Gilliland (1999). Personality and Individual Differences 30(2): 333–352, DOI: https://doi.org/10.1016/S0191-8869(00)00028-3
Corr, P. J. (2004). Reinforcement sensitivity theory and personality. Neuroscience & Biobehavioral Reviews 28(3): 317–332, DOI: https://doi.org/10.1016/j.neubiorev.2004.01.005
Delgado-Rico, E., Río-Valle, J. S., González-Jiménez, E., Campoy, C. and Verdejo-García, A. (2012). BMI Predicts Emotion-Driven Impulsivity and Cognitive Inflexibility in Adolescents With Excess Weight. Obesity 20(8): 1604–1610, DOI: https://doi.org/10.1038/oby.2012.47
Franken, I. H., Muris, P. and Rassin, E. (2005). Psychometric properties of the Dutch BIS/BAS scales. Journal of Psychopathology and Behavioral Assessment 27(1): 25–30, DOI: https://doi.org/10.1007/s10862-005-3262-2
Galván, A. (2013). The Teenage Brain Sensitivity to Rewards. Current directions in psychological science 22(2): 88–93, DOI: https://doi.org/10.1177/0963721413480859
Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual review of psychology 60: 549–576, DOI: https://doi.org/10.1146/annurev.psych.58.110405.085530
Gray, J. A. (1987). The psychology of fear and stress. 2nd ed Cambridge: Cambridge University Press, DOI: https://doi.org/10.1016/0005-7967(70)90069-0
Harrison, A., O’Brien, N., Lopez, C. and Treasure, J. (2010). Sensitivity to reward and punishment in eating disorders. Psychiatry research 177(1): 1–11, DOI: https://doi.org/10.1016/j.psychres.2009.06.010
Harrison, A., Treasure, J. and Smillie, L. D. (2011). Approach and avoidance motivation in eating disorders. Psychiatry research 188(3): 396–401, DOI: https://doi.org/10.1016/j.psychres.2011.04.022
Heene, M., Hilbert, S., Draxler, C., Ziegler, M. and Bühner, M. (2011). Masking misfit in confirmatory factor analysis by increasing unique variances: a cautionary note on the usefulness of cutoff values of fit indices. Psychological methods 16(3): 319.DOI: https://doi.org/10.1037/a0024917
Heubeck, B. G., Wilkinson, R. B. and Cologon, J. (1998). A second look at Carver and White’s (1994) BIS/BAS scales. Personality and Individual Differences 25(4): 785–800, DOI: https://doi.org/10.1016/S0191-8869(98)00124-X
Heym, N., Ferguson, E. and Lawrence, C. (2008). An evaluation of the relationship between Gray’s revised RST and Eysenck’s PEN: Distinguishing BIS and FFFS in Carver and White’s BIS/BAS scales. Personality and Individual Differences 45(8): 709–715, DOI: https://doi.org/10.1016/j.paid.2008.07.013
Heym, N., Kantini, E., Checkley, H. L. and Cassaday, H. J. (2015). Gray’s revised Reinforcement Sensitivity Theory in relation to Attention-Deficit/Hyperactivity and Tourette-like behaviors in the general population. Personality and Individual Differences 78: 24–28, DOI: https://doi.org/10.1016/j.paid.2015.01.012
Hu, L. T. and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal 6(1): 1–55, DOI: https://doi.org/10.1080/10705519909540118
Jones, S. H., Tai, S., Evershed, K., Knowles, R. and Bentall, R. (2006). Early detection of bipolar disorder: a pilot familial high-risk study of parents with bipolar disorder and their adolescent children. Bipolar disorders 8(4): 362–372, DOI: https://doi.org/10.1111/j.1399-5618.2006.00329.x
Jorm, A. F., Christensen, H., Henderson, A. S., Jacomb, P. A., Korten, A. E. and Rodgers, B. (1998). Using the BIS/BAS scales to measure behavioural inhibition and behavioural activation: Factor structure, validity and norms in a large community sample. Personality and Individual Differences 26(1): 49–58, DOI: https://doi.org/10.1016/S0191-8869(98)00143-3
Knyazev, G. G., Slobodskaya, H. R. and Wilson, G. D. (2004). Comparison of the construct validity of the Gray–Wilson personality questionnaire and the BIS/BAS scales. Personality and Individual Differences 37(8): 1565–1582, DOI: https://doi.org/10.1016/j.paid.2004.02.013
Ko, C.-H., Yen, J.-Y., Yen, C.-F., Chen, C.-S., Weng, C.-C. and Chen, C.-C. (2008). The association between Internet addiction and problematic alcohol use in adolescents: the problem behavior model. CyberPsychology & Behavior 11(5): 571–576, DOI: https://doi.org/10.1089/cpb.2007.0199
Little, R. J. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association 83(404): 1198–1202, DOI: https://doi.org/10.1080/01621459.1988.10478722
Loxton, N. J. and Dawe, S. (2001). Alcohol abuse and dysfunctional eating in adolescent girls: The influence of individual differences in sensitivity to reward and punishment. International Journal of Eating Disorders 29(4): 455–462, DOI: https://doi.org/10.1002/eat.1042
Luman, M., van Meel, C. S., Oosterlaan, J. and Geurts, H. M. (2012). Reward and punishment sensitivity in children with ADHD: validating the sensitivity to punishment and sensitivity to reward questionnaire for children (SPSRQ-C). Journal of abnormal child psychology 40(1): 145–157, DOI: https://doi.org/10.1007/s10802-011-9547-x
Mardaga, S. and Hansenne, M. (2007). Relationships between Cloninger’s biosocial model of personality and the behavioral inhibition/approach systems (BIS/BAS). Personality and Individual Differences 42(4): 715–722, DOI: https://doi.org/10.1016/j.paid.2006.08.013
Marsh, H. W., Morin, A. J., Parker, P. D. and Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology 10: 85–110, DOI: https://doi.org/10.1146/annurev-clinpsy-032813-153700
Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. and Trautwein, U. (2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. Structural Equation Modeling: A Multidisciplinary Journal 16(3): 439–476, DOI: https://doi.org/10.1080/10705510903008220
Matthews, G. and Gilliland, K. (1999). The personality theories of HJ Eysenck and JA Gray: A comparative review. Personality and Individual Differences 26(4): 583–626, DOI: https://doi.org/10.1016/S0191-8869(98)00158-5
Matton, A., Goossens, L., Braet, C. and Vervaet, M. (2013). Punishment and reward sensitivity: are naturally occurring clusters in these traits related to eating and weight problems in adolescents?. European Eating Disorders Review 21(3): 184–194, DOI: https://doi.org/10.1002/erv.2226
Matton, A., Goossens, L., Vervaet, M. and Braet, C. (2015). Temperamental differences between adolescents and young adults with or without an eating disorder. Comprehensive Psychiatry 56: 229–238, DOI: https://doi.org/10.1016/j.comppsych.2014.09.005
Moreno-López, L., Soriano-Mas, C., Delgado-Rico, E., Rio-Valle, J. S. and Verdejo-García, A. (2012). Brain structural correlates of reward sensitivity and impulsivity in adolescents with normal and excess weight. PloS one 7(11): e49185.DOI: https://doi.org/10.1371/journal.pone.0049185
Muris, P., Meesters, C., de Kanter, E. and Timmerman, P. E. (2005). Behavioural inhibition and behavioural activation system scales for children: relationships with Eysenck’s personality traits and psychopathological symptoms. Personality and Individual Differences 38(4): 831–841, DOI: https://doi.org/10.1016/j.paid.2003.06.007
Pickering, A. D. (1997). The conceptual nervous system and personality: From Pavlov to neural networks. European Psychologist 2(2): 139–163, DOI: https://doi.org/10.1027/1016-9040.2.2.139
Romer, D. and Hennessy, M. (2007). A biosocial-affect model of adolescent sensation seeking: The role of affect evaluation and peer-group influence in adolescent drug use. Prevention Science 8(2): 89–101, DOI: https://doi.org/10.1007/s11121-007-0064-7
Smillie, L. D., Pickering, A. D. and Jackson, C. J. (2006). The new reinforcement sensitivity theory: Implications for personality measurement. Personality and Social Psychology Review 10(4): 320–335, DOI: https://doi.org/10.1207/s15327957pspr1004_3
Soler, J. Vega, D. Elices, M. Feliu-Soler, A. Soto, À. Martín-Blanco, A. Pascual, J. C. et al. (2014). Testing the reinforcement sensitivity theory in borderline personality disorder compared with major depression and healthy controls. Personality and Individual Differences 61: 43–46, DOI: https://doi.org/10.1016/j.paid.2014.01.005
Torrubia, R., Avila, C., Molto, J. and Caseras, X. (2001). The Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) as a measure of Gray’s anxiety and impulsivity dimensions. Personality and Individual Differences 31(6): 837–862, DOI: https://doi.org/10.1016/S0191-8869(00)00183-5
Verbeken, S. (2009). Dutch 44-item Version of the Sensitivity to Punishment and Sensitivity to Reward Questionnaire for Children and Adolescents [Instrument]. Ghent University, Department of Developmental, Personality and Social Psychology.
Verdejo-García, A. Pérez-Expósito, M. Schmidt-Río-Valle, J. Fernández-Serrano, M. J. Cruz, F. Pérez-García, M. Marcos, A. et al. (2010). Selective alterations within executive functions in adolescents with excess weight. Obesity 18(8): 1572–1578, DOI: https://doi.org/10.1038/oby.2009.475
Vervoort, L., Wolters, L. H., Hogendoorn, S. M., De Haan, E., Boer, F. and Prins, P. J. (2010). Sensitivity of Gray’s behavioral inhibition system in clinically anxious and non-anxious children and adolescents. Personality and Individual Differences 48(5): 629–633, DOI: https://doi.org/10.1016/j.paid.2009.12.021
Vlaams Onderwijs in Cijfers (2014–2015). From onderwijs.vlaanderen.be/onderwijsstatistieken.
Wiesner, M. and Schanding, G. T. (2013). Exploratory structural equation modeling, bifactor models, and standard confirmatory factor analysis models: Application to the BASC-2 behavioral and emotional screening system teacher form. Journal of school psychology 51(6): 751–763, DOI: https://doi.org/10.1016/j.jsp.2013.09.001
Yu, R., Branje, S. J., Keijsers, L. and Meeus, W. H. (2011). Psychometric characteristics of Carver and White’s BIS/BAS scales in Dutch adolescents and their mothers. Journal of personality assessment 93(5): 500–507, DOI: https://doi.org/10.1080/00223891.2011.595745