1. Introduction
Common mental problems (i.e. anxiety and depression) are major factors in sickness and absence from work,1–4 and in gaining employment,5 with the obvious negative outcomes the for employee, employer, and the economy due to lost productivity. Lim et al.6 evaluated the consequences of different types of mental health problems on workplace productivity and found the greatest work impairment was due to anxiety and affective disorders. Reducing the presence and severity of common mental problems is a goal for both society and business. However, levels of disclosure and levels of help-seeking are remarkably low given their high prevalence7–9 and mental health issues are far less likely to be reported than physical health conditions.10 The most common reason given for this lack of help-seeking relates to stigmatic beliefs about mental health problems and the fear of possible discrimination if an individual were to disclose their own mental health problems.11,12 In turn, mental health stigma is then related to poor mental health.13
1.1. Mental Health Stigma
Stigmatic beliefs about mental health problems take various forms. “Stigma to Others” is what a person thinks about other people who have mental health difficulties. When measured at the population level this is often called “public stigma”.14 Eisenberg, Downs, Golberstein, and Zivin15 showed that high levels of Stigma to Others were related to low levels of help-seeking in students. However, the meta-analysis of Clement et al.16 failed to find a consistent association between stigma to others and help-seeking behaviour.
“Social Distance” covers the affective component of beliefs (see Fox, Earnshaw, Taverna, & Vogt17) and is defined by a willingness to interact with people with a mental health problem.18 Schomerus, Matschinger, and Angermeyer19 have demonstrated that an increased level of personal desire for social distance is associated with a decreased willingness to seek psychiatric help in a large sample of the German general population.
“Anticipated stigma” is the belief that other people will discriminate against you if you have a mental health problem20 and is also referred to as “perceived public stigma”.21 Clement et al.16 identified two studies and found no relationship between anticipated stigma and help-seeking behavior. Fox, Smith, and Vogt22 found that anticipated stigma had a significant effect on levels of absenteeism. However, Fox et al. conducted their research within a sample of U.S. veterans and, consequently, their results may not be generalisable to other populations with less severe mental health difficulties. Schomerus et al.19 failed to find an effect of levels of anticipated stigma on willingness to seek psychiatric help.
“Self-stigma” refers to a person’s belief about themselves if they have, or were to have, a mental health problem14 and can be thought of as the internalisation of public stigma.14 Jennings et al.23 found that self-stigma was related to low levels of help-seeking intentions in students, while Conner et al.24 showed similar results for older adults. The meta-analysis of Clement et al.16 examined seven studies on this issue and found overall a “small negative relationship” between self-stigma and help-seeking behavior.
“Avoidant coping” is the deliberate ignoring of problems, or the use of maladaptive coping strategies such as the use or abuse of alcohol or other substances, to block out negative thoughts or emotions.25 Although avoidant coping is not a form of “stigma” it is clearly an important concept in understanding help-seeking behaviour for mental health difficulties, the maintenance of mental health problems, and absenteeism from work. Currently there is little evidence on the relationship between avoidant coping and help-seeking behaviour for mental health problems.26 However, there is evidence that avoidant coping strategies affect absenteeism. For instance, van Rhenen, Schaufeli, van Dijk, and Blonk27 examined over 3,500 employees over a 12-month period and found that an avoidant coping style increased both the frequency and the length of sickness absence.
To define these different concepts of stigma we have presented them separately. We also acknowledge that this list is not exhaustive and alternate views of mental health stigma exist. However, these concepts are highly connected. For instance, Lannin et al.21 have developed that Internalised Stigma Model and showed that anticipated stigma (or perceived public stigma as they refer to the concept) is internalised to self-stigma which in turn is predictive of help-seeking behaviors, particularly through stigma that is associated help-seeking behaviour itself. It was not the aim of this paper to explore these relationships or test the Internalised Stigma model.
1.2. Measures of Mental Health Stigma
While there are several measures of mental health stigma17 there were reasons for the creation of a new measure. First, Wei, McGrath, Hayden, and Kutcher28 noted that few studies reported on the psychometric properties– a position noted earlier by Brohan, Slade, Clement, and Thornicroft29 who also noted many had floor or ceiling effects. Second, most measures look at one specific form of stigma (e.g. stigma to others) or confound the different forms of stigma. None of the existing measures of mental health stigma give separate estimates of stigma to others (in both cognitive and affective forms), anticipated stigma, and self-stigma.
Third, the measures vary with respect to the specificity of the mental disorder.30 Some are designed to measure attitudes to a specific mental disorder (e.g. schizophrenia) while others are for mental health problems as a whole. Fox et al.22 suggested that considering mental health stigma variables more generally results in a better understanding of commonalities of mental health stigma (see also Van Brakel31).
Fourth, some measures were designed for people who have, or have had, a mental health problem. However, all individuals can be affected by mental health difficulties, and placing experience of mental health on a continuum, rather than into two dichotomous categories (i.e. mentally ill vs. mentally well), is related to a reduction in stigmatising beliefs.32 Schibalski et al.33 suggested that considering how individuals with sub-clinical mental disorders identify with stigmatising views can lead to a better understanding of different forms of mental health stigma.
Fifth, measures of stigma may not be answered honestly as individuals may be hesitant to endorse stigmatic beliefs.34 This desire to present oneself positively is known as “positive impression management” or “social desirability bias” and can lead to false or incorrect responses.35 Ensuring anonymity is one way to reduce social desirability bias, but it may be prudent to measure this.35
1.3. The Present Study
The Stigma and Self-Stigma Scale (SASS) was created as a questionnaire that could separately measure these different forms of mental health stigma. It was designed to look at mental health problems in general and was applicable to both those with or without a history of mental health problems. Its principal aim was to have an efficient single measure rather than a range of questionnaires to measure the different concepts (with associated different response formats etc.) in order to evaluate a workplace mental health literacy and stigma reduction programme for the workplace (Prevail – see Gray, Davies & Snowden36). The present study evaluated: (a) its psychometric properties, (b) its relationship to current mental health status, and (2) its relationship to recent absenteeism (due to physical and mental health problems).
2. Method
2.1. Participants
The ***** (****) is a UK government organisation that ********** records. Possible participants were selected by the Human Resources Department to obtain approximately equal numbers across employees across age groups, gender, and history of mental health problems. Over one thousand (N = 1235) individuals were contacted, of which and 377 took part. Data from the first 196 participants were used for development of the measure. The other 181 participants took part in the main study. The study was then advertised across the agency resulting in an additional 147 participants (total N =328; 37.5% male) for the main study. One hundred and thirteen participants repeated the questionnaire approximately four weeks later in order to assess test-retest reliability. Ethics approval was given by the *** University ethical committee. All participants gave written informed consent.
2.2. Materials
2.2.1. Stigma and Self-Stigma Scales (SASS)
This final version of the SASS was developed from an earlier version. For this original version, the items for the scales of Stigma to Others, Self-stigma, and Anticipated Stigma, and Help-Seeking/Disclosure were chosen by the research team after reviewing many previous scales that aimed to measure these concepts. Items were rewritten to be answerable by people both with and without a history of mental health problems. Items were also chosen to produce a scale related to willingness to disclose mental health difficulties and the amount of help-seeking a person would engage within for these problems. Finally, items were added to produce a Social Desirability scale. All items were reviewed by a research team which consisted of a Clinical and Forensic psychologist, a Forensic psychologist, a Human Resources director, and an MSc-by-Research student.
This initial version underwent an exploratory factor analysis using Principle Axis Factoring with Oblimin rotation and Kaiser Normalization with a pilot sample of participants (N = 194). The 10 items from the Social Desirability were not included in this analysis as they are not related to mental health attitudes. The scree plot suggested five factors that explained 43.5% of the variance. Bartlett’s test of sphericity was significant, χ2 (1081) = 4571.62, p < .001. The Kaiser-Meyer Olkin measure verified the sampling adequacy for the analysis, KMO = .88. The five factors were interpretable broadly along the intended lines. Factor 1 contained items from both the Anticipated Stigma and Self-stigma scales. Factor 2 contained items from the Stigma to Others scales, as did Factor 4. These two factors differed in the items loaded onto Factor four appeared to be those relating to “social distance” (see Introduction). Factor 3 contained items from the Help-seeking/disclosure scale. Finally, Factor 5 appeared to contain items which we interpreted as an “avoidant coping” style.
Following this initial analysis, items that did not load onto the correct scales, or showed poor psychometric properties (e.g. floor or ceiling effects) were dropped or reworded. We decided to maintain the distinction between Anticipated Stigma and Self-stigma for theoretical reasons (see Quinn et al.20). Other items were added to bolster the Social Distancing scale and the Avoidant Coping scales.
The final SASS contained of 42 items across the six domains of Stigma to Others, Social Distance, Anticipated Stigma, Self-stigma, Avoidant Coping, and (Lack of) Help-seeking/disclosure with six questions for each domain. The measure also contains six items to examine positive impression management (Social Desirability). Mental health problems were defined at the start of the questionnaire as “a pattern of behaving, thinking, and/or feeling that causes the person significant distress or impairment of personal functioning”.
Participants were asked to indicate if they agreed or disagreed with each of the statements using a 5-point Likert scale ranging from 'strongly disagree, disagree, neither agree nor disagree, agree, strongly agree’ scored from 0 to 4. Some terms were reverse scored to prevent response bias. Each scale had a possible range of 0-24 with higher scores representing greater stigma or problems. The full questionnaire is included in the Supplementary Materials.
2.2.2 Demographics and Work Performance
Participants completed a questionnaire related to demographic information, their history of mental health problems, and any absence from work due to physical or mental health problems. The number of days absent in the past year was assessed separately for both mental and physical problems (see Goetzel et al.37), with options of none, one, two to three, four to ten, eleven to twenty, twenty-one to thirty, or more than thirty. Participants were asked if they had ever given a physical health reason for an absence when the real reason was a mental health problem, and vice versa.
2.2.3 Measures of Mental Health
The Patient Health Questionnaire (PHQ-9) is a 9-item tool that assesses major depression.38 It scores each of the nine items from 0-3. A score of ‘0’ indicates ‘not at all’ and a score of 3 indicates ‘nearly every day.’ In the present study, Cronbach’s α was .91.
The Generalised Anxiety Disorder-7 Item Scale (GAD-7) is a 7-item scale that assesses generalised anxiety disorder39 with the same scoring structure as the PHQ-9. In the present study, Cronbach’s α was .93.
Work and Social Adjustment Scale (WSAS) is a 5-item measure of impairment in functioning.40 Each item is rated from 0 to 8 (0 represents no impairment at all and 8 represents very severe impairment). Items measures participants’ abilities to complete everyday activities, ability to work, home management, social leisure activities, private leisure activities, and close relationships. In the present study, Cronbach’s α was .89.
2.3. Statistical Analyses
The psychometric properties of the SASS were assessed via a Confirmatory Factor Analysis, internal reliability (using both Cronbach’s alpha (α) and coefficient omega: ωu – see Flora41) and test-retest reliability (Spearman rho). The main hypotheses (the relationship between mental health stigma variables, current mental health, and workplace absenteeism) were assessed via zero-order correlations and multiple regression. Spearman rho correlations were chosen to analyse the data for consistency across the analysis (as some of the data were ordinal). Multiple hierarchical linear regressions were chosen to analyse the data even for the ordinal data to prevent a loss of information (see Mircioiu & Atkinson42). In step 1 the demographic variables were entered (including Social Desirability) to account for their ability to predict the dependent variable. In step 2 the SASS scales were entered. Changes in the ability of the model to predict the dependent variable were assessed by changes in R2 and standardised beta (β) to examine the contribution of each scale.
3. Results
Full demographic details are given in Table 1. Around 30% of participants had taken sickness absence for mental health reasons in the past year. Very few participants provided mental health reasons for an absence when it was really a physical health absence (n = 4, 1.2%). However, approximately a third of participants reported giving a physical health reason for an absence when it was really a mental health problem (n = 124, 37.8%).
3.1. Confirmatory Factor Analysis
The six-factor (Stigma to Others, Social Distance, Anticipated Stigma, Self-stigma, Avoidant Coping and Help-seeking/Disclosure) model was examined via confirmatory factor analysis on the data from the 328 participants. The six items from the Social Desirability scale were not included in this analysis. As the data is ordinal, a confirmatory factor analysis using a diagonally weighted least squares (DWLS) estimator to determine whether the factor structure was used as recommended by Lavaan package version 0.5-22.43
The model resulted in an excellent fit (χ² (df= 579) = 881.43, CFI = .97, TLI= .97, and RMSEA =.041) as the Comparative Fit Index (CFI), and Tucker Lewis Index (TLI) were both above the recommended value of .90. Each item loaded significantly on its respective latent factor and all specified covariances were significantly different from zero (see Table 2).
3.2. Psychometric Properties of SASS
The psychometric properties of the SASS are given in Table 3. Most of the scales achieved scores in the mid–range of 0- 24 and had acceptable levels of skewness and kurtosis. The exception was the Stigma to Others scale which had a low mean score and a restricted range. Internal consistencies were good for most scales (assessed by either Chronbach’s α or the coefficient omega: ωu). However, the Avoidant Coping scale did not achieve an acceptable level of internal consistency. All the scales had good levels of test-retest reliability.
There was no significant difference in scale scores due to gender. Most of the scales were also unaffected by age, however, there was a small effect where Stigma to Others was greater for the older participants. The older participants also showed greater levels of Social Desirability.
3.3. SASS and Recent Mental Health Problems
The SASS scales gave consistent results across the three measures of mental health– see Table 4. Anticipated Stigma, Self-Stigma (medium effect sizes) and Avoidant Coping (small effect sizes) were positively correlated with mental health problems. Stigma to Others and Social Distance were not correlated with mental health problems (with some hint that Stigma to Others may be negatively related). Lack of Help-Seeking was positively correlated with mental health problems (small effect size).
As the three mental health problem scales were highly correlated (PHQ-9 and GAD-7 = .87; PHQ-9 and WSAS = .75; GAD-7 and WSAS = .70), the regression results are presented only for the PHQ-9 scale, however, the pattern of results was highly similar across all scales. The stage 1 model was not significant (R2 = .02, F(3, 318) = 2.38, p = .07). The addition of the SASS scales produced a significant increase in the model’s fit (∆R2 = 0.21, F(3, 314) = 18.33, p < .001). Both Self-stigma and Avoidant Coping were positively predictive of mental health problems (medium effects sizes), whereas Stigma to Others was negatively predictive of mental health problems (small effect size).
3.4. SASS and Absenteeism
Table 5 gives the correlations between the scales of the SASS and recent absenteeism. Anticipated Stigma was positively correlated with all forms of absenteeism (small effect sizes). Stigma to Others was negatively correlated with general absenteeism and with absenteeism due to mental health reasons (small effect sizes).
To clarify the unique role of each SASS scale a hierarchical regression was performed but using the Anticipated Stigma scale rather than the Self-stigma scale due to the former’s greater zero-order correlation with absenteeism. As the three measures of absenteeism were highly correlated, and our previous finding that the reasons given for a mental health absence were often recorded as a physical absence, we present data from the analysis of all absenteeism. The stage 1 model was not significant (R2 = .01, F(3, 317) = 1.20, p = .31). However, the addition of the SASS scales produced a significant increase in the model’s fit (∆R2 = .06, F(3, 313) = 4.99, p = .001). Inspection of the beta weights showed that both Anticipated Stigma and Avoidant Coping were positively predictive of absenteeism (small effect sizes), whereas Stigma to Others was negatively predictive (small effect size).
4. Discussion
4.1. Psychometric Properties of SASS
The SASS scales had good psychometric properties with some minor exceptions. Avoidant Coping had an unacceptable level of internal consistency (i.e. low correlations amongst the items). Examination of the items in this scale did not reveal that any one item was responsible for this low internal consistency, though the items due to use of alcohol and drugs had the lowest loadings. Further development of this scale is warranted to increase its internal consistency due to the scale’s clear ability to predict important aspects of help-seeking behaviour, severity of mental health problems, and levels of absenteeism, despite this lack of internal consistency.
The other weakness identified in psychometric properties was the low mean score and truncated range of the Stigma to Others scale. The questions used for this scale were adapted from similar scales (e.g. King et al.44; Subramaniam et al.18) where higher levels of stigma have been found. Thus, these differences in results may simply reflect differences in the samples due to culture, education, income, and exposure to people who experience mental health problems.18
4.2. Anticipated Stigma and Self-Stigma
We hypothesised that both Anticipated Stigma and Self-stigma would be related to both outcomes (i.e. current mental health problems, and absenteeism). Both hypotheses were supported. These effects were among the strongest of the SASS measures and therefore point to a strategy of targeting these form(s) of mental health stigma in any programme that hopes to produce improvement in behaviours associated with mental health and absenteeism.45
4.3. Stigma to Others and Social Distance
Both these scales concern stigma towards people with mental health problems and so are discussed together. The two scales are correlated (ρ = .44) and produced broadly similar results. Stigma to Others was negatively related to absenteeism. It may be that people with no current mental health problems hold more stigmatic attitudes to those with problems and are less likely to be absent from work. These results, overall, suggest that mental health intervention programmes that target stigma to others may not produce changes in absenteeism. Intervention programmes need to target other forms of stigma.
4.4. Avoidant Coping
As hypothesised, Avoidant Coping scale was associated with poor mental health and greater absenteeism. Hence, avoidant coping strategies should be targeted by intervention programmes that aim to improve people’s help-seeking behaviour for mental health problems and improve rates of absenteeism from work.
4.5. Limitations
The major limitation of this study is the reliance on self-report for each of the measures used. However, some of the issues seem only accessible via self-report (e.g. a person’s attitudes about their own mental health problems), and issues of anonymity precluded our ability to look at how these individual attitudes were related to actual behavior.
Help-seeking intentions were measured rather than actual help-seeking behaviors. This raises the question whether help-seeking intentions are a good proxy measure for help-seeking behavior. Recent research supports the notion that beliefs of one’s help-seeking intentions are a good proxy for actual help-seeking behavior.45
Current mental health difficulties were measured using well-established questionnaires for the two most common mental disorders of depression and anxiety (PHQ-9 and GAD-7). These measures have established strong associations with actual mental health as diagnosed via clinician diagnoses.38,39 The study also used the WSAS that allows for an evaluation of the impact of mental health symptoms on level of functioning. The WSAS also incorporates variables that are specific to functioning in the workplace, and thus was the most appropriate measure of the impact of symptoms of mental health in the workplace.
We measured absenteeism through participants’ self-report. While official figures would normally record the reason for an absence, it seems likely that some people may dissimulate this reason, particularly if they hold stigmatic attitudes about mental health problems. In the present study, where responses were completely anonymous, approximately 1/3 of the participants admitted that they had dissimulated the reasons provided for their work absence, with nearly all of these being instances where the person had given a physical health reason for absence whereas the real reason was due to mental health problems. These results are in line with large-scale studies that show that people are more reluctant to report mental health problems in comparison to other health conditions.10 Thus, there are instances where this anonymised self-report method may have advantages over official records. There are also several studies that have addressed the relationship between self-report of absenteeism and official records. Johns and Miraglia46 meta-analysed these studies and suggests that the relationship between self-report and official records is very good in terms of rank-ordering, but people tend to under-report their overall levels of absence. They conclude that self-report data is valid for correlational type designs as used in the present study.
The study was also cross-sectional limiting the ability to draw inferences about causation. Clearly, a longitudinal study is needed to see if mental health attitudes are predictive of future work placed behavior.
Finally, there are some limitations to the sample collected. First, data were only collected from a single organisation that may limit the generalisability of the results. Second, the study was reliant on individuals volunteering to take part in the study. No data were available from those that did not volunteer to take part, so the study was not able to compare individuals that did or did not volunteer. There may be systematic biases between these two groups (e.g. experience of mental health problems), however it is not clear that such differences would affect the pattern of relationships between stigma and mental health reported here.
4.6. Conclusions
The SASS measures multiple aspects of stigmatic beliefs about mental health problems including aspects of stigma towards others (cognitive and emotional stigma), anticipated stigma by others towards the self, self-stigma, avoidant coping strategies and help-seeking intentions, alongside an index of social desirability. The scales of the SASS have good psychometric properties (with some minor exceptions), including good internal reliability and test-retest reliability. The scales also showed validity to key variables such as current mental health and absenteeism from the workplace. The SASS questionnaire, therefore, provides the basis for a more comprehensive examination of mental health stigma and attitudes in the workplace compared to any single measure currently available. It is hoped the SASS will prove useful to monitor changes in mental health attitudes and intervention programmes, or to investigate stigmatic attitudes to mental health problems across different samples, across cultures, and in different types of workplace environment.
Acknowledgments
We are very grateful to the Drivers and Vehicles Licensing Agency (DVLA) for part-funding this research, allowing access to a sample of their employees, and hosting the research student throughout the period of data collection. We are particularly grateful to Shireen Thomas, Rhodri Brad, Amanda Payne, Kirsten Howell, Sophie Hanford, Louise White, Georgia Williams, and Jennifer Davies for all their help, support, patience, and understanding throughout the research process, for completing the veracity checks on the datadatabased for helping us to navigate through all the challenges that the new laws on General Data Protection Regulation (GDPR) and the Data Protection Impact Assessment (DPIA) process brought to us.
Author contribution
The original project proposal was developed by NSG and HBD. AED was responsible for data collection and curation. AED was supervised by NSG and RJS. Data analysis was performed by RJS, AED and NS The original paper was drafted by AED and RJS. All authors contributed to editing and rewrites of the manuscript. All authors approved the final version of the manuscript.
Conflict of Interest
No conflicts of interest are reported for any of the authors.
Funding/Support
This work was supported by a Knowledge Economy Skills Scholarship (KESS-2) studentship for AED. We are also grateful to the Knowledge Economy Skills Scholarship (KESS-2) for providing funding for AD’s Research Masters’s qualification. KESS-2 is a pan-Walehigher-level skills initiative led by Bangor University on behalf of the Higher Education sector in Wales. It is partly-funded by the Welsh Government’s European Social Fund (ESF) convergence program for West Wales and the Valleys. The work was further supported by grant from the Driver and Vehicles Licensing Agency (UK).