Research paper
Detecting depression stigma on social media: A linguistic analysis

https://doi.org/10.1016/j.jad.2018.02.087Get rights and content

Highlights

  • This study reveals the ways in which depression stigma presents on social media.

  • Linguistic analysis can be helpful to detect depression stigma on social media.

  • 6.09% of relevant social media posts reflected depression stigma.

  • The accuracy of online detection of stigma reached 75.2% and 86.2% (F-Measure).

Abstract

Background

Efficient detection of depression stigma in mass media is important for designing effective stigma reduction strategies. Using linguistic analysis methods, this paper aims to build computational models for detecting stigma expressions in Chinese social media posts (Sina Weibo).

Methods

A total of 15,879 Weibo posts with keywords were collected and analyzed. First, a content analysis was conducted on all 15,879 posts to determine whether each of them reflected depression stigma or not. Second, using four algorithms (Simple Logistic Regression, Multilayer Perceptron Neural Networks, Support Vector Machine, and Random Forest), two groups of classification models were built based on selected linguistic features; one for differentiating between posts with and without depression stigma, and one for differentiating among posts with three specific types of depression stigma.

Results

First, 967 of 15,879 posts (6.09%) indicated depression stigma. 39.30%, 15.82%, and 14.99% of them endorsed the stigmatizing view that “People with depression are unpredictable”, “Depression is a sign of personal weakness”, and “Depression is not a real medical illness”, respectively. Second, the highest F-Measure value for differentiating between stigma and non-stigma reached 75.2%. The highest F-Measure value for differentiating among three specific types of stigma reached 86.2%.

Limitations

Due to the limited and imbalanced dataset of Chinese Weibo posts, the findings of this study might have limited generalizability.

Conclusions

This paper confirms that incorporating linguistic analysis methods into online detection of stigma can be beneficial to improve the performance of stigma reduction programs.

Introduction

Depression is a common and serious mental disorder that affects people negatively. According to a report of the WHO, in 2015, the proportion of the global population with depression is estimated to be 4.4% (World Health Organization, 2017). Getting professional treatment can be helpful for most people with depression (Wang et al., 2003). However, the existence of stigma associated with depression hinders help-seeking behaviors and delays treatment of mental illness (Barney et al., 2006, Schomerus et al., 2009). Therefore, lowering depression stigma would improve mental health outcomes.

Stigma reduction campaigns work best when targeted. Information distributed through mass media is an important contributor to the dissemination of mental-health-related material that may increase stigma (Corrigan et al., 2005, Dietrich et al., 2006, Morgan and Jorm, 2009, McGinty et al., 2014, Niederkrotenthaler et al., 2014, Koike et al., 2015, Maiorano et al., 2017). If the characteristics of such stigma information can be understood, it may be possible to design interventions that counter its negative influence. However, the majority of previous studies investigating the impact of media coverage of mental illness mainly focused on traditional media platforms (e.g. newspapers and TV programs), with relatively little attention paid to new media platforms (i.e. social media). Recently, a few studies used of social media data to monitor mental-illness-related stigma information, including depression stigma information (Fu et al., 2013, Reavley and Pilkington, 2014, Li et al., 2015). These studies employed human coders to manually process potential stigma information, and established a series of schemes for coding stigma information on social media, which may provide us an evaluation method to determine whether a piece of social media post reflects mental-illness-related stigma or not. However, the sheer volume of social media data makes it difficult to identify stigma information by human coders. Therefore, there is a dire need for automatic detection of stigma, which may give us an efficient way to target stigma information automatically among massive information or at least minimize the information searching scope quickly. However, computational methods for detecting depression stigma have not yet been established.

The words that people use in their language expressions can provide clues into their psychological processes (Pennebaker et al., 2003). Evidence confirms that health-related stigma, including mental-health-related stigma, can be conveyed through different patterns of language use (Anthony et al., 2008, Downie and Black, 2010, Puhl et al., 2013, Slebioda, 2013). This suggests that incorporating linguistic analysis methods into online detection of stigma may improve our ability to screen for depression stigma information automatically on social media.

By analyzing Chinese language expressions in Sina Weibo posts, a famous microblogging service in China, this study aims to build computational models for detecting depression stigma information on social media.

Section snippets

Methods

In this study, a three-step procedure was followed: (1) data collection, (2) data pre-processing, and (3) data modeling.

The methods and procedures applied in this study were approved by the Institutional Review Board of the Institute of Psychology, Chinese Academy of Sciences. Participant consent was not obtained, as it is not required for analyzing publicly available data (Reavley and Pilkington, 2014, O’Dea et al., 2015, Li et al., 2015). Specifically, in this study, we only downloaded and

Coding

Table 1 showed the results of coding task. The Cohen's κ coefficients for stigma and its subcategories were 0.89 and 0.74, respectively, reflecting a substantial to almost perfect level of agreement (Landis and Koch, 1977). A total of 967 / 15,879 Weibo posts (6.09%) were coded as indicating depression stigma (male: 311 posts; female: 605 posts; not specified: 51 posts). 39.30% of them (380 posts) reflected the view that “People with depression are unpredictable” (unpredictability stigma),

Discussion

This study investigated the ways in which depression stigma presents on social media. Results of this study confirmed that incorporating linguistic analysis methods into online detection of stigma can be beneficial to improve the performance of stigma reduction programs.

First, social media data can be used to monitor users’ stigmatizing attitudes towards mental illness. In this study, two human coders were recruited to perform content analysis on Weibo posts with keywords. Results showed that

Funding information and role of the funding source

This work was supported by the National Basic Research Program of China (grant number 2014CB744600) and the Fundamental Research Funds for the Central Universities (grant numbers 2016ZCQ11, BLX2015-42). The funder has played no role in the research.

References (37)

  • A. Ahmad et al.

    A feature selection technique for classificatory analysis

    Pattern Recognit. Lett.

    (2005)
  • B. O’Dea et al.

    Detecting suicidality on Twitter

    Internet Interv.

    (2015)
  • J. Wang et al.

    Gender specific correlates of stigma toward depression in a Canadian general population sample

    J. Affect. Disord.

    (2007)
  • S. Anthony et al.

    Stigmatization of repetitive hand use in newspaper reports of hand illness

    Hand

    (2008)
  • L.J. Barney et al.

    Stigma about depression and its impact on help-seeking intentions

    Aust. N.Z. J. Psychiatry

    (2006)
  • China Internet Network Information Center

    Statistical report on internet development in China (January 2017)

    China Internet Netw. Inf. Cent.

    (2017)
  • T.M. Cook et al.

    Descriptive epidemiology of stigma against depression in a general population sample in Alberta

    BMC Psychiatry

    (2010)
  • P.W. Corrigan et al.

    Newspaper stories as measures of structural stigma

    Psychiatr. Serv.

    (2005)
  • A. Decter-Frain et al.

    Impressive words: linguistic predictors of public approval of the U.S. congress

    Front. Psychol.

    (2016)
  • S. Dietrich et al.

    Influence of newspaper reporting on adolescents' attitudes toward people with mental illness

    Social. Psychiatry Psychiatr. Epidemiol.

    (2006)
  • J. Downie et al.

    Watch your language: a review of the use of stigmatizing language by Canadian judges

    J. Ethics Ment. Health

    (2010)
  • K. Fu et al.

    Responses to a self-presented suicide attempt in social media: a social network analysis

    Crisis

    (2013)
  • A.T. Gong et al.

    Mental health literacy: public knowledge and beliefs about mental disorders in mainland China

    PsyCh J.

    (2014)
  • K.M. Griffiths et al.

    Effect of web-based depression literacy and cognitive-behavioural therapy interventions on stigmatising attitudes to depression: randomised controlled trial

    Br. J. Psychiatry

    (2004)
  • K.M. Griffiths et al.

    Stigma in response to mental disorders: a comparison of Australia and Japan

    BMC Psychiatry

    (2006)
  • L. Guan et al.

    Identifying Chinese microblog users with high suicide probability using internet-based profile and linguistic features: classification model

    JMIR Ment. Health

    (2015)
  • Jiang, K., Gupta, R., Gupta, M., Calix, R.A., Bernard, G.R., 2017. Identifying personal health experience Tweets with...
  • S. Koike et al.

    Effect of name change of schizophrenia on mass media between 1985 and 2013 in Japan: a text data mining analysis

    Schizophr. Bull.

    (2015)
  • Cited by (60)

    • Exploring the potential of delivering mental health care services using digital technologies in Bangladesh: A qualitative analysis

      2022, Internet Interventions
      Citation Excerpt :

      Our findings also infer that misinformation and stigmas spread by social media can negatively impact MH and healthcare-seeking behavior among service users. MH is already a stigmatized issue, and misleading information on social media can build on these stigmas (Li et al., 2018). Stigmatized individuals may feel devalued by, and discriminated from others, leading them to adopt harmful coping mechanisms such as secrecy or withdrawal from health care (Hasan, 2020; Moses, 2009; Mascayano et al., 2015).

    • Exploring Stigma Towards People with Schizophrenia in Mass Media and Their Private Discourses

      2022, Revista Colombiana de Psiquiatria
      Citation Excerpt :

      Also, it would be interesting to compare the labels used among other clinical populations (e.g., depression, HIV, borderline personality disorder). This type of research already has precedents at the international level, but mainly focused on how the rest of the population expresses different diagnoses.24-26 Our team proposes complementing this type of research with people's discourses in the mass media.

    • Revealing traces of depression through personal statements analysis in social media

      2022, Artificial Intelligence in Medicine
      Citation Excerpt :

      All of them have tried to identify causes, symptoms and, of course, how to correctly diagnose a patient having depression. In such a way, user-generated content in social media has become an interesting subject of study of depression-related topics [28,29]. It has been proven that social media data capture aspects related to the mental and emotional condition of people [30].

    View all citing articles on Scopus
    View full text