Detection of Depression Using Depression Indicators
DOI:
https://doi.org/10.13053/cys-29-1-5537Keywords:
Depression detection, BERT, PHQ-9Abstract
This article addresses Task ”2a” of the MentalRiskES 2023 competition, which focuses on detecting depression in Telegram texts. The approach involves creating eight specialized corpora based on the PHQ-9 questionnaire to fine-tune pre-trained BERT models for identifying signs of depression in messages. Each corpus is designed to represent the different indicators of the PHQ-9 questionnaire, using three classes: positive (texts that reflect an indicator), negative (texts opposing the indicator), and neutral (texts unrelated to the indicator). These classes allow for the creation of clear and representative examples of texts associated with each indicator. The pre-trained BERT models, specialized for each indicator, evaluate the texts of each Telegram user to generate a vector that will feed into a multilayer perceptron (MLP) neural network for final classification. The results achieved a macro-F1 score of 0.77 with proposed model Ind-bert-base-spanish, surpassing the best result in the competition by 5 %. This performance highlights the effectiveness of combining advanced natural language processing techniques, such as BERT models and MLP networks, to address mental health challenges in digital communication.Downloads
Published
2025-03-24
Issue
Section
Articles of the Thematic Section (2)
License
Hereby I transfer exclusively to the Journal "Computación y Sistemas", published by the Computing Research Center (CIC-IPN),the Copyright of the aforementioned paper. I also accept that these
rights will not be transferred to any other publication, in any other format, language or other existing means of developing.I certify that the paper has not been previously disclosed or simultaneously submitted to any other publication, and that it does not contain material whose publication would violate the Copyright or other proprietary rights of any person, company or institution. I certify that I have the permission from the institution or company where I work or study to publish this work.The representative author accepts the responsibility for the publicationof this paper on behalf of each and every one of the authors.
This transfer is subject to the following conditions:- The authors retain all ownership rights (such as patent rights) of this work, except for the publishing rights transferred to the CIC, through this document.
- Authors retain the right to publish the work in whole or in part in any book they are the authors or publishers. They can also make use of this work in conferences, courses, personal web pages, and so on.
- Authors may include working as part of his thesis, for non-profit distribution only.