Gender Prediction in English-Hindi Code-Mixed Social Media Content: Corpus and Baseline System

Authors

  • Ankush Khandelwal Language Technologies Research Centre, International Institute of Information Technology, Hyderabad
  • Sahil Swami Language Technologies Research Centre, International Institute of Information Technology, Hyderabad
  • Syed Sarfaraz Akhtar Language Technologies Research Centre, International Institute of Information Technology, Hyderabad
  • Manish Shrivastava Language Technologies Research Centre, International Institute of Information Technology, Hyderabad

DOI:

https://doi.org/10.13053/cys-22-4-3061

Keywords:

Author profiling, code-mixing, language detection, linguistics, SVM, random forest

Abstract

The rapid expansion in the usage of social media networking sites leads to a huge amountof un processed user generated data which can beused for text mining. Author profiling is the problem of automatically determining profiling aspects like the author’s gender and age group through a text is gaining much popularity in computational linguistics. Most of the past research in author profiling is concentrated on English texts. However many users often change the language while posting on social media which is called code-mixing, and it develops some challenges in the field of text classification and author profiling like variations in spelling, non-grammatical structure and transliteration. There are very few English-Hindicode-mixed an notated datasets of social media content present online. In this paper, we analyze the task of author’s gender prediction in code-mixed content and present a corpus of English-Hindi texts collected from Twitter which is annotated with author’s gender. We also explore language identification of every word in this corpus. We present a supervised classification baseline system which uses various machine learning algorithms to identify the gender of an author using a text, based on character and word level features.

Downloads

Published

2018-12-30

Issue

Vol. 22 No. 4 (2018): Topic Trends in Computing Research (Guest Editors: A. Aguilar-Meléndez, E. Moya-Sánchez)

Section

Articles of the Thematic Section

License 

Hereby I transfer exclusively to the Journal "Computación y 
Sistemas", published by the Computing Research Center (CIC-IPN),
the Copyright of the aforementioned paper. I also accept that these 
rights will not be transferred to any other publication, in any other 
format, language or other existing means of developing.
I certify that the paper has not been previously disclosed or simultaneo
usly submitted to any other publication, and that it does not contain 
material whose publication would violate the Copyright or other 
proprietary rights of any person, company or institution. I certify that 
I have the permission from the institution or company where I work or 
study to publish this work.
The representative author accepts the responsibility for the publication
of this paper on behalf of each and every one of the authors. 
This transfer is subject to the following conditions:
  • The authors retain all ownership rights (such as patent rights) of this work, except for the publishing rights transferred to the CIC, through this document.
  • Authors retain the right to publish the work in whole or in part in any book they are the authors or publishers. They can also make use of this work in conferences, courses, personal web pages, and so on.
  • Authors may include working as part of his thesis, for non-profit distribution only.