logo Idiap Research Institute        
 [BibTeX] [Marc21]
Classifying the Social Media Author Profile Through a Multimodal Representation
Type of publication: Book chapter
Citation: Alvarez-Carmona_SPRINGERNATURESINGAPORE_2022
Booktitle: Intelligent Technologies: Concepts, Applications, and Future Directions. Studies in Computational Intelligence
Series: 7092
Volume: 1028
Year: 2022
Month: May
Publisher: Springer
URL: https://link.springer.com/chap...
DOI: https://doi.org/10.1007/978-981-19-1021-0_3
Abstract: The author profiling task refers to extracting as much of an author through what he writes, such as gender, age, nationality, location, among others. Although this task arose a few decades ago, the explosion in social networks has made the task of author profiling mainly focus on digital media. Typically, previous works have used only the text of the users of social networks to determine specific demographic characteristics. However, due to the nature of social networks, it is possible to have access to another type of information that could be useful. This work faces the author profiling in a social networks domain with text and images information. This kind of information is also called multimodal information. The solution proposed uses an approach to extract data from social media messages and users’ images. The proposal shows evidence of the complementarity of the modalities by merging these two information sources. The idea consists of transforming images into texts and having the same representation framework for both types of information, which allows them to be merged. The work explores distinct approaches to extracting information from text and images. The results show that the text constructed from the images contains helpful information, increasing this task’s precision.
Keywords: Age prediction, Author profiling, Gender prediction, Location prediction, Multimodal classification, Occupation prediction
Projects Idiap
Authors Álvarez-Carmona, Miguel Á.
Villatoro-Tello, Esaú
Pineda, Luis Villaseñor
Montes-y-Gómez, Manuel
Added by: [UNK]
Total mark: 0
Attachments
    Notes