Framework for heterogeneous data management: An application case in a NoSQL environment from a Climatological Center

Authors

  • Alicia Margarita Jiménez-Galina Autonomous University of Ciudad Juarez
  • Aide Aracely Maldonado-Macías Autonomous University of Ciudad Juarez
  • Karla Miroslava Olmos-Sanchez Autonomous University of Ciudad Juarez
  • Israel Hernandez Autonomous University of Ciudad Juarez
  • Fernando Estrada-Saldana Autonomous University of Ciudad Juarez
  • Felipe Adrián Vázquez-Gálvez Autonomous University of Ciudad Juarez

DOI:

https://doi.org/10.13053/cys-28-1-4474

Keywords:

Heterogeneous Data, Homogenization, Action Research

Abstract

Processing, visualizing and understanding data from meteorological networks can present several challenges due to the variety and complexity of the data and must be accessible in real time and in different formats, protocols and standards. This paper presents the development of an innovative technological framework for handling heterogeneous climatological data in a NoSQL environment. The framework was developed following the Action Research methodology and enables the extraction of heterogeneous data, their homogenization, and the creation of a dataset. Its real-case application took place in data repositories used for climatological data management in a specialized regional center in Ciudad Juarez, Mexico. The ´ main repository use MongoDB and contain 631,202 documents with data from several meteorological stations. A 70% reduction in data processing time is evidence that the methodology and framework developed were effective in the case of the application. In addition, the generated data sets are homogenized and in formats compatible with advanced analysis tools.

Author Biography

Aide Aracely Maldonado-Macías, Autonomous University of Ciudad Juarez

Dr. Aide Aracely Maldonado Macías, she completed her Bachelor Degree in Industrial Engineering, the MSc in Industrial Engineering by the Technological Institute of Ciudad Juárez and Ph. D. in Sciences in Industrial Engineering by the same Institute. She is currently a full-time Professor-Investigator at the Autonomous University of Ciudad Juárez (UACJ). Her research interests are the evaluation and ergonomic design, cognitive ergonomics anthropometric studies and work-related stress studies, Multicriteria and Multi-attribute decision-making with fuzzy logic and axiomatic design applications, as well as the ergonomic evaluation for the selection of technology of advanced manufacturing (AMT) and Structural Equation Models. She has published in indexed journals in English and Spanish; such as International Journal of Industrial Engineering and International Journal of Advanced Manufacturing Technology, Expert Systems with Applications, Work a Journal of Prevention, Assessment & Rehabilitation, International Journal of Environmental Research and Public Health, IEEE Access, Complexity, Sustainability among others. She has also collaborated with books and book chapters for Springer Editorial. She received the State Science and Technology Award 2018 and received the “Chihuahuense Destacada” distintion in the Scientific Field in Mexico. She is actually recognized as an investigator SNI 2 by the National Science and Technology Institute.

Downloads

Published

2024-03-20

Issue

Vol. 28 No. 1 (2024): 28(1) 2024

Section

Articles

License 

Hereby I transfer exclusively to the Journal "Computación y 
Sistemas", published by the Computing Research Center (CIC-IPN),
the Copyright of the aforementioned paper. I also accept that these 
rights will not be transferred to any other publication, in any other 
format, language or other existing means of developing.
I certify that the paper has not been previously disclosed or simultaneo
usly submitted to any other publication, and that it does not contain 
material whose publication would violate the Copyright or other 
proprietary rights of any person, company or institution. I certify that 
I have the permission from the institution or company where I work or 
study to publish this work.
The representative author accepts the responsibility for the publication
of this paper on behalf of each and every one of the authors. 
This transfer is subject to the following conditions:
  • The authors retain all ownership rights (such as patent rights) of this work, except for the publishing rights transferred to the CIC, through this document.
  • Authors retain the right to publish the work in whole or in part in any book they are the authors or publishers. They can also make use of this work in conferences, courses, personal web pages, and so on.
  • Authors may include working as part of his thesis, for non-profit distribution only.