Abstract

DUQUE MENDEZ, Néstor Darío et al. MODEL FOR THE EXTRACTION, TRANSFORMATION AND LOAD PROCESS IN DATA WAREHOUSES. AN APPLICATION WITH ENVIRONMENTAL DATA. Cienc. Ing. Neogranad. [online]. 2016, vol.26, n.2, pp.95-109. ISSN 0124-8170.  https://doi.org/10.18359/rcin.1799.

Data warehouse management requires a procedure to ensure the accuracy, completeness, and centralization of data when there are several sources of information, thus making the use of specialized applications for Extraction, Transformation, and Loading of Data -ETL- necessary. These applications have conflicts with the parameterization, lack the implementation of correction filters adaptable to the data characteristics, and can demand high costs for their implementation. In this article, it is presented a generic model that applies the stages of ETL and allows monitoring the process to keep a historical record of errors filtered and to calculate indicators to identify quality in processing. Model validation was performed on a case study with environmental data. The model showed satisfactory results. Finally, it is planned to conduct validations of the model in other areas, including new types and data structures.

Keywords : datawarehouses; consistency; integrity; web processing; ETL process.

        · abstract in Spanish     · text in Spanish     · Spanish ( pdf )