SciELO - Scientific Electronic Library Online

 
vol.22 número1Evaluation of Physicochemical Parameters in Discontinuous Reactors of Activated Sludge for the Treatment of Waters with MethanolOn the Fuzzy Opening Morphological Operator índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Artigo

Indicadores

Links relacionados

  • Em processo de indexaçãoCitado por Google
  • Não possue artigos similaresSimilares em SciELO
  • Em processo de indexaçãoSimilares em Google

Compartilhar


Ingeniería

versão impressa ISSN 0121-750X

Resumo

PLAZAS-NOSSA, Leonardo; AVILA ANGULO, Miguel Antonio  e  TORRES, Andrés. Detection of Outliers and Imputing of Missing Values for Water Quality UV-VIS Absorbance Time Series. ing. [online]. 2017, vol.22, n.1, pp.111-124. ISSN 0121-750X.  http://dx.doi.org/10.14483/udistrital.jour.reving.2017.1.a01.

Context:

The UV-Vis absorbance collection using online optical captors for water quality detection may yield outliers and/or missing values. Therefore, pre-processing to correct these anomalies is required to improve the analysis of monitoring data. The aim of this study is to propose a method to detect outliers as well as to fill-in the gaps in time series.

Method:

Outliers are detected using Winsorising procedure and the application of the Discrete Fourier Transform (DFT) and the Inverse of Fast Fourier Transform (IFFT) to complete the time series. Together, these tools were used to analyse a case study comprising three sites in Colombia (i) Bogotá D.C. Salitre-WWTP (Waste Water Treatment Plant), influent; (ii) Bogotá D.C. Gibraltar Pumping Station (GPS); and, (iii) Itaguí, San Fernando-WWTP, influent (Medellín metropolitan area) analysed via UV-Vis (Ultraviolet and Visible) spectra.

Results:

Outlier detection with the proposed method obtained promising results when window parameter values are small and self-similar, despite that the three time series exhibited different sizes and behaviours. The DFT allowed to process different length gaps having missing values. To assess the validity of the proposed method, continuous subsets (a section) of the absorbance time series without outlier or missing values were removed from the original time series obtaining an average 12 % error rate in the three testing time series.

Conclusions:

The application of the DFT and the IFFT using the 10% most important harmonics of useful values, can be advantageous for its later use in different applications, specifically for time series of water quality and quantity in urban sewer systems. One potential application would be the analysis of dry weather affecting rainy seasons, a feature achieved by detecting values that correspond to unusual behaviour in a time series. Additionally, the results hint at the potential of the method in correcting other hydrologic time series.

Palavras-chave : Imputing missing values; outlier detection; UV-vis absorbance; water quality; winsorizing; Language: English.

        · resumo em Espanhol     · texto em Espanhol     · Espanhol ( pdf )